feat: robust scraping DSL and health monitoring (Phase 2)
CI / Test (Python 3.11) (push) Has been cancelled
CI / Test (Python 3.12) (push) Has been cancelled
CI / Lint (push) Has been cancelled
CI / Type Check (push) Has been cancelled
CI / Summary (push) Has been cancelled

- Implemented YAML-driven GenericScraper for resilient scraping
- Added ProvidersManager to manage scraper health and active providers
- Modernized unified search with systematic Kitsu metadata enrichment
- Integrated automated health checks in the scheduler
- Added comprehensive tests for scraping DSL and provider health
This commit is contained in:
root
2026-03-24 10:57:19 +00:00
parent 29c7040b20
commit 2b4cc617cb
8 changed files with 535 additions and 268 deletions
+1
View File
@@ -11,6 +11,7 @@ beautifulsoup4==4.12.3
lxml==5.3.0
jieba==0.42.1
sqlmodel==0.0.22
PyYAML==6.0.1
# Testing dependencies
pytest==8.3.4