feat: robust scraping DSL and health monitoring (Phase 2)
- Implemented YAML-driven GenericScraper for resilient scraping - Added ProvidersManager to manage scraper health and active providers - Modernized unified search with systematic Kitsu metadata enrichment - Integrated automated health checks in the scheduler - Added comprehensive tests for scraping DSL and provider health
This commit is contained in:
@@ -11,6 +11,7 @@ beautifulsoup4==4.12.3
|
||||
lxml==5.3.0
|
||||
jieba==0.42.1
|
||||
sqlmodel==0.0.22
|
||||
PyYAML==6.0.1
|
||||
|
||||
# Testing dependencies
|
||||
pytest==8.3.4
|
||||
|
||||
Reference in New Issue
Block a user