peter/tenderpilot
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13 Commits 1 Branch 0 Tags
685ac00f7cd51fab1914e329f9a5d85b6cf2171b
Commit Graph

3 Commits

Author SHA1 Message Date
Peter Foster
685ac00f7c feat: implement TED EU scraper with Playwright 
- Add Playwright browser automation for TED EU tender scraping
- Install playwright + chromium browser dependencies
- Scraper successfully finds UK-relevant EU tenders (~11 per run)
- Uses headless Chrome with keyword filtering
- Add SCRAPERS_STATUS.md documentation

All 6 main scrapers now operational (digital-marketplace API still down).
Total active tenders: 626
 2026-02-15 13:28:54 +00:00
Peter Foster
6ca3e9c576 fix: clean Apply Now URLs and disable TED demo scraper 
- Strip tracking query params from find_tender URLs (?origin=SearchResults)
- Disable TED EU scraper (requires browser automation, was using demo data)
- Update 220 find_tender database records with clean URLs
- Delete 4 TED demo records from database
- Add URL_FIX_SUMMARY.md documentation

All 615 tenders now have direct links to tender detail pages.
Fixes Apply Now button UX issue.
 2026-02-15 13:18:50 +00:00
Peter Foster
771fcf9d76 Add sector classification module, integrate into all 7 scrapers, fix CF pagination 2026-02-14 17:12:51 +00:00