Bots & automationPublished 18 hours ago
Supplier catalog scraper with anti-bot bypass
Regularly export 12 catalog categories to CSV. The site is behind Cloudflare, so careful session handling is needed.
Description
Regularly export 12 catalog categories to CSV. The site is behind Cloudflare, so careful session handling and retries are needed.
Frequency — once a day via cron. Export to S3 or Google Drive. A clear error log is required.
Skills
- Python
- Playwright
- PostgreSQL
- Docker