ProBoard
Bots & automation
Bots & automationPublished 18 hours ago

Supplier catalog scraper with anti-bot bypass

Regularly export 12 catalog categories to CSV. The site is behind Cloudflare, so careful session handling is needed.

Description

Regularly export 12 catalog categories to CSV. The site is behind Cloudflare, so careful session handling and retries are needed. Frequency — once a day via cron. Export to S3 or Google Drive. A clear error log is required.

Skills

  • Python
  • Playwright
  • PostgreSQL
  • Docker