Web Scraping Expert Needed (Anti-Bot / Cloudflare / Akamai Experience Required)

Заказчик: AI | Опубликовано: 19.12.2025
Бюджет: 250 $

Project Description We are looking for an experienced web scraping engineer to build a reliable data extraction system from modern, protected websites. The target sites use advanced anti-bot protections (e.g. Cloudflare, Akamai) and JavaScript-rendered content, so this role is not suitable for basic requests/BeautifulSoup scrapers. Project Goal Scrape structured data from protected business listing websites Normalize and export data for automation workflows Build a scraper that is stable, maintainable, and production-ready Key Responsibilities Scrape data from JavaScript-heavy websites Bypass common bot-detection systems ethically and safely Handle pagination, infinite scroll, and dynamic loading Implement human-like behavior (delays, scrolling, session handling) Extract structured fields (title, price, location, description, contact info where available) Implement logging, retries, and error handling Deliver clean, well-documented code Required Skills Strong experience with Playwright or Puppeteer Proven experience scraping Cloudflare / Akamai protected sites Knowledge of anti-bot detection mechanisms Experience with: Headless & headful browsers User-agent rotation Session & cookie handling Python or Node.js Clean code & modular scraper design Nice to Have Experience with proxy services (residential / rotating IPs) Google Sheets or API integrations Automation tools (n8n, Zapier, Make) Docker or VPS deployment experience What We Expect A working prototype before full implementation Clear explanation of scraping approach Honest discussion about limitations and maintenance Professional communication and fast feedback cycles To Apply Please include: Your experience with protected websites (Cloudflare/Akamai) Tools you would use and why Example projects or code (if possible) Your estimated timeline for a prototype Applications that mention only requests/BeautifulSoup will be ignored. If you want, I can also: make a shorter version (Freelancer likes concise posts) tune it for budget vs expert-level pricing add screening questions to filter bad applicants Just tell me.