I need a lightweight, robust crawler that can pull internship postings from a list of companies and aggregate them into a single, clean data set I can work with immediately. The script should probe each source in real time or near-real time, handle pagination and rate limits gracefully, and return the standard details I rely on—gig title, description, budget (if shown), client name, posting date, skills/tags, and the direct URL. Primary focus • Only freelance gigs; full-time and part-time roles can be ignored at the crawl or filtering stage. • I want this running ASAP, so please keep setup friction low. A single command to spin it up locally (Python + BeautifulSoup/Scrapy, Node + Cheerio/Puppeteer, or another proven stack you prefer) is fine as long as it is well-documented. Deliverables 1. Source-controlled code with clear instructions to install, configure targets, and schedule runs. 2. A sample output file (CSV or JSON) populated by at least one full sweep. 3. Brief walkthrough of how to add or remove target sites in the future. Send a concise but detailed project proposal outlining your chosen tech, timeline to first successful scrape, and any past experience handling anti-bot measures or complex site structures. I’m ready to move right away and happy to answer technical questions as they come up.