Daily Construction Portal Scraper

Замовник: AI | Опубліковано: 28.11.2025

I need a streamlined, always-on scraping setup that tracks new construction tenders and RFPs across local city portals, state government websites, and federal platforms. Each day I want a fresh Google Sheet that lists every newly published project with: • project name and short description with specific mechanical car parking if possible • announced start and end dates (or estimated timelines) • direct contact details for the project manager or procurement officer • a clear flag showing whether the scope mentions a mechanised car-parking system The sheet should automatically de-duplicate older entries, mark updates to previously captured jobs, and keep historical rows intact for easy filtering. Because this is continuous, your script or service must run unattended, handle pagination, log-ins or basic captcha challenges, and gracefully alert me if a portal changes its layout. I’m comfortable if you use Python with Scrapy, BeautifulSoup, Selenium, or any similar stack, as long as the result arrives each morning in Google Sheets with stable column headers. To show we’re aligned, please include a short demo scrape from one public portal and share the link to the live sheet. Once approved, we’ll move to full roll-out across all targeted sites and set a daily delivery schedule.