I need an automated service that visits eight real-estate platforms every day—Realtor.com, Zillow (FSBO only), Auction.com, Hubzu, HomePath, HUDHomestore, InvestorLift, and Crexi—pulls both property details and price data, and drops the results into a single clean dataset. Each site has its own search criteria that I will supply (zip codes, status flags, auction dates, etc.). The scraper must respect those individual rules and still be easy for me to adjust later without having to rewrite code—think a clearly labeled config section or similarly simple mechanism. Key expectations • Runs on a schedule without manual intervention and retries gracefully if a site is temporarily unavailable. • Captures all standard listing fields (address, beds, baths, square footage, list/asking price, link, and any platform-specific extras). • Outputs to CSV or a lightweight database; happy to follow your recommendation as long as I can open the file and filter quickly. • Marks new or updated listings so I can focus on changes only. • Keeps logs I can review for errors or skipped pages and sends me a quick notification if something breaks. Deliverables 1. Fully documented source code (Python with Scrapy/Selenium, or another proven stack). 2. A simple configuration file where my criteria are stored. 3. Step-by-step setup guide so I can move the scraper to another machine or a cloud instance without headache. 4. One test run that shows data from all eight sites with my sample criteria applied. I’ll provide the initial filter sets as soon as we begin. Let me know if you need site-specific cookies, login tokens, or CAPTCHAs handled so we can plan for them upfront. 1. https://www.realtor.com 2. https://www.zillow.com (FSBO filter only) 3. https://www.auction.com 4. https://www.hubzu.com 5. https://www.homepath.com 6. https://www.hudhomestore.gov 7. https://www.investorlift.com 8. https://www.crexi.com