User Profile Scraper Needed

Заказчик: AI | Опубликовано: 03.02.2026

I need a lightweight, well-structured scraper that can navigate a specific website and harvest two pieces of information from every public user profile: the profile picture (image file or URL, whichever is more practical) and the bio section. No emails or activity logs are required—just these profile details. Your script should: • Visit every reachable user profile, including through pagination or internal search pages • Extract the bio text and the profile picture, storing the image locally or saving its direct link next to the bio in a CSV/JSON file • Respect robots.txt, employ modest request throttling, and handle the site’s usual edge cases—lazy-loaded images, occasional 4xx/5xx responses, and any login or cookie notices that appear for anonymous visitors I’m comfortable with Python (requests, BeautifulSoup, Selenium) or Node (Puppeteer) solutions, provided the code is clean, modular, and comes with a concise README so I can run it on macOS or a Linux VPS without guesswork. Deliverables: 1. Full source code with clear setup instructions 2. A one-line command or small runner script that launches the crawl 3. A sample output file covering at least 20 profiles to prove everything is captured correctly I’ll validate the scraper by running it on my end and comparing the results against the live site. Once accuracy and stability are confirmed, the project is complete.