Senior Software Engineer (Scraping / Web Automation)

Заказчик: AI | Опубликовано: 16.12.2025

Summary We’re looking for a senior software engineer with deep expertise in web scraping and automation to join a compact, fast-moving team working directly with one of our clients on a technically diverse and business-critical system. You’ll collaborate closely with the client (technical founder, serial tech entrepreneur) and two of our internal engineers. This role is ideal for someone who thrives in environments that require both technical depth and adaptability, enjoys working autonomously in a small team, and understands how to deliver value by solving the right problems. About the Project The system is designed to automate and streamline data aggregation from third-party ticketing platforms to support real-time event access management. It performs secure, large-scale login operations across multiple accounts, retrieves time-sensitive barcode data via web automation, and displays the information through a lightweight web interface to ensure seamless entry at venues. This is a multi-component solution built with: Web scraping modules for automated browser-based data collection (PuppeteerSharp, Playwright) Windows background services for periodic data synchronization Azure Function Apps for serverless task orchestration Blazor WebAssembly App for displaying event access codes The system combines performance, automation, and stability to deliver results in a time-critical environment. Your Responsibilities Design, build, and maintain robust scraping and web automation modules for high-volume data retrieval Implement proxy rotation and anti-detection strategies to ensure reliability and longevity of automation Optimize performance and data consistency across scraping jobs and data pipelines Collaborate with the client and internal team on defining priorities, technical direction, and architecture decisions Continuously monitor, troubleshoot, and improve system stability and resilience Ensure compliance with target platforms’ terms and security best practices Contribute to CI/CD improvements and operational reliability Drive improvements through experimentation, innovation, and technical excellence What We’re Looking For 8+ years of software development experience native English skill is required Proven expertise in web scraping and browser automation (e.g., Playwright, Puppeteer, Selenium, custom headless browsers) Strong understanding of proxy management, rotation, and fingerprinting techniques Deep knowledge of HTTP traffic, session handling, cookies, and browser automation internals Experience building fault-tolerant, distributed scraping systems Proficiency in at least one backend language (Python, JavaScript/TypeScript, C#, Go, etc.) - flexibility welcome Familiarity with cloud environments (Azure, AWS, or GCP) and CI/CD Comfort working in a small, highly collaborative team with direct client interaction Ability to balance clean architecture with pragmatic problem-solving Flexible and responsible, with a customer-focused mindset and solid communication skills