Python Scraping Engineer
Python Scraping Engineer - Remote - Python / Java, Google Scraping - £50,000-£70,000
Why this company?
I am recruiting for a company doing serious, specialist Google scraping at scale this is not generic scraping, and not a data engineering role dressed up.
They run 10+ million Google requests per day, operate in highly defended environments, and focus heavily on bot detection, fingerprinting and anti-automation. If you enjoy understanding how Google blocks scrapers and figuring out how to stay ahead of it, this is exactly the kind of role that keeps things interesting.
Engineering here is modern, pragmatic and AI-aware, with a strong emphasis on reliability and ownership. This is a brand-new role, created to strengthen a critical capability, so you will have real impact from day one.
You will work with
- Other experienced scraping and data engineers
- Product and data teams who rely on accurate, trusted extracted data
- Cloud-based infrastructure running scraping at serious scale
What will be involved
- Designing and running high-volume Google scraping systems (10M+ requests/day)
- Building production-grade scrapers in Python or Java
- Handling and evolving solutions for: Bot detection, Fingerprinting, CAPTCHA challenges, IP rotation and request routing
- Scaling scraping infrastructure for throughput, stability and cost
- Debugging failures and adapting quickly to Google changes
- Improving observability, monitoring and operational resilience
Benefits
- £50,000-£70,000 salary
- Fully remote working
- Travel to London once every 3 months
- Highly specialised technical role (no generic scraping work)
- Modern engineering culture with ownership and autonomy
Key experience required
This role is not suitable for generalist data engineers.
You must have:
- Expert-level scraping experience in Python or Java
- Direct, hands-on experience scraping Google at scale
- Deep knowledge of: Anti-bot systems, Bot detection techniques, Fingerprinting, CAPTCHA handling, Scaling scraping infrastructure
- Experience operating systems at millions of requests per day
- Strong communication skills and clear technical reasoning
Interested?
Roles this specialised do not come up often, Apply now or send your CV directly to be considered.