Senior back end engineer - Golang

Our global media and consumer technology client is seeking a Senior Back End Engineer to join their data engineering team for an initial 6-month contract. This role focuses on building and maintaining sophisticated browser automation and web scraping systems, helping to collect and process data from web platforms at scale.

This is a fast-paced, high-impact role suited to experienced engineers who are confident working autonomously and contributing to complex data collection systems with minimal on boarding. The ideal candidate will be available immediately or at short notice, and willing to work flexibly as needed to help clear a growing backlog of work.

Key Responsibilities

• Develop and maintain large-scale web scraping systems using headless browsers and automation frameworks
• Build robust data extraction pipelines that can handle dynamic web content and complex user interactions
• Design and implement browser automation workflows for data collection across multiple web platforms
• Create tools for managing browser sessions, handling JavaScript-heavy sites, and bypassing common anti-bot measures
• Optimise scraping performance and reliability for high-volume data collection operations
• Collaborate with data engineering and product teams across global organisations
• Deliver high-quality, efficient code in an agile environment with minimal supervision

Requirements

• Extensive commercial experience with Golang / Go Programming Language in back end development
• Strong experience with browser automation tools (Chromedp, Rod, Playwright, or similar)
• Proven ability to build and support web scraping applications at scale
• Deep understanding of web technologies (HTML, CSS, JavaScript, DOM manipulation)
• Knowledge of HTTP protocols, cookies, sessions, and web authentication methods
• Familiarity with Python is advantageous but not essential
• Experience with concurrent processing and rate limiting for web scraping
• Excellent communication and documentation skills
• Comfortable working independently and able to hit the ground running
• Experience working in global, distributed teams

Desirable Skills

• Knowledge of CAPTCHA handling and browser fingerprinting
• Familiarity with data parsing and extraction from various web formats
• Understanding of web performance optimisation and caching strategies