Senior Data Engineer
Flixmedia Permanent | Full Time Hours: 37.5 hours per week, Monday to Friday Location: Farringdon, London EC1R 3AU (Hybrid) We’re on the hunt for a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) and big data technologies to power the data that fuels ecommerce performance and large-scale web analytics. You’ll design, build, and optimise high-volume data pipelines—batch and streaming—while partnering with analysts, engineers, and QA to deliver trusted insights. If you thrive on solving tough data challenges and making pipelines sing at scale, this is your stage. What You’ll Be Doing
- Pipeline Engineering: Build, scale, and fine-tune data pipelines in GCP (batch & streaming).
- Code Ownership: Enhance and optimise Java and Python pipelines for speed and cost efficiency.
- Data at Scale: Handle weblog, clickstream, behavioural, and ecommerce transaction data.
- Collaboration: Work with engineers, analysts, and QA to deliver high-quality, reliable data.
- Governance & Quality: Use Dataplex for cataloguing, classification, and governance; enforce data standards and validation.
- Automation & Orchestration: Design workflows in Apache Airflow and automate data quality checks, schema changes, and lifecycle processes.
- Continuous Improvement: Champion best practices, mentor junior engineers, and push for scalable, cost-efficient solutions.
- Commensurate years of experience in data engineering in eCommerce, digital marketing or web analytics.
- Proven expertise in GCP services: BigQuery, Dataflow, Pub/Sub, Dataproc, Dataplex.
- Strong development skills in Java and Python.
- Experience with weblog ingestion & processing, both real-time and batch.
- Solid hands-on use of Apache Airflow.
- Familiarity with AWS Kinesis Firehose for log/data ingestion.
- Knowledge of data governance, metadata management, and stewardship.
- Comfort working with clickstream/analytics platforms (e.g., GA4, Adobe Analytics).
- Collaborative mindset—able to partner seamlessly across engineering, analytics, and QA.
- Experience building or implementing data quality frameworks.
- Knowledge of data modelling (star schema, data vault, wide tables).
- Exposure to ML pipelines and feature store architectures.
- Previous experience in SaaS or ecommerce environments.
- Competitive salary and performance-based bonus
- Contributory Pension, Death In Service
- 24 days holiday (rising to 27) + bank holidays + birthday day off!
- Health perks: Medicash scheme, wellbeing apps (Calm, WeCare, FoothFairy) and enhanced parental pay
- Exclusive discounts: Perkbox, Tastecard
- Flexible working environment, including opportunities for remote work
- A collaborative, high-performance culture with significant opportunities for growth
- International travel and events attendance
- Sales incentives, evets and SPIFFS, dinner nominations (up to £100)