Data Engineer

Data Engineer (Streaming, Kafka, Databricks)

Location: Bristol (3 days on‐site)

Salary: £62,000 – £70,000 + 20% bonus, pension, 37-38 days holiday inluding bank holidays, Perkbox

The Opportunity:

This is a career‐defining Data Engineer role for someone who wants real ownership, real scale, and a clear path to senior‐level responsibility.

We’re building and scaling a modern, real‐time data platform that processes over 1 billion records per month, and we’re looking for a Data Engineer who either:

  • Is ready to step into a senior‐level role, or
  • Is already operating at that level and wants more technical ownership rather than titles and hierarchy

If you enjoy solving hard problems, designing systems that scale, and want a clear progression roadmap, this role is built for you.

What You’ll Be Doing:

  • Building high‐throughput streaming data pipelines
  • Processing ~500 messages per second from real‐time data sources
  • Working with Kafka on AWS, integrating Lambda and ECS
  • Developing data pipelines using Databricks / PySpark
  • Delivering time‐series data into ClickHouse
  • Partnering closely with data scientists to support analytics and modelling
  • Taking increasing ownership of design decisions as the platform evolves

This is a hands‐on engineering role with scope to influence architecture as the data platform expands over the next 6–12 months.

Technology Stack:

Core

  • Python (production)
  • Kafka (streaming data)
  • Databricks or PySpark
  • SQL (MySQL used internally)
  • Cloud: AWS (experience with GCP or Azure also welcome)

Nice to have:

  • ClickHouse or time‐series databases
  • MLflow
  • IoT or high‐volume data environments

Who This Role Is For

This role is ideal if you:

  • Are a strong Data Engineer looking to step up
  • Want exposure to senior‐level responsibility without needing the title today
  • Enjoy building systems rather than maintaining legacy platforms
  • Want ownership, visibility, and influence in a growing team
  • Are comfortable working in a high‐scale, real‐time environment

Formal leadership or line management experience is not required, but there’s a clear pathway into increased technical and platform ownership.

Progression Roadmap

This role is designed to grow with you.

In the first 6 months

  • Own core streaming pipelines
  • Become the go‐to engineer for key parts of the platform
  • Contribute to architectural decisions

Beyond 6–12 months

  • Increased ownership of Databricks and streaming strategy
  • Influence platform standards and best practices
  • Natural progression into a senior‐level engineering role as the team scales

Location & Working Pattern

  • Bristol‐based
  • 3 days per week on‐site (non‐negotiable)
  • Flexible working on remaining days

Salary & Benefits

  • £62,000 – £70,000 base salary (depending on experience)
  • 20% annual bonus
  • Learning and development support
  • Opportunity to work on genuinely large‐scale, real‐time systems

If you need more information please contact me ,Kumbirai Mafini, kumbirai.mafini@opusrs.com

Job Details

Company
Opus Recruitment Solutions
Location
Greater Bristol Area, United Kingdom
Posted