12 of 12 Data Pipeline Jobs in Essex

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with … offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing ...

belonging for all our colleagues is central to our journey as a global business. Who You Are/Your Next Challenge The Data Engineer plays a critical role in enabling Finance & Treasury to deliver accurate, timely, and insight‐driven reporting by building scalable data solutions, maintaining … core data infrastructure, and supporting the modernisation of Finance systems. This role is responsible for engineering robust data pipelines, managing datasets across the Microsoft Fabric platform, and ensuring Finance has reliable, consistent, and governed data to support transformation, automation, and improved operational efficiency. ...

complexity manageable and insight actionable supporting everything from premium and ads growth to forecasting, experimentation, and global reporting. As engineers in the Financial Data Platform team, we turn messy, fragmented realities into clean, reusable foundations. We build core datasets that represent key financial domains like Premium … Royalties. We create libraries and tools that empower others to produce and trust financial data at scale. We collaborate deeply with Finance, Product, and Data teams to unlock clarity and drive Spotify s ambitions forward. We are looking for engineers who are excited to shape ...

Data Engineer – Remote Working/London circ £60,000 - £70,000 Experienced Data Engineer required for this remote working/hybrid position based in West London (near Feltham, Hanworth, Hounslow etc). Ideally the successful candidate will be able to work on site once or twice … client would also consider candidates looking for a remote working role as long as they can be onsite once a month. The Data Engineer will join a small team and play a key role in developing and managing data integration projects as our client transitions data ...

Senior Data Engineer Location: Manchester (Hybrid – 1 day per month on-site) My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment … passionate about leveraging data to deliver tangible business value. This is not a role for someone just moving data from A to B with Python — it's for someone who understands how to model, optimise, and apply data to support better business decisions. ...

Title: Senior Data Scientist Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions … enable customers to derive insights quickly. Atreides transforms the chaos of petabyte-scale, all-domain data land, air, sea, space, and cyber into real-time operational clarity. We are a fast-moving, high-performance international scale company. We trust our team with autonomy, believing it leads to better ...

Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming … distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure · Familiarity with Docker, Kubernetes, and CI/CD pipelines · Excellent problem ...

/ML-powered features and applications using Python and modern frameworks. Build, integrate, and maintain machine learning models/solutions from data pipelines to API deployment and user-facing delivery. Collaborate with product managers, compliance experts, and engineers to translate business needs into intelligent technologies. Build robust backend … agentic workflows), ensuring security and compliance standards are met. Implement best practices for MLOps, including CI/CD, automated testing, model versioning, and data validation. Architect integrations with vector databases, cloud platforms, and retrieval-augmented generation systems. Qualifications: 3+ years of production experience delivering fullstack AI/ ...

rapidly growing company that specialises in delivering high-intent, high-quality leads while maintaining strict compliance with Financial Conduct Authority (FCA) and General Data Protection Regulation (GDPR) standards. Leveraging advanced APIs, their platform focuses on enhancing eligibility criteria and creating frictionless customer journeys to maximise conversion rates … generation platforms. The successful candidate will be passionate about automation, API integrations, and building conversion-focused user experiences, with a strong awareness of data privacy, security, and compliance. Responsibilities: Develop and maintain full-stack web applications focused on lead generation workflows. Optimise and scale platform performance to manage ...

concept through to a live product. What you'll do Design, build and scale geospatial systems. Collaborating with domain experts across Engineering, Product, Data, Bioinformatics and Nature Strategy, you will translate complex requirements into seamless user experiences. You will help define and run experiments, practice rigorous iteration … bioacoustics. Influence technical strategy and make decisions in ambiguity. You will drive foundational work across product and engineering, helping our teammates navigate various data engineering challenges, guiding technology choice and adoption of best practices. This includes designing and delivering scalable, cloud-based systems and leveraging AI to accelerate ...

systems that power VulnCheck s vulnerability intelligence platform. This is a high-impact, hands-on role where you ll own critical services and data pipelines end-to-end from design through production. You ll play a key role in shaping architecture, improving system performance and reliability, and delivering … primarily looking for candidates based in Cheltenham, United Kingdom. What You ll Do Design and build scalable backend systems, APIs, and data pipelines Own services end-to-end, including architecture, development, deployment, and operation Lead technical design discussions and contribute to system architecture decisions Write high-quality, maintainable ...