1 to 25 of 40 Permanent Data Pipeline Jobs in the East of England

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with … offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing ...

Broster Buchanan are partnered global business within the food industry with a turnover of £8Bn+ who are looking for a Fabric Data Engineer to join as they set up an exciting new project team within the group. This would suit an experienced Azure Data Engineer with … offer. Responsibilities: Help set up and deliver the future direction of strategy and approach to the management, storage and usage of data Collaborate with their wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing ...

Data Platform Manager UK/Remote Circa £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where … combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

belonging for all our colleagues is central to our journey as a global business. Who You Are/Your Next Challenge The Data Engineer plays a critical role in enabling Finance & Treasury to deliver accurate, timely, and insight‐driven reporting by building scalable data solutions, maintaining … core data infrastructure, and supporting the modernisation of Finance systems. This role is responsible for engineering robust data pipelines, managing datasets across the Microsoft Fabric platform, and ensuring Finance has reliable, consistent, and governed data to support transformation, automation, and improved operational efficiency. ...

business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with ...

complexity manageable and insight actionable supporting everything from premium and ads growth to forecasting, experimentation, and global reporting. As engineers in the Financial Data Platform team, we turn messy, fragmented realities into clean, reusable foundations. We build core datasets that represent key financial domains like Premium … Royalties. We create libraries and tools that empower others to produce and trust financial data at scale. We collaborate deeply with Finance, Product, and Data teams to unlock clarity and drive Spotify s ambitions forward. We are looking for engineers who are excited to shape ...

working with a growing business in Norwich to recruit a newly created Data Manager position. This is a high-impact role working closely with the senior leadership team, using data to provide clearer financial insight, improve visibility of business performance and support smarter commercial decision-making. … hands-on with the technical delivery. You will ensure data is reliable, accessible and well governed, while developing the reporting, warehouse and pipeline capability needed to support continued growth. A key part of the role will involve analysing sales, prospect and audience data to identify ...

Data Engineer – Remote Working/London circ £60,000 - £70,000 Experienced Data Engineer required for this remote working/hybrid position based in West London (near Feltham, Hanworth, Hounslow etc). Ideally the successful candidate will be able to work on site once or twice … client would also consider candidates looking for a remote working role as long as they can be onsite once a month. The Data Engineer will join a small team and play a key role in developing and managing data integration projects as our client transitions data ...

Senior Data Engineer Location: Manchester (Hybrid – 1 day per month on-site) My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment … passionate about leveraging data to deliver tangible business value. This is not a role for someone just moving data from A to B with Python — it's for someone who understands how to model, optimise, and apply data to support better business decisions. ...

everyone deserves the best night’s sleep. As part of our Transport Standardisation & Compliance team, you’ll support the business by ensuring our data is accurate, accessible and increasingly automated, helping colleagues make better decisions and delivering exceptional experiences for our customers. Your Purpose You will support … tools and techniques. Desirable: Experience with reporting or dashboard tools (e.g. Power BI, Tableau, Power Automate) or exposure to ETL/data pipeline concepts. Previous experience in warehousing or logistics is beneficial. Familiarity with PIM/ERP systems or an interest in logistics data management. ...

Title: Senior Data Scientist Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions … enable customers to derive insights quickly. Atreides transforms the chaos of petabyte-scale, all-domain data—land, air, sea, space, and cyber—into real-time operational clarity. We are a fast-moving, high-performance international scale company. We trust our team with autonomy, believing it leads to better ...

Title: Senior Data Scientist Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions … enable customers to derive insights quickly. Atreides transforms the chaos of petabyte-scale, all-domain data land, air, sea, space, and cyber into real-time operational clarity. We are a fast-moving, high-performance international scale company. We trust our team with autonomy, believing it leads to better ...

hands-on technical role, suited to someone with strong Splunk Enterprise and Splunk Enterprise Security experience, who can take ownership of platform engineering, data ingestion, detection content and performance tuning across complex client environments.This is a key technical leadership role, responsible for ensuring the right tooling, controls … tuning.Experience designing and optimising detection content, including MITRE ATT&CK-aligned use cases and alert tuning to reduce noise.Good understanding of data pipeline engineering, log enrichment, data quality and large-scale ingestion architectures.Strong knowledge of SPL; experience with KQL and EQL would be beneficial ...

hands-on technical role, suited to someone with strong Splunk Enterprise and Splunk Enterprise Security experience, who can take ownership of platform engineering, data ingestion, detection content and performance tuning across complex client environments. This is a key technical leadership role, responsible for ensuring the right tooling, controls … designing and optimising detection content, including MITRE ATT&CK-aligned use cases and alert tuning to reduce noise. Good understanding of data pipeline engineering, log enrichment, data quality and large-scale ingestion architectures. Strong knowledge of SPL; experience with KQL and EQL would be beneficial ...

Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming … distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure · Familiarity with Docker, Kubernetes, and CI/CD pipelines · Excellent problem ...

Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming … distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure · Familiarity with Docker, Kubernetes, and CI/CD pipelines · Excellent problem ...

possible to track and then present KPIs effectively across the Group. Main responsibilities Support the implementation and development of the Group Microsoft Fabric data environment Design and maintain data ingestion pipelines from multiple source systems Develop and maintain data models to support reporting … interactive dashboards. Ensuring the dashboard, reporting and design process uses the most appropriate formats to gain maximum user engagement and insight. Ensuring the data integrity of all reports, dashboards, and analysis. Assist in the governance and documentation of BI solutions, including data dictionaries and report inventories. ...

know-how Bonus Points If You Have built complex workflow orchestration systems Know your way around cloud infra Have experience building integrations or data pipelines Love mentoring and growing teams Why Join Saris AI? Join us in building the future of work for the trillion-dollar banking industry ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

hiring experienced professionals to design, scale, and optimise decisioning frameworks across multiple markets. This is an opportunity to work at the intersection of data, AI, and customer engagement, delivering personalised, real-time experiences in a regulated environment. We are hiring for: Lead Decisioning Expert Own and govern … Decision frameworks (eligibility, arbitration, prioritisation) Omni-channel decisioning (real-time & outbound) Decision governance, explainability, regulatory awareness Strong stakeholder management & Agile delivery Lead NBA Data Scientist Design and optimise ML models driving NBA decisioning. Key Skills: Pega CDH adaptive models Strong MLB/RTIM/arbitration logic knowledge Advanced ...