20 of 20 Permanent Data Pipeline Jobs in the East of England

Key Responsibilities: Data Pipelines and … ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools … recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure's suite of services. Collaboration More ❯

Select how often (in days) to receive an alert: Location: UK - Hatfield Job-ID: 215349 Contract type: Standard Business Unit: Data Management/Reporting Life on the team Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We … operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that … supports Computacenter's combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. More ❯

Snowflake Architect Location: Basildon, UK Work from office 3 days per week Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. Collaborate with data analysts, scientists, and other stakeholders to define and fulfil data requirements. Optimize performance and scalability of Snowflake data warehouse, ensuring high … availability and reliability. Develop and maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. Stay up to date with the latest trends and best practices in data engineering and cloud technologies. Cloud Services More ❯

Are you passionate about shaping and delivering data strategies that drive real change and innovation? Do you excel at both setting the vision and rolling up your sleeves to design and implement cutting-edge data solutions? Could you be our next Data Technology Manager, leading by example to modernise our data landscape … while staying hands-on in the work that makes it happen? Data Technology Manager Up to £66,000 Permanent/Full Time Stevenage with Hybrid Working At the IET, making our world a better place starts by creating a better place for our people. At the IET youll have more than just a job. Our work is exciting … quality, scalable solutions, and the leadership skills to inspire and develop a high-performing team. Youll be just as comfortable in a design meeting as you are debugging a pipeline or building a proof-of-concept. Your ability to balance big-picture thinking with practical delivery will be key to your success. Wed love to get to know you More ❯

roles that best align with your skills, interests and university experience to strengthen your application. Roles Available in Location: Stevenage Education required: To apply for a placement in Data, Automation, & Predictive Sciences (DAPS), you must be studying for an Undergraduate Degree in a subject related to the role. Includes Life sciences, Biomedical Sciences, Engineering, Mathematics, Bioinformatics, Computer Science … Business Analysis, Information Sciences, Statistics, Data Sciences, Biology, Chemistry, Physics or related fields. Please read the degree requirements for each role carefully before applying. Other requirements: You will have completed a minimum of 2 years of your undergraduate degree but will not have graduated at the start of your placement. You must be enrolled at a UK or … groups and pre-joining webinars. 2 volunteering days per year. Typical skills you can expect to learn on this placement include teamwork, communication, time management, problem-solving, networking, data analysis and management, and role-specific technical skills. The Roles (6 available) This advert contains multiple roles. All roles are within the Data, Automation & Predictive Sciences Department. More ❯

every decision wemake and action we take, guiding us to deliver impact how and where it mattersmost . Connect to your opportunity We're looking for a skilled Data Lake Reporting Assistant Manager to join our team and play a key role in developing and maintaining our data lake reporting environment. You'll work closely with … experienced data analysts and engineers to deliver impactful reports that help us understand our business better. Key responsibilities include: Collaborate closely with senior data analysts and engineers, contributing to the development and implementation of our reporting strategy. Learn and apply industry best practices for data warehousing, reporting, and visualization. Data Lake Reporting … Environment: Become proficient in navigating and understanding data lake architecture. Assist in implementing data quality checks and validation processes to ensure accurate and reliable reporting. Work alongside data engineers to understand and optimize data pipelines for reporting needs. Translate business requirements into technical specifications for reports and dashboards, working with senior team More ❯

We are excited to offer a new opportunity for an Enterprise Data Architect to join our community of Solution, Data and Infrastructure Architects. Reporting to the Director of Technology Office , you will shape and drive our enterprise-wide data strategy, to establish best practices and guidelines for data management, integration and insights. … with a strong culture of authenticity and innovation. This is a great time to join a growing business, to be part of a new technology team. The Enterprise Data Architect will work closely with our product owners and product/project managers to ensure a robust architectural runway that can support future business requirements throughout the product life … cycle. Key Responsibilities You will be accountable for the data architecture & design, and you will oversee the implementation of enterprise-wide data models, governance frameworks, and architectural standards. You'll guide the design & development of scalable data pipelines and solutions that support our retail operations across the customer journey and channels. With excellent communication More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

in technical decision-making, mentoring, and shaping best practice within the engineering team. Key responsibilities Full stack development using Node.js, TypeScript and React Build and maintain APIs, microservices, data pipelines and integrations with third-party systems Develop React components with SSR (Next.js) and Storybook Architect solutions covering databases, cloud infrastructure and user-facing applications Optimise for speed, scalability More ❯

projects for government and defence clients, using the latest tools and techniques to solve real-world problems. ?? What You'll Do: Design, build, and test powerful backend systems, data pipelines, and web apps. Work in small, agile teams using DevOps best practices. Deploy to cloud environments like AWS and Azure. Own the full software lifecycle-from concept to More ❯

projects for government and defence clients, using the latest tools and techniques to solve real-world problems. What You'll Do: Design, build, and test powerful backend systems, data pipelines, and web apps. Work in small, agile teams using DevOps best practices. Deploy to cloud environments like AWS and Azure. Own the full software lifecycle-from concept to More ❯

join our software group and help build the next generation AI-driven scientific platform. In this role, you will design, build, and optimize backend systems that power intelligent, data-driven applications. You will focus on creating high-performance APIs, architecting scalable data management tooling, and ensuring the reliability of services that integrate advanced AI frameworks with … laboratory workflows. You'll work closely with ML researchers, platform engineers, and scientists to develop systems that can handle diverse workloads and scale seamlessly, including structured SQL database, data lake houses, and vector databases. This is an opportunity to apply your deep backend expertise to a cutting-edge AI platform with real scientific impact. If you are passionate … Building Design & Build APIs: Design and build high-performance, secure, and well-documented APIs that integrate with AI-driven applications. Database Architecture & Scaling: Architect schemas and manage diverse data systems (SQL, NoSQL, Vector DBs, and others) for optimal performance and scalability. Backend Systems Development: Drive the implementation of backend services, focusing on performance, maintainability, and reliability. Performance & Reliability More ❯

Data Engineer (Defence) £45,000 - 55,000 GBP Onsite WORKING Location: Stevenage, Cambridge, East of England - United Kingdom Type: Permanent Data Engineer - Generative AI | Defence Technology A leading international defence organisation is seeking an experienced Data Engineer with a focus on Generative AI to join their IM GenAI Delivery Office in the UK. You … support advanced defence systems and critical internal projects. What you'll do: Develop and maintain robust, secure, and high-integrity datasets for internal defence applications. Design and optimise data pipelines to ensure reliable, compliant, and scalable solutions. Apply your expertise in Generative AI, NLP, and OCR to enhance and automate data processes. Build ETL workflows, APIs … and other data integration solutions tailored for mission-critical environments . Provide guidance on emerging technologies and support the roadmap for next-generation defence data solutions . Skills and experience: Strong knowledge of SQL (MS SQL, Oracle) and noSQL databases (e.g., MongoDB, Neo4J, InfluxDB). Hands-on experience with data processing and integration tools More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 07-Aug-2025 20282 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Engineer & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Engineer & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … lead every decision we make and action we take, guiding us to deliver impact how and where it matters most. Connect to your opportunity As an AI Engineer & Data Scientist, you will be expected to: Build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such as machine More ❯

demonstrating the power of our platform and ensuring our clients' success. Key Responsibilities Client Engagement & Discovery: Collaborate closely with enterprise clients to understand their business processes, pain points, data ecosystems, and strategic goals. Solution Design & Architecture: Design end-to-end solutions by mapping client requirements to our platform's offerings (e.g., Knowledge Hubs, Conversational AI, Real-time Insights … and Agentic Automation). Create detailed architecture documents, data flow diagrams, and technical specifications. MCP Workflow & Ontology Design: Architect the core intelligence for client solutions. This includes designing client-specific ontologies and defining the structure, logic, and composition of Model Context Protocols (MCPs) to automate complex reasoning and workflows. Technical Leadership: Serve as the deep technical expert on … the platform for both clients and internal teams. Provide guidance on best practices for data integration, RAG implementation, and agentic automation. Proof of Concept & Prototyping: Lead the technical design and development of Proof of Concept (PoC) projects to demonstrate the feasibility and value of our solutions for specific client use cases. Cross-functional Collaboration: Work closely with our More ❯

Data Engineer - Generative AI Projects ?? Hybrid | 2-3 Days On-Site | Up to £55,000 + Bonus + Package ?? British Citizens Only | BPSS Clearance Required We're hiring a Data Engineer with a passion for automation, clean pipelines, and the future of AI. This is your chance to shape how data powers Generative AI … on innovative internal use-cases - from AI assistants to intelligent search and document automation - this is the perfect next step. ?? What You'll Be Doing Building and maintaining data pipelines across structured & unstructured sources Collaborating with internal teams to support Generative AI and NLP projects Ensuring data is secure, compliant, high-quality, and easy to access … customers across multiple teams and functions ?? What You'll Bring Experience with SQL & NoSQL databases (e.g. MS SQL, MongoDB, Neo4J) Python skills for scripting and automation ETL and data exchange experience (e.g. APIs, ESB tools) Knowledge of Big Data (e.g. Hadoop) Curiosity about AI, particularly NLP, OCR or Generative AI ?? Bonus Points For Docker/containerisation More ❯

the unrestricted right to work in the UK - this organisation is not able to offer sponsorship. Are you a skilled SQL Server Developer looking to take ownership of data solutions in a dynamic environment? This is a fantastic opportunity to design and implement advanced SQL queries, build robust data pipelines, and deliver impactful reporting using Power … BI. Key Responsibilities: Develop and optimise complex SQL queries and stored procedures. Design and implement scalable data pipelines and ETL processes using SSIS. Create and maintain insightful reports and dashboards using Power BI or SSRS. Collaborate with cross-functional teams to understand data requirements and deliver solutions that drive business decisions. Required Skills: Strong SQL Server … development experience. Proficiency with SSIS for ETL and data integration. Experience with reporting tools such as SSRS or Power BI. What's on Offer: Competitive salary up to £50,000. Hybrid working model - 2-3 days per week on-site in Cambridge. Opportunity to work on meaningful data projects with real business impact. To apply for More ❯