20 of 20 Permanent Data Pipeline Jobs in the East of England

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary More ❯

Join a Leading Semiconductor Company as an ESG Data Reporting Manager ! Job Overview: Be at the forefront of sustainability transformation in a global tech leader. This is a unique opportunity to lead the development of a cutting-edge ESG data infrastructure, supporting regulatory compliance and strategic reporting. You’ll drive the integration of platforms like Workiva … and a new Carbon Management system to create a trusted, enterprise-wide ESG data ecosystem. Contract Details Contract Length: 12 months (with potential to extend or convert to permanent) Location: Cambridge (hybrid – twice per week on-site) Daily Rate: £700 per day through umbrella Key Responsibilities Lead the design and implementation of an ESG data governance … framework (policies, ownership, controls, RACIs). Oversee the development of an ESG data lake and integration with Workiva and Carbon Management platforms. Map and standardize ~100 ESG metrics; develop scalable templates for future data needs. Automate manual data feeds from HR, supply chain, and facilities systems. Align ESG reporting with regulatory frameworks including CSRD More ❯

Data Engineer Are you a data professional with strong SQL skills and a passion for building scalable data systems? Do you want your work to directly impact learners, educators, and decision-makers? A leading education provider is seeking a Data Engineer to join their Management Information Services (MIS) team. This is a … key role in shaping the way data is collected, stored, and used across the organisation to support strategic decisions, ensure compliance, and drive digital transformation. What You’ll Be Doing Designing and managing SQL-based data infrastructure and ETL processes Developing and maintaining data models, stored procedures, and integrated data pipelines Building … insightful dashboards and visualisations using Power BI or SSRS Supporting internal and external reporting needs, including funding body submissions Contributing to data governance, quality assurance, and compliance with UK GDPR Collaborating with IT and digital teams on data architecture and transformation initiatives What We’re Looking For Strong experience with SQL Server databases and data More ❯

Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the … future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that … either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet systems. Collaborating with a More ❯

with an average profit share of £3,532-£10,861. Softwire is one of the UK's leading digital technology consultancies, offering services in data, AI, cloud, CX, innovation, design, and software engineering. We deliver high-profile, mission-critical, and transformational projects for household names across the public and private sectors. Founded on the idea to be the … Our culture and values emphasize doing jobs properly, making work fulfilling and fun, extending kindness, and trusting each other to reduce bureaucracy. In brief We seek well-rounded data engineers capable of tackling complex data challenges, impressing clients, and impacting team output. We offer a supportive environment with career development, mentorship, and diverse project opportunities. You … will work with talented developers and data engineers, supported by a Technical Lead, on projects such as: Data modeling for Moorfields Eye Hospital's INSIGHT programme Maintaining data pipelines and dashboards on Elexon's Azure platform Implementing AI transcription services for the BBC using GenAI Migrating legacy Excel workflows for a financial services firm More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

control for subscribers. The world's largest content providers, including Amazon, Google and Microsoft trust Bango technology to reach subscribers everywhere. Bango, where people subscribe. Role As Product Data Analyst you will play a key role in building the Bango Digital Vending Machine that makes Bango the place where people subscribe. Reporting to VP Product, you will play … ignite ideas and opportunities to drive the growth of the DVM as well as design dashboards for tracking performance. We are seeking a highly motivated and detail-oriented Data Analyst to join our team. In this role, you will be responsible for turning raw data into actionable insights that drive strategic decisions across the business. Responsibilities … Discover opportunities in data for Bango to drive the performance of the Bango Digital Vending Machine and new data product opportunities. Conduct in-depth exploratory, descriptive, and diagnostic analysis to identify patterns, trends, and anomalies. Build and maintain dashboards and reports to track key performance indicators (KPIs) Collaborate with stakeholders across product, marketing, engineering, operations, sales More ❯

As a Data Scientist, you'll join our dynamic Business Performance & Insights team, working alongside talented data analysts, engineers, and subject matter experts. You'll deliver high-impact machine learning models and analytics solutions that directly influence business strategy and service performance. This is more than a technical role-you'll be a strategic partner, using … and communities, and to make better use of water and safeguard the local environment now and in the future. We're on a journey to become a truly data-driven organisation. With data at the heart of how we serve our customers and drive performance, we are building a culture of innovation and insight-led decision … making across the business. Key Responsibilities Design and develop advanced analytics and machine learning models to solve real-world business challenges. Work across departments to identify opportunities where data science can deliver measurable value. Create powerful visualisations and present findings to technical and non-technical stakeholders. Build, deploy, and maintain robust data pipelines and production-grade More ❯

Subject Matter Expert (SME) on Technical and Functional domain areas. What we value Demonstrated experience in Python, PySpark and SQL (AWS Redshift, Postgres, Oracle). Demonstrated experience building data pipelines with PySpark and AWS. Application development experience in financial services with hands on designing, developing, and deploying complex applications.Demonstrated ability to translate business requirements in a technical design … looking for, we don't necessarily need you to fulfil all of them when applying. If you like change and innovation, seek to see the bigger picture, make data driven decisions and are a good team player, you could be a great fit. About State Street What we do. State Street is one of the largest custodian banks … markon the financial services industry. For more than two centuries, we've been helping our clientssafeguard and steward the investments of millions of people. We provide investment servicing, data& analytics, investment research & trading and investment management to institutional clients. Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Driving modernisation of data processes and tools across the business Supporting key areas like risk, commercial, and customer functions with reliable data solutions Collaborating with stakeholders to shape scalable, efficient data architecture Building conceptual and physical data models to … support reporting and analysis Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and building models More ❯

Data Warehouse Engineer Location: Newark Salary: £35,000-£38,000 A well-established organisation in the Newark area is seeking a Data Warehouse Engineer to take ownership of its centralised data platform. With a current team member transitioning out at the end of July, this role is ideal for someone confident in SQL, data warehousing, and Power BI, who can hit the ground running in a collaborative, technically strong environment. You'll join a close-knit data team and work alongside a colleague focused on reporting to deliver meaningful insights and maintain a robust, scalable data infrastructure. This position offers exposure to a wide range of ERP systems … and an opportunity to shape the business's approach to data and reporting. Key Responsibilities: Manage and maintain the central data warehouse across multiple ERP platforms Develop and optimise SQL queries to support reporting and data access Build and maintain Power BI dashboards and visualisations Collaborate with internal teams to understand reporting needs and More ❯

Data Warehouse Engineer Location: Newark Salary: £35,000-£38,000 A well-established organisation in the Newark area is seeking a Data Warehouse Engineer to take ownership of its centralised data platform. With a current team member transitioning out at the end of July, this role is ideal for someone confident in SQL, data warehousing, and Power BI, who can hit the ground running in a collaborative, technically strong environment. You'll join a close-knit data team and work alongside a colleague focused on reporting to deliver meaningful insights and maintain a robust, scalable data infrastructure. This position offers exposure to a wide range of ERP systems … and an opportunity to shape the business's approach to data and reporting. Key Responsibilities: Manage and maintain the central data warehouse across multiple ERP platforms Develop and optimise SQL queries to support reporting and data access Build and maintain Power BI dashboards and visualisations Collaborate with internal teams to understand reporting needs and More ❯

Role Overview: We are currently looking for a Data Team Lead to head our data operations and strategy.This is a hands-on leadership role responsible for managing a small but growing data team, ensuring the delivery of high-quality data infrastructure, reporting, and business intelligence tools to support cross-functional goals.The ideal … candidate will have a strong technical background, experience in team management, and the ability to align data processes with business objectives. Key Responsibilities: Lead and develop the internal data team, including hiring, mentoring, and performance management Build and maintain scalable data pipelines, storage solutions, and reporting dashboards Ensure data accuracy, quality, governance … and compliance with relevant standards Translate business needs into technical requirements and data-driven solutions Collaborate with marketing, product, and executive teams to support decision-making Monitor performance metrics and proactively identify areas for optimisation Own and refine the company's data strategy, aligned with broader business goals Requirements: Minimum 5 years of experience in data More ❯

Evaro is looking to do for health care what online banking has done for finance, and we're looking for a Head of Data Science to help us that through data-driven insights and innovations. Our mission? To increase accessibility to prescription medications and improve health outcomes by providing a seamless, technology-driven solution that empowers … brands to integrate digital health services effortlessly, Evaro strives to build the online banking for UK healthcare. About the job We're looking to hire a Head of Data Science to build out and lead the data science capabilities across the organisation. You'll have a background in analytics, machine learning, and leading data teams. You'll be joining the company at an exciting time, working to build out a data team to help drive the company's direction. Ensuring that data isn't just analyzed but transformed into actionable insights that directly improve patient outcomes. Join Evaro as Head of Data Science to harness the More ❯

week to charitable causes, with bold ambitions to double their impact in the next decade. Why This Role? 🛠 You'll play a critical role in owning and optimising data and reporting pipelines, overseeing daily operations and release management, while being technical enough to dive into ETL, AWS, or BI issues as they arise. You’ll lead a small … offshore supplier team and ensure smooth, efficient delivery of BI data services across the business. What You’ll Be Doing: Monitor, troubleshoot, and manage daily Data Ops, including ETL workflows and Power BI releases Be the escalation point for Level 2/3 support, resolving issues hands-on across AWS (Airflow … S3, Redshift, Glue) Lead and coordinate with a team of 5–6 offshore data engineers and suppliers Support and automate Power BI deployments and data pipeline releases Own release communications and issue resolution across stakeholders Work closely with the BI Operations Manager and wider tech/data teams Tech Stack You’ll Use More ❯

continuous improvement of existing models and the development of cutting-edge technologies that address future business needs. Key Responsibilities: Technical lead in designing full-cycle AI solutions, including data collection and pipelines for reusable analysis, and monitoring and maintenance regimes for continuous development. Research, develop, deploy, and maintain scalable AI-powered solutions for Cambridge English products. Estimate time … and apply effective risk management to ensure prompt delivery Deep experience in Python and PyTorch/TensorFlow. Industry experience in building scalable, production-grade AI services and automated data pipelines with tools like Docker, Kubernetes, and cloud platforms (e.g., AWS). Proven ability to collaborate effectively in Agile/Scrum teams and contribute to cross-functional projects. Exceptional More ❯

design, and efficiency. Deep expertise in developing, training, and deploying models using frameworks like PyTorch and TensorFlow. Demonstrated experience in building scalable, production-grade AI services and automated data pipelines with tools like Docker, Kubernetes, and cloud platforms (e.g., AWS). Strong understanding of data analysis, model evaluation, and error analysis to drive continuous model improvement. More ❯

design, and efficiency. Deep expertise in developing, training, and deploying models using frameworks like PyTorch and TensorFlow. Demonstrated experience in building scalable, production-grade AI services and automated data pipelines with tools like Docker, Kubernetes, and cloud platforms (e.g., AWS). Strong understanding of data analysis, model evaluation, and error analysis to drive continuous model improvement. More ❯

Research & development of new AI/ML methods Deployment and serving of models at scale Infrastructure automation and cloud-native design Responsible AI, LLM safety, and interpretability tooling Data pipelines, versioning, and observability in production A glimpse of roles we recruit for: AI Research Scientist Machine Learning Engineer Data Engineer with ML experience Applied Scientist/… D departments aiming to scale machine learning adoption throughout their organisations. We support VC-backed companies undergoing rapid headcount growth and collaborate closely with technical consultancies specialising in data and ML solutions. Our experience also extends to stealth-mode ventures and cutting-edge AI labs, along with cloud infrastructure teams within mid-market technology firms looking to enhance More ❯

Architect, build and validate custom test setups, integrating electronics, fluidics, mechanical fixtures, and environmental control Develop LabVIEW-based automated test software with intuitive interfaces, scalable architecture, and robust data handling Design and fabricate (or outsource) custom mechanical and electronic test hardware including fixtures, PCBs, and gas/fluid setups Create detailed test specifications, plans and scripts to characterise … sensor performance and validate compliance Execute verification, qualification and correlation tests across development and early production stages Build data pipelines and analysis tools in Python or MATLAB to extract, visualise and interpret key performance insights Work closely with hardware, software, firmware and applications teams to define test criteria and refine results Contribute to lab infrastructure development and help More ❯