1 to 25 of 305 Data Pipeline Jobs in the UK excluding London

summary Are you a data engineer with a passion for public service? Then maybe you're looking for us! We are seeking an experienced and skilled Advanced Data Engineer to be part of a growing team that delivers on our mission of protecting and improving … Advanced programming skills in SQL and Python/Randa collaborative, CI/CD approach to pushing code; experience with orchestration and data pipeline tools. A user-focused approach to data delivery, ensuring that outputs are accessible, actionable and grounded in real-world context Effective communication ...

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Data Engineer FTC – 18 Months – Coventry - University of Warwick £47,389 - £56,535 (D.O.E) 42 Days Holidays (Inc Bank Hols) Excellent Pension Contributions Hybrid Working Great Food, Gym and Leisure Facilities on-site We are seeking a new addition for our Data Labs Team to assist … architects, system owners and end users to ensure quality issues are addressed as needed. Documentation ▪ Create and maintain technical documentation, including data pipeline specifications, data models, and transformation logic, to facilitate knowledge sharing and support future enhancements. Collaboration ▪ Collaborate with cross-functional teams, including data ...

summary Are you a strong Data Engineer who builds reliable pipelines, improves data quality and delivers trusted data products? BPAS is recruiting a Data Engineer to join the growing Business Intelligence team at an important stage of development. You will work with … Software Engineering, IT and business stakeholders to deliver secure, practical data solutions. Reporting to the BI Lead, you will strengthen the data foundations that support reporting, analytics, service improvement and decision-making. You will design and maintain robust data pipelines and analytical data ...

Senior Data Engineer Remote UK | Occasional Travel Senior Data Engineer | Azure | Microsoft Fabric | Data Platform | Python | SQL | Power BI | AI & Analytics 167 Solutions are partnering with a global organisation embarking on a significant data transformation programme. As investment in analytics … business intelligence continues to grow, we are seeking a Senior Data Engineer to play a key role in shaping and delivering a modern enterprise data platform. This opportunity offers the chance to work on large-scale data initiatives, modern cloud technologies and next-generation ...

Title: Senior Data Engineer Location: Warwick (Hybrid Working) Contract: Initial 6 Months Pay Rate: £550 - £650 (Umbrella) Role Overview Our client is seeking a hands-on Senior Data Engineer with deep experience in enterprise data warehousing and data integration. This role … develop, and maintain ETL/ELT processes utilising tools such as Matillion. Create and maintain optimal data flows and data pipeline architectures. Create and implement semantic data models, including fact and dimension tables. Own the end-to-end data lifecycle: extraction ...

analytics data, as you develop automated data quality checks and validation processes, implement monitoring systems for data pipeline health, and create documentation and standards for data quality assurance. Collaborating with the Architect to implement technical designs means you'll translate architectural … systems such as Google Cloud Platform and cloud storage solutions like Snowflake/AWS. You have deep understanding of data pipeline design, ETL processes, and data integration tools, combined with expertise in relational and NoSQL databases, that ensures you can build robust solutions ...

Title Engineering Data Integrity Lead Grade P3 Function Engineering Location Gloucester Security Clearance Required Baseline BPSS and SC Duration Permanent Hours 37hrs per week Raytheon UK At Raytheon UK, we take immense pride in being a leader in defence and aerospace technology. As an employer, we are dedicated … manage the end-to-end data platforms which control product design change, ensuring all changes are correctly assessed, approved, implemented, and recorded. Pipeline and Infrastructure - drive the creation of scalable and efficient pipelines and processing systems for data ingestion, transformation and access - including engineering change ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

with engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role. Key responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow … monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

seeking an experienced Data Architect to join our Group Technology team on a 6-month contract. You will help realise the value of the immense Connells Group data landscape for the benefit of customers, colleagues and the overall business. You will use your expertise to define … evolve and communicate the existing Estate Agency enterprise data architecture, to democratise safe access to consolidated and unified data, modelled to help engineering teams develop single customer and property views. The data architecture will also support system migration and integration, to establish effective master ...

seeking an experienced Data Engineer to join our Group Technology team on a 9-month contract.Youll play a key role in delivering Connells Group Reporting Data, covering medallion architecture, data modelling, design, and pipelines. Youll work closely with technical specialists to innovate, share ideas … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

Description We are seeking an experienced Data Engineer to join our Group Technology team on a 9-month contract. You’ll play a key role in delivering Connells Group Reporting Data, covering medallion architecture, data modelling, design, and pipelines. You’ll work closely with … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

Lead Data Engineer/Data Tech Lead Permanent, Leeds/Hybrid Who are we? Enablis is a technology delivery consultancy who partner with clients to accelerate digital roadmaps. By combining our deep knowledge and best practice experience with the client’s domain expertise, we are able … open the door to incredible opportunities and introduce you to a network of equally driven, like-minded professionals. Job Brief The Lead Data Engineer role is responsible for owning the technical direction, design and delivery of data platforms and data engineering solutions ...

Data Platform Manager UK/Remote Circa £70k per annum + 15% bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where … combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

Description We’re looking for a talented and passionate Core Data Engineer to join our Group Technology team in Milton Keynes. You’ll play a key role in delivering Connells Group Reporting Data, covering architecture, data modelling, design, and pipelines. You’ll work closely … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

efficient data processing, storage and retrieval. You will work closely with cross-functional teams to analyse requirements, propose new data pipeline architectures, and implement solutions to improve performance and scalability. The tasks for this post include the following: Analyse existing data pipelines … optimisation, and scalability. Work closely with Bioinformaticians and annotators to integrate data pipelines with existing systems and applications. Monitor data pipeline performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency. Stay current with industry trends and best practices in data engineering ...

Azure Data Technical Specialist: For one of our globally leading tech clients we are urgently looking for an experienced Azure Data Technical Specialist for a long contract based in Gateshead, England, United Kingdom. Its paying well and my client can interview asap! Key Responsibilities Design … processing. Collaborate with business and technical stakeholders to gather and implement data requirements. Monitor, troubleshoot, and optimize data pipeline performance. Ensure data quality, accuracy, and reliability. Stay current with Azure data platform innovations and best practices. Required Skills Strong ...

Christmas shut down) Position Overvie w My client are looking for an experienced Microsoft Fabric & Azure Engineer with hands-on experience in data ingestion, Microsoft Fabric, and Azure data services. This role is focused on building and supporting data pipelines that move data from on-premise systems into Microsoft Fabric and Azure, helping to improve reporting, analytics, and overall data visibility across the business. You will be responsible for designing and maintaining data ingestion processes, supporting Lakehouse architecture, and ensuring data is secure, reliable ...

data strategy across service sAssess current (“as-is”) and future (“to-be”) states of data platforms and pipeline sDevelop a short- to medium-term strategic roadmap aligned with broader organisational and government data strategie sDefine and implement policies, standards, and governance frameworks … complex organisation sStrong expertise in cloud-based data platforms (AWS preferred )Experience with modern ETL/ELT tools and data pipeline framework sSolid understanding of data modelling, warehousing, and transformation best practice sExperience across the data science/ML lifecycle from ...

Description As part of our continued growth and investment in our data and analytics capabilities, we’re recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This is a key opportunity to play a central role in shaping how data … decisions, and support ongoing business success. As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting, analytics, and customer marketing capabilities. You’ll work closely with stakeholders to define requirements, develop best-in-class data ...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus … ensure data is handled securely and appropriately. Help create reusable patterns, templates and accelerators for Fabric-based deployments. Troubleshoot data pipeline failures, performance issues, permissions problems and integration challenges. Contribute to technical documentation, solution designs, deployment notes and customer-facing architecture material. Desirable Skills Microsoft ...

Head of Data Bristol (Hybrid) From £90k Certified B Corp We're at a pivotal point in our growth. As an established and industry-leading packaging data company, we're investing heavily in building products that help organisations make smarter decisions about their packaging — improving sustainability … while reducing costs. At the centre of this is a platform that brings together fragmented packaging data, applies complex regulatory logic, and enables customers to model packaging decisions across multiple markets. As this platform evolves, there's a clear opportunity to go further - moving beyond reporting and compliance ...