1 to 25 of 294 Data Pipeline Jobs in the UK excluding London

summary Are you a data engineer with a passion for public service? Then maybe you're looking for us! We are seeking an experienced and skilled Advanced Data Engineer to be part of a growing team that delivers on our mission of protecting and improving … Advanced programming skills in SQL and Python/Randa collaborative, CI/CD approach to pushing code; experience with orchestration and data pipeline tools. A user-focused approach to data delivery, ensuring that outputs are accessible, actionable and grounded in real-world context Effective communication ...

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Related Jobs Data Engineer Senior Data Engineer Data Engineer Data Engineer Senior Data Engineer - (Python & SQL) Related Jobs Senior Data Engineer (INV) Senior Consultant, Data Engineer, AI&Data, UKI (INV) Senior Consultant, Data … Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control Strong ...

Senior Data Engineer Remote UK | Occasional Travel Senior Data Engineer | Azure | Microsoft Fabric | Data Platform | Python | SQL | Power BI | AI & Analytics 167 Solutions are partnering with a global organisation embarking on a significant data transformation programme. As investment in analytics … business intelligence continues to grow, we are seeking a Senior Data Engineer to play a key role in shaping and delivering a modern enterprise data platform. This opportunity offers the chance to work on large-scale data initiatives, modern cloud technologies and next-generation ...

solutions for performance, reliability, and scalability, ensuring efficient data processing and storage. Implement and manage orchestration workflows to automate data pipeline scheduling monitoring and error handling. The Requirements As a Data Engineer you will play a crucial role in transforming data … designing and delivering data pipelines using industry-standard tools and cloud technologies. Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies. Proficiency in working with at least one major cloud data ...

contribute to the shaping, validation, and monitoring of data solutions. Your work ensures accuracy, clarity, and integrity across the entire delivery pipeline RESPONSIBILITIES Data Analysis & Insight Development Exploratory Analytics: Conduct detailed exploratory data analysis to identify trends, root causes, and opportunities for improvement … Insight Packaging: Translate complex findings into clear, concise insights, visualisations, and recommendations for both technical and non-technical stakeholders. 2. Data Preparation & Pipeline Support Data Wrangling: Prepare, clean, and transform datasets to support modelling, prototyping, and production-ready pipelines. Requirements Translation: Work with the Data ...

About the role... Are you an experienced Data Architect looking for your next challenge? Cooper Parry is on a rapid growth trajectory, and we’re seeking a Data Architect to lead the design and evolution of our enterprise data platform. This role will play … experience with Microsoft Fabric Deep understanding of: Modern data lakehouse architectures Dimensional and analytical data modelling Data pipeline orchestration Strong SQL skills and experience with distributed data processing Experience designing enterprise‐scale analytics platforms in Azure Ability to translate business requirements ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … Fabric experiences to operationalise models and drive business insights. Design, monitor and optimise data pipelines and platform performance: Use Fabric capacity management, pipeline monitoring, logging, and operational best practices to improve reliability, throughput, cost, and scalability. Collaborate with cross-functional teams: Work closely with business analysts, data ...

Lead Data Engineer Location: London, City (Hybrid) £ Highly competitive base with bonus and benefits Lead Data Engineer is sought by expanding central data platform team within a prestigious global wealth management organisation. This role offers the opportunity to help shape enterprise-wide data engineering standards, contribute to platform strategy, and build modern, scalable data solutions that support business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role ...

identifying data migration requirements. Onboarding datasets, users + workloads onto target platform. Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation. AWS Cloud Platform, S3, IAM, CI/… concepts, DevOps principles, Agile Delivery. Advantageous Skills: Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS/Healthcare data experience. Government/GOV.UK/Public Sector domain experience strongly preferred. Must be active SC Cleared or fully eligible ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … ready architectures, taking end to end ownership from vision through to delivery and value realisation You will be part of the Data Platforms team that is part of the Insights and Data Global Practice that has seen strong growth and continued success across a variety ...

seeking an experienced Data Architect to join our Group Technology team on a 6-month contract. You will help realise the value of the immense Connells Group data landscape for the benefit of customers, colleagues and the overall business. You will use your expertise to define … evolve and communicate the existing Estate Agency enterprise data architecture, to democratise safe access to consolidated and unified data, modelled to help engineering teams develop single customer and property views. The data architecture will also support system migration and integration, to establish effective master ...

Data Platform ManagerUK/RemoteCirca £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where you'll combine … hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

Data Engineer Peterborough (Hybrid) £50,000 - £60,000 Base + Benefits We are seeking an experienced Data Engineer with strong Databricks experience to join a growing Data & Analytics team. As part of this continued growth, the successful candidate will play a key role … developing and enhancing data solutions, working closely with the Data & Analytics Manager and wider team to support the delivery of data-driven initiatives. This is an excellent opportunity for a skilled Data Engineer looking to make an impact within a forward-thinking ...

Data Platform Manager UK/Remote Circa £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where … combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

efficient data processing, storage and retrieval. You will work closely with cross-functional teams to analyse requirements, propose new data pipeline architectures, and implement solutions to improve performance and scalability. The tasks for this post include the following: Analyse existing data pipelines … optimisation, and scalability. Work closely with Bioinformaticians and annotators to integrate data pipelines with existing systems and applications. Monitor data pipeline performance, troubleshoot issues, and implement solutions to ensure reliability and efficiency. Stay current with industry trends and best practices in data engineering ...

summary We are seeking an exceptional Head of Data Engineering (Band 8c) to lead the delivery and continuous development of our enterprise data warehouse and data platform.This is a pivotal senior leadership role responsible for ensuring the Trust's data warehouse provides … high-quality, reliable and timely data to support clinical care, operational performance and strategic decision-making. You will lead the design, delivery and optimisation of data pipelines, integrations and data models, ensuring our platforms are scalable, secure and resilient.Join us to play a leading ...

global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As an AWS Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … ready architectures, taking end to end ownership from vision through to delivery and value realisation You will be part of the Data Platforms team that is part of the Insights and Data Global Practice that has seen strong growth and continued success across a variety ...

global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As an AI Data Engineer at Capgemini, you will design, build and operate reliable, scalable data pipelines and data products that enable analytics … GenAI. You will work hands-on with modern data engineering tools and cloud services to ingest, transform and serve trusted datasets, using AI-assisted engineering to accelerate delivery, improve quality and automate routine tasks—while applying sound judgement and secure engineering practices. You will be part ...

Description As part of our continued growth and investment in our data and analytics capabilities, we’re recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This is a key opportunity to play a central role in shaping how data … decisions, and support ongoing business success. As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting, analytics, and customer marketing capabilities. You’ll work closely with stakeholders to define requirements, develop best-in-class data ...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus … ensure data is handled securely and appropriately. Help create reusable patterns, templates and accelerators for Fabric-based deployments. Troubleshoot data pipeline failures, performance issues, permissions problems and integration challenges. Contribute to technical documentation, solution designs, deployment notes and customer-facing architecture material. Desirable Skills Microsoft ...