1 to 25 of 209 Permanent Data Pipeline Jobs in the UK excluding London

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Related Jobs Data Engineer Senior Data Engineer Data Engineer Data Engineer Senior Data Engineer - (Python & SQL) Related Jobs Senior Data Engineer (INV) Senior Consultant, Data Engineer, AI&Data, UKI (INV) Senior Consultant, Data … Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control Strong ...

Senior Data Engineer Remote UK | Occasional Travel Senior Data Engineer | Azure | Microsoft Fabric | Data Platform | Python | SQL | Power BI | AI & Analytics 167 Solutions are partnering with a global organisation embarking on a significant data transformation programme. As investment in analytics … business intelligence continues to grow, we are seeking a Senior Data Engineer to play a key role in shaping and delivering a modern enterprise data platform. This opportunity offers the chance to work on large-scale data initiatives, modern cloud technologies and next-generation ...

solutions for performance, reliability, and scalability, ensuring efficient data processing and storage. Implement and manage orchestration workflows to automate data pipeline scheduling monitoring and error handling. The Requirements As a Data Engineer you will play a crucial role in transforming data … designing and delivering data pipelines using industry-standard tools and cloud technologies. Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies. Proficiency in working with at least one major cloud data ...

contribute to the shaping, validation, and monitoring of data solutions. Your work ensures accuracy, clarity, and integrity across the entire delivery pipeline RESPONSIBILITIES Data Analysis & Insight Development Exploratory Analytics: Conduct detailed exploratory data analysis to identify trends, root causes, and opportunities for improvement … Insight Packaging: Translate complex findings into clear, concise insights, visualisations, and recommendations for both technical and non-technical stakeholders. 2. Data Preparation & Pipeline Support Data Wrangling: Prepare, clean, and transform datasets to support modelling, prototyping, and production-ready pipelines. Requirements Translation: Work with the Data ...

About the role... Are you an experienced Data Architect looking for your next challenge? Cooper Parry is on a rapid growth trajectory, and we’re seeking a Data Architect to lead the design and evolution of our enterprise data platform. This role will play … experience with Microsoft Fabric Deep understanding of: Modern data lakehouse architectures Dimensional and analytical data modelling Data pipeline orchestration Strong SQL skills and experience with distributed data processing Experience designing enterprise‐scale analytics platforms in Azure Ability to translate business requirements ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … Fabric experiences to operationalise models and drive business insights. Design, monitor and optimise data pipelines and platform performance: Use Fabric capacity management, pipeline monitoring, logging, and operational best practices to improve reliability, throughput, cost, and scalability. Collaborate with cross-functional teams: Work closely with business analysts, data ...

Lead Data Engineer Location: London, City (Hybrid) £ Highly competitive base with bonus and benefits Lead Data Engineer is sought by expanding central data platform team within a prestigious global wealth management organisation. This role offers the opportunity to help shape enterprise-wide data engineering standards, contribute to platform strategy, and build modern, scalable data solutions that support business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … ready architectures, taking end to end ownership from vision through to delivery and value realisation You will be part of the Data Platforms team that is part of the Insights and Data Global Practice that has seen strong growth and continued success across a variety ...

Data Platform ManagerUK/RemoteCirca £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where you'll combine … hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

Data Engineer Peterborough (Hybrid) £50,000 - £60,000 Base + Benefits We are seeking an experienced Data Engineer with strong Databricks experience to join a growing Data & Analytics team. As part of this continued growth, the successful candidate will play a key role … developing and enhancing data solutions, working closely with the Data & Analytics Manager and wider team to support the delivery of data-driven initiatives. This is an excellent opportunity for a skilled Data Engineer looking to make an impact within a forward-thinking ...

Data Platform Manager UK/Remote Circa £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where … combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As an AWS Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … ready architectures, taking end to end ownership from vision through to delivery and value realisation You will be part of the Data Platforms team that is part of the Insights and Data Global Practice that has seen strong growth and continued success across a variety ...

global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As an AI Data Engineer at Capgemini, you will design, build and operate reliable, scalable data pipelines and data products that enable analytics … GenAI. You will work hands-on with modern data engineering tools and cloud services to ingest, transform and serve trusted datasets, using AI-assisted engineering to accelerate delivery, improve quality and automate routine tasks—while applying sound judgement and secure engineering practices. You will be part ...

Description As part of our continued growth and investment in our data and analytics capabilities, we’re recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This is a key opportunity to play a central role in shaping how data … decisions, and support ongoing business success. As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting, analytics, and customer marketing capabilities. You’ll work closely with stakeholders to define requirements, develop best-in-class data ...

Azure/Microsoft Fabric Data Engineer - remote - outside IR35 - £500 - 535 (and a perm role - up to £80k) You will be an experienced Azure/Microsoft Fabric Data Engineer and will help design, build and maintain modern data platforms. The role will focus … ensure data is handled securely and appropriately. Help create reusable patterns, templates and accelerators for Fabric-based deployments. Troubleshoot data pipeline failures, performance issues, permissions problems and integration challenges. Contribute to technical documentation, solution designs, deployment notes and customer-facing architecture material. Desirable Skills Microsoft ...

exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start … delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring ...

Azure Data Engineer Manchester(Hybrid) You'll design and build scalable, automated data pipelines that bring together information from across the organisation. It's a hands-on engineering role covering everything from data ingestion to transformation, modelling and delivery, all within a modern Azure … environment. You'll report to the Lead Data Engineer and join our Data Engineering Team, working alongside architects, analysts, testers and agile delivery squads. Responsibilities: * Build and maintain scalable, automated data pipelines using Azure tools like Data Factory, Databricks and Logic Apps ...

applications we might need to close the role ealier than the application closing date - so don't delay! As a Senior Digital Data Engineering Manager, you'll develop and drive the strategic direction for TUI's digital analytics capabilities, ensuring they align with and support business objectives. … analytics data, as you develop automated data quality checks and validation processes, implement monitoring systems for data pipeline health, and create documentation and standards for data quality assurance. Working with cross-functional teams to understand data requirements enables ...

summary Are you passionate about turning data into meaningful insights that improve healthcare services and patient outcomes? South Tyneside Health Collaboration (STHC) is looking for a Healthcare Business Intelligence Analyst to play a key role in developing a data-driven culture across our organisation. Working with … wide range of healthcare datasets, including EMIS and NHS data sources, you will design dashboards, analyse performance, identify trends and opportunities, and provide intelligence that supports strategic decision-making and service improvement. This is an exciting opportunity to join a collaborative and forward-thinking GP Federation where your ...

Lead Data Engineer | Azure | SQL | Python | Team Leadership We're partnering with a market-leading, highly regulated organisation to recruit a newly created Lead Data Engineer position. This is a fantastic opportunity for a hands-on data engineering leader to take ownership … growing data function, leading a team while remaining actively involved in technical delivery. Acting as the bridge between senior leadership and the data team, you'll be responsible for the data engineering roadmap, platform development, engineering standards, and delivery capability. This is a genuine ...

Data Engineer Location: Birmingham (1 day per week onsite) Salary: Up to £48,000 + Benefits Contract: Permanent A Data Engineer is required to join a growing organisation undergoing significant investment in its data and AI capabilities. This is an exciting opportunity to work … Design and optimise SQL-based data models, transformations, and reporting datasets. Support and maintain cloud-based data warehouse infrastructure. Troubleshoot pipeline issues and manage dependencies across multiple data sources. Work closely with stakeholders to translate business requirements into effective data solutions. ...