1 to 25 of 955 Data Pipeline Jobs in the UK excluding London

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

Contract Data Engineer - £375/day Inside IR35 - Immediate Start Please note - this is a hybrid role with 2-3 days per week required in London based office. You must have the unrestricted right to work in the UK to be eligible for this role - this organisation … data modelling, including schema design, partitioning, indexing, and performance optimisation. Proven experience with Azure Data Factory for ETL/ELT pipeline design, orchestration, and monitoring. Strong SQL skills, including queries, stored procedures, views, and performance tuning. Practical experience supporting data migration projects, including ...

growing world. We leverage cutting-edge technology to optimize operations, enhance customer experience, and drive business growth. We are seeking a Senior Data Engineer to join our team and play a pivotal role. About The Role At Maersk, we are redefining global logistics through data, platform … data ecosystems Operational Excellence Ensure data solutions are reliable, scalable, performant, secure, and production‐ready Monitor, troubleshoot, and continuously improve pipeline performance, data quality, and platform stability Drive automation, observability, and supportability across data, analytics, and AI/ML solutions ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

Role Profile Job Title: Data Engineering & Insights Manager (Hybrid Working Policy) 2 days a month. Reports To: Chief Innovation Officer Role Purpose The Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside … delivery of high-quality, business-ready insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted ...

NEXT CHAPTER STARTS WITH YOU. Data Engineer Build trusted data products that turn complexity into confident decisions Vanquis is strengthening how it uses data to improve customer outcomes, insight and competitive advantage. This is an opportunity to help shape a modern, cloud-first data … tools that improve time to market. Learning together. We document well, share experience and help the wider engineering community grow. Technology stack Snowflake – ELT pipeline development – Agile and DevOps Coalesce – Data modelling and data marts – CI/CD and test automation SQL – Metadata-driven pipelines ...

Closing date: 2026-10-18Location: CardiffSalary: Competitive Salary DOE (per annum)Job type: PermanentWorking pattern: Full timeIndustry: Banking & Financial Services/Data & Advanced AnalyticsCompany: HaysConsultant: Adam SinclairHays office: London-City — 5th Floor, 107 Cheapside,Phone: 0333 010 6203Email: adam.sinclair@hays.comRole ProfileJob Title: Data Engineering & Insights … Manager (Hybrid Working Policy) 1 day a week. Reports To: Chief Innovation OfficerRole PurposeThe Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside the delivery of high-quality, business-ready insights that support strategic decision ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations … utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex ...

about making a positive impact, we'd love to have you on our team. About the role We are seeking a Data Pipeline Manager to join the team at Valpak on a permanent basis. This role offers primarily remote working, with occasional travel to our Stratford-upon … Avon office, typically once per quarter. As the Data Pipeline Manager, you will lead a team of 2 responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data ...

Data Pipeline Manager - Remote Working (UK) - Qlik/ADF - Up to £55,000 Are you working with ETL tools and data pipelines but looking for a role where you can have more influence, take ownership and help shape how data integration is done … built a reputation for looking after its people. You Will Work With Leading and supporting a small team responsible for data pipeline development Driving the implementation and adoption of Qlik Talend Building, improving, and maintaining scalable ETL pipelines Working closely with stakeholders to understand requirements and priorities ...

Data Architect is responsible for designing, building, and managing the data warehouse’s data architecture, ensuring it is scalable, secure, and optimized for performance. This position plays a crucial role in shaping our data strategy, working across multiple departments to design … implement a robust data ecosystem that supports our business intelligence, analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud ...

Manager AI & Data Architect London | Up to £90,000 Were working with a leading change and transformation consultancy that helps organisations turn strategy into practical solutions that deliver lasting impact. Theyre looking for a Manager AI & Data Architect to join their Technology & Data Practice … London. This is an opportunity for an experienced data professional to take ownership of end-to-end data architecture, working across modern data platforms, cloud technologies, analytics and AI to solve complex business challenges. What youll be doing Design and deliver ...

recruiting for a Head of Dat for a Not for Profit based in London. You as the Head of Data will focus of the Data strategy, governance & quality. You will Modernise the cloud data infrastructure, including Microsoft Fabric & Power BI Analytics, MI & self-service … reporting. Building data literacy across the organisation. Head of Data Location: London - Hybrid Salary: £70,000-£96,000 per annum Contract: Permanent, Full Time The Client- Our client is a well-established professional organisation with a strong reputation within its sector and an important role ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

competitive salary, and opportunities for professional development. Apply now to make a difference in our community! We are seeking a dedicated and experienced Data Engineer to join our Insights team. At North East and North Cumbria Integrated Care Board, we are committed to providing high-quality care … modifying and supporting data pipelines or data processing solutions in production or operational environments. Diagnosing and resolving data pipeline, data quality or processing issues, identifying root causes and taking corrective action within agreed parameters. Supporting the deployment of data ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...

constantly evolving needs of our clients across a wide range of markets on a global scale. If you're an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … with organizational standards. Implement CI/CD practices and support deployment automation using Azure DevOps. Monitor, troubleshoot, and resolve data platform and pipeline issues. Collaborate with business stakeholders, analysts, and developers to deliver data-driven solutions. Create and maintain technical documentation, data dictionaries ...

Data Engineer - Belfast (Hybrid) | Databricks & AWS A well-established, large-scale organisation is looking for an experienced Data Engineer to join its growing Data & Analytics team in Belfast. This is a fantastic opportunity for a Data Engineer with experience in Databricks … Databricks notebooks, jobs and workflows Optimise Spark jobs and data workflows for performance and scalability Monitor, troubleshoot and improve data pipeline performance Ensure data quality, integrity, security and compliance Support wider analytics, AI and machine learning initiatives Contribute to continuous improvement and knowledge ...

team OSB Group is undertaking a significant transformation programme, building new cloud-based customer journeys and experiences supported by a modern enterprise data architecture. In parallel, the Group Data Office is responsible for maintaining a complex legacy data landscape that continues … bank today. What you will be doing? As a senior technical leader within the Data Engineering function, the Principal Data Engineer will act as the organisation's Azure Data Platform subject matter expert, providing architectural leadership and technical direction across all data ...

About the role... Are you an experienced Data Architect looking for your next challenge? Cooper Parry is on a rapid growth trajectory, and we're seeking a Data Architect to lead the design and evolution of our enterprise data platform. This role will play … experience with Microsoft Fabric Deep understanding of: Modern data lakehouse architectures Dimensional and analytical data modelling Data pipeline orchestration Strong SQL skills and experience with distributed data processing Experience designing enterprise-scale analytics platforms in Azure Ability to translate business requirements ...

categories. The subsidiaries of Tripadvisor, Inc. (Nasdaq: TRIP), include a portfolio of travel brands and businesses, including Tripadvisor, Viator, and TheFork. About the Data Platform Team Our Data Platform team is the engineering backbone of Tripadvisor’s data ecosystem. Formed from … core fundamentals of our Data Engineering and Software Engineering (Data Platform) groups, this unified team combines deep data pipeline expertise with robust platform engineering capabilities. We are responsible for providing software and infrastructure that enable Tripadvisor to better understand visitor preferences, power experimentation ...

experts such as the Cloud Infrastructure team to optimise performance and costs. Experience/Competences Essential Strong experience ETL/ELT data pipeline builds from design, to implementation, to maintenance in relation to financial market messaging platforms, and trade & order systems. Solid understanding of CI/… with a background in software engineering, product management or data analytics. Strong proficiency in Python or Java, SQL, and data pipeline frameworks (e.g., Airflow, dbt, Spark), with solid experience with the AWS ecosystem. Excellent problem-solving skills and ability to work in a fast-paced ...