51 to 75 of 2,576 Data Pipeline Jobs in the UK

constantly evolving needs of our clients across a wide range of markets on a global scale. If you're an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … with organizational standards. Implement CI/CD practices and support deployment automation using Azure DevOps. Monitor, troubleshoot, and resolve data platform and pipeline issues. Collaborate with business stakeholders, analysts, and developers to deliver data-driven solutions. Create and maintain technical documentation, data dictionaries ...

platforms so they are reliable, secure, and easy to change. You will work across engineering and operations to automate delivery, improve data pipeline observability, and embed good governance so analytics and AI workloads can run at scale.You will be part of the Data Platforms team … restricted environments.* Delivering data applications in an automated and continuous fashion.* Utilising tools like Airflow for orchestration and automating data pipeline deployments using DevOps tools and techniques (Docker, Containers, Terraform, Kubernetes)* Building data pipelines using both cloud-native and open-source data ...

Data Engineering activities. Working alongside the wider Data Engineering team, they will help shape, validate and consume the underlying pipelines, data warehouse and data lake that feed reporting, flagging data quality issues and new data needs as they … data platform (Azure Synapse, Data Lake, Microsoft Fabric) that feeds reporting and analytics Monitor, troubleshoot and resolve data pipeline and platform issues, ensuring high availability and reliability for reporting and analytics consumers Work with the wider Data Engineering team on data ...

data engineering team. In this role, you will be responsible for managing and scaling data products, driving data pipeline development, and ensuring the availability, quality, and security of our data assets. You will collaborate closely with cross-functional teams including data … engineering or software engineering roles, with at least 3 years in a leadership/management position. Strong expertise in data pipeline development, ETL/ELT processes, and data warehousing solutions. Proficient with cloud platforms (AWS, GCP, Azure) and big data tools ...

Data Engineer - Belfast (Hybrid) | Databricks & AWS A well-established, large-scale organisation is looking for an experienced Data Engineer to join its growing Data & Analytics team in Belfast. This is a fantastic opportunity for a Data Engineer with experience in Databricks … Databricks notebooks, jobs and workflows Optimise Spark jobs and data workflows for performance and scalability Monitor, troubleshoot and improve data pipeline performance Ensure data quality, integrity, security and compliance Support wider analytics, AI and machine learning initiatives Contribute to continuous improvement and knowledge ...

team OSB Group is undertaking a significant transformation programme, building new cloud-based customer journeys and experiences supported by a modern enterprise data architecture. In parallel, the Group Data Office is responsible for maintaining a complex legacy data landscape that continues … bank today. What you will be doing? As a senior technical leader within the Data Engineering function, the Principal Data Engineer will act as the organisation's Azure Data Platform subject matter expert, providing architectural leadership and technical direction across all data ...

team OSB Group is undertaking a significant transformation programme, building new cloud-based customer journeys and experiences supported by a modern enterprise data architecture. In parallel, the Group Data Office is responsible for maintaining a complex legacy data landscape that continues … bank today. What you will be doing? As a senior technical leader within the Data Engineering function, the Principal Data Engineer will act as the organisation's Azure Data Platform subject matter expert, providing architectural leadership and technical direction across all data ...

About the role... Are you an experienced Data Architect looking for your next challenge? Cooper Parry is on a rapid growth trajectory, and we're seeking a Data Architect to lead the design and evolution of our enterprise data platform. This role will play … experience with Microsoft Fabric Deep understanding of: Modern data lakehouse architectures Dimensional and analytical data modelling Data pipeline orchestration Strong SQL skills and experience with distributed data processing Experience designing enterprise-scale analytics platforms in Azure Ability to translate business requirements ...

categories. The subsidiaries of Tripadvisor, Inc. (Nasdaq: TRIP), include a portfolio of travel brands and businesses, including Tripadvisor, Viator, and TheFork. About the Data Platform Team Our Data Platform team is the engineering backbone of Tripadvisor’s data ecosystem. Formed from … core fundamentals of our Data Engineering and Software Engineering (Data Platform) groups, this unified team combines deep data pipeline expertise with robust platform engineering capabilities. We are responsible for providing software and infrastructure that enable Tripadvisor to better understand visitor preferences, power experimentation ...

experts such as the Cloud Infrastructure team to optimise performance and costs. Experience/Competences Essential Strong experience ETL/ELT data pipeline builds from design, to implementation, to maintenance in relation to financial market messaging platforms, and trade & order systems. Solid understanding of CI/… with a background in software engineering, product management or data analytics. Strong proficiency in Python or Java, SQL, and data pipeline frameworks (e.g., Airflow, dbt, Spark), with solid experience with the AWS ecosystem. Excellent problem-solving skills and ability to work in a fast-paced ...

experts such as the Cloud Infrastructure team to optimise performance and costs. Experience/Competences Essential Strong experience ETL/ELT data pipeline builds from design, to implementation, to maintenance in relation to financial market messaging platforms, and trade & order systems. Solid understanding of CI/… with a background in software engineering, product management or data analytics. Strong proficiency in Python or Java, SQL, and data pipeline frameworks (e.g., Airflow, dbt, Spark), with solid experience with the AWS ecosystem. Excellent problem-solving skills and ability to work in a fast-paced ...

with expertise working with MS Fabric, SQL and Python. We are looking for an experienced engineer who can drive the automated data pipeline development process, starting from requirements gathering, data extraction & loading, through to data modelling, reporting, and ultimately supporting the business. … responsibilities include: Work with the Engineering Operations team to understand and define their data pipeline requirements for their new data projects Collaborate with the wider Engineering teams to understand existing data ingestion and design suitable methods for extraction Design and implement the necessary ...

with expertise working with MS Fabric, SQL and Python. We are looking for an experienced engineer who can drive the automated data pipeline development process, starting from requirements gathering, data extraction & loading, through to data modelling, reporting, and ultimately supporting the business. … responsibilities include: Work with the Engineering Operations team to understand and define their data pipeline requirements for their new data projects Collaborate with the wider Engineering teams to understand existing data ingestion and design suitable methods for extraction Design and implement the necessary ...

Data Pipeline Manager Application Deadline: 31 August 2026 Department: Technology Employment Type: Permanent - Full Time Location: Stratford-Upon-Avon Reporting To: Adam Christopherson Description As the UK’s leading provider of environmental compliance, Valpak strives to work together towards a profitable, sustainable, waste‐free world. To date … passionate about making a positive impact, we'd love to have you on our team. About the role As the Data Pipeline Manager, you will lead a team responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will ...

compensation related questions, including pay details for this role. Job Description The TDS Research Technology team is responsible for delivering the data, analytics, and AI platforms that support Research business capabilities globally. From Belfast, this role will help build the strategic Research data platform leveraging Databricks … enabling reusable data products, modern analytics, and future AI solutions across the organization. Role Description We are seeking a Senior Data Engineer to help build and evolve the strategic Research data platform in Databricks. Working as part of a global Research Technology team, this ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

Senior Data Architect Remote (UK) Up to £90,000 This is an opportunity to shape and scale a modern enterprise data platform while influencing data architecture strategy across a complex organisation. You'll play a key role in designing end-to-end data models, driving cloud-based data architecture decisions, and establishing a robust Medallion architecture that supports analytics, AI, and business intelligence initiatives. The Company They are a well-established organisation undergoing a significant data transformation programme. With continued investment in cloud technologies, modern data ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...

company's internal teams to interact with data comprehensively. The ideal candidate has a strong background in big data processing, pipeline orchestration, and data modeling, with a proven track record of delivering scalable and high-quality data solutions in fast-paced … pipelines and products, ensuring data accuracy and lineage are a top priority. Participate in a shared PagerDuty on-call rotation, responding to pipeline and platform incidents, performing root-cause analysis, and driving remediation and postmortems. Triage production issues quickly and expedite them appropriately, knowing when to loop ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud-native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

Purpose Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data platform, tools … processes. About The Role Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data ...

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...

minds, together we can solve the world’s most complex challenges and deliver more impact together. Role description Arcadis is seeking a Senior Data Engineer to design, develop, and optimise enterprise-scale data solutions that support major projects, programmes, and business functions. As a technical specialist … Demonstrable experience delivering data engineering solutions within complex project, programme, or enterprise environments. Strong experience designing and maintaining ETL/ELT pipelines, data integration processes, and structured data platforms. Experience working with Microsoft Fabric, Azure Data Services, SQL, Power BI, or equivalent ...