1 to 25 of 516 Data Pipeline Jobs in the UK excluding London

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Role Profile Job Title: Data Engineering & Insights Manager (Hybrid Working Policy) 2 days a month. Reports To: Chief Innovation Officer Role Purpose The Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside … delivery of high-quality, business-ready insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations … utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex ...

about making a positive impact, we'd love to have you on our team. About the role We are seeking a Data Pipeline Manager to join the team at Valpak on a permanent basis. This role offers primarily remote working, with occasional travel to our Stratford-upon … Avon office, typically once per quarter. As the Data Pipeline Manager, you will lead a team of 2 responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data ...

Data Pipeline Manager - Remote Working (UK) - Qlik/ADF - Up to £55,000 Are you working with ETL tools and data pipelines but looking for a role where you can have more influence, take ownership and help shape how data integration is done … built a reputation for looking after its people. You Will Work With Leading and supporting a small team responsible for data pipeline development Driving the implementation and adoption of Qlik Talend Building, improving, and maintaining scalable ETL pipelines Working closely with stakeholders to understand requirements and priorities ...

Data Architect is responsible for designing, building, and managing the data warehouse’s data architecture, ensuring it is scalable, secure, and optimized for performance. This position plays a crucial role in shaping our data strategy, working across multiple departments to design … implement a robust data ecosystem that supports our business intelligence, analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

team OSB Group is undertaking a significant transformation programme, building new cloud-based customer journeys and experiences supported by a modern enterprise data architecture. In parallel, the Group Data Office is responsible for maintaining a complex legacy data landscape that continues … bank today. What you will be doing? As a senior technical leader within the Data Engineering function, the Principal Data Engineer will act as the organisation's Azure Data Platform subject matter expert, providing architectural leadership and technical direction across all data ...

About the role... Are you an experienced Data Architect looking for your next challenge? Cooper Parry is on a rapid growth trajectory, and we're seeking a Data Architect to lead the design and evolution of our enterprise data platform. This role will play … experience with Microsoft Fabric Deep understanding of: Modern data lakehouse architectures Dimensional and analytical data modelling Data pipeline orchestration Strong SQL skills and experience with distributed data processing Experience designing enterprise-scale analytics platforms in Azure Ability to translate business requirements ...

Head of Data & Analytics Department: Technology Reporting to: Chief Technology Officer (CTO) Location: London (Hybrid) Client My client is a rapidly growing UK fintech providing innovative consumer lending solutions through proprietary technology. As an FCA regulated business, data sits at the heart of everything … pipelines Change Data Capture (CDC) AWS Database Migration Service (DMS) Amazon Redshift optimisation SQL performance tuning Data pipeline monitoring Automation Data lifecycle management AWS Data Platform Own the organisation's cloud data platform, including: Amazon Redshift AWS Database Migration ...

with expertise working with MS Fabric, SQL and Python. We are looking for an experienced engineer who can drive the automated data pipeline development process, starting from requirements gathering, data extraction & loading, through to data modelling, reporting, and ultimately supporting the business. … responsibilities include: Work with the Engineering Operations team to understand and define their data pipeline requirements for their new data projects Collaborate with the wider Engineering teams to understand existing data ingestion and design suitable methods for extraction Design and implement the necessary ...

with expertise working with MS Fabric, SQL and Python. We are looking for an experienced engineer who can drive the automated data pipeline development process, starting from requirements gathering, data extraction & loading, through to data modelling, reporting, and ultimately supporting the business. … responsibilities include: Work with the Engineering Operations team to understand and define their data pipeline requirements for their new data projects Collaborate with the wider Engineering teams to understand existing data ingestion and design suitable methods for extraction Design and implement the necessary ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance … warehousing. Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. Can make data pipeline design recommendations based on business requirements. Experience with data migration is a plus. Open to new ways of working and new technologies. ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud-native data platforms, with strong expertise in AWS and native data services. Familiarity with Infrastructure ...

with engineering best practices and the ability to translate customer expectations into applied technical functionality are key to success in this role. Key responsibilitiesData pipeline development Build and maintain scalable data pipelines using Apache Spark and PySpark, processing and transforming large datasets across distributed cloud infrastructure. Workflow … monitoring, and execution of data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data ...

Data Engineer £60,000 - £70,000 DOE | East Kent | Generous Hybrid Working Are you an experienced Data Engineer looking for an opportunity to help shape and improve the way a growing international organisation uses data? We're working with a well-established, technology … organisation that is investing in its data and analytics capability. They are looking for a Data Engineer to join their Data Analytics team and play a key role in building reliable, scalable and reusable data solutions. This is an excellent opportunity ...

Senior Data Engineer – Market Data We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process billions of market … engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience ...

small team with a large remit, and we expect AI-assisted development to be embedded in how we work Apply AI tools to accelerate pipeline development, automated testing, anomaly detection and data quality monitoring Stay current with AI developments in the data engineering space … this is non‐negotiable; you must have built and operated production data pipelines on this stack Strong Python skills – used daily for pipeline development, data transformation and automation Experience across at least two of the three core data domains: Customer, Commercial and Operations ...

seeking a Data Engineering Specialist to join the Architecture & Modernization team. You will be instrumental in building … maintaining the data infrastructure for our Data AI platforms. This role will involve hands‐on development, data pipeline creation, and close collaboration with stakeholders across the organization. This role requires a self‐starter with strong execution skills and the ability to work independently. ...

Data Engineer We are looking for an experienced Data Engineer to join a major data transformation programme on an initial 3-month contract. This is a hands-on role for someone who enjoys building robust, scalable data platforms and pipelines. You will … work as part of a wider technical delivery team, helping to develop a modern AWS-based data environment that supports enterprise reporting, analytics and operational decision-making. The successful candidate will ideally be able to attend the Leeds office one day per week. However, flexible arrangements ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

Senior Data/AI Engineer - Manager £60,000 to 77,000 GBP Bonus Hybrid WORKING Location: Manchester, North West - United Kingdom Type: Permanent Senior Data/AI Engineer - Manager Location: Manchester Salary: Up to £77,000 + Bonus Employment Type: Permanent Security Clearance: Must be eligible … performance and solution reliability. Optimise data processing, storage and AI workloads for performance, scalability and efficiency. Produce clear technical documentation covering pipelines, data models, solution logic and technical assumptions. Ensure solutions adhere to appropriate data governance, security and privacy standards. Work as part ...

Senior Data Engineer - Remote We are looking for a Senior Data Engineer to take a key role in developing, modernising and improving the organisations data platform and data warehouse capability. This is a hands-on senior engineering position with genuine ownership. Youll … developing data warehouses, analytical platforms and data pipelines. Strong understanding of ETL/ELT, data transformation and pipeline architecture. Solid knowledge of data modelling, including dimensional modelling, Kimball, star schemas and/or medallion architecture. Hands-on experience with Microsoft Fabric ...