26 to 50 of 628 Data Pipeline Jobs in the UK

Director of Data and AI Department: Platform Employment Type: Permanent Location: London Reporting To: James Complin Description We’re seeking a strategic Director of Data and AI to lead, develop, and empower our Data and AI teams. This role balances leadership with technical excellence … define how data, analytics, machine learning, and generative AI enable the wider business. You’ll work closely with senior stakeholders, translating business objectives into a clear Data and AI strategy, and ensuring the team delivers scalable, trusted, secure, and commercially impactful solutions. The ultimate goal will ...

Data Platform ManagerUK/RemoteCirca £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where you'll combine … hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

team : \n We are looking for a skilled Analytics Engineer to join our team and help build and \n maintain robust data pipelines that support our analytics applications. \n The Data Engineering team has recently undergone a technology transformation to \n migrate from our legacy data … entities and processes are integrated \n downstream in the Snowflake data platform model \n ● Monitor and troubleshoot data pipeline issues and provide timely resolution. \n ● Work closely with product managers, data scientists, product analysts and \n software engineers to identify analytical requirements. ...

flexible working arrangements for any of our roles and offer workplace accommodations to ensure you can deliver effectively. Key Responsibilities Document and catalogue data requirements for existing and redesigned business processes. Lead complex data analysis to validate business requirements, interrogating source systems directly. Translate data … models and dimensional modelling (star schemas, fact/dimension tables). Proficient in data architecture principles, ETL processes and data pipeline concepts. Experience with data cataloguing tools, SQL for data validation and analysis, and familiarity with data visualisation tools ...

SENIOR DATA ENGINEER Salary up to £100,000 + Equity London-based role - hybrid working with 4 days per week in the office Join a fast-growing technology business building modern, cloud-based data platforms Develop scalable data infrastructure using Python, SQL and cloud … technologies Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're recruiting for a Senior Data Engineer to join an ambitious technology business with exciting expansion plans. You'll work as part of a collaborative engineering team, helping to design and deliver ...

Maximise your chances of a successful application to this job by ensuring your CV and skills are a good match. \n As a Data Engineer, you will be critical to the successful delivery of the programme, collaborating within matrix organisation, with multi-disciplinary teams within Engineering. … working in a hybrid style. \n You'll work in a matrix organisation and report operationally through OMNIA Training and functionally to the Data Lead. Ultimately, you'll work for the British Army, championing innovation, and helping shape the future of military collective training. \n Key Responsibilities ...

Data Engineer Peterborough (Hybrid) £50,000 - £60,000 Base + Benefits We are seeking an experienced Data Engineer with strong Databricks experience to join a growing Data & Analytics team. As part of this continued growth, the successful candidate will play a key role … developing and enhancing data solutions, working closely with the Data & Analytics Manager and wider team to support the delivery of data-driven initiatives. This is an excellent opportunity for a skilled Data Engineer looking to make an impact within a forward-thinking ...

IntaPeople are seeking an experienced Data Engineer to join one of their financial services focussed clients based in South Wales. This role is critical to transforming a reporting-led organisation into a proactive, insight-driven business. The Data Engineer will be responsible for developing robust data engineering solutions that reduce manual processes, improve data quality, and enable self-service analytics at scale. You will have strong experience in data architecture, ETL development, and modern data warehousing practices, including the application of Kimball methodology and dimensional modelling, alongside ...

Data Platform Manager UK/Remote Circa £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where … combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

Junior Data Engineer Location: UK-based, hybrid working Security Clearance: BPSS or SC clearance Required Working Style: Agile, product-led delivery We are looking for a Junior Data Engineer to support the design, build and operation of scalable data platforms for digital services. Working … Understanding of REST APIs, HTTP methods and JSON payloads Ability to consume data from APIs as part of a data pipeline Good problem-solving skills and ability to troubleshoot basic data issues Desirable Skills Experience with AWS Aurora PostgreSQL Basic understanding of data ...

Title: Engineering Manager Data Platforms SENIOR LEVEL Hybrid - Sheffield 2/3 days per week Inside IR35 Contract Job Description This role leads a high-performing data engineering team focused on building and operating modern data platforms using cloud-native technologies. You will oversee … technical environment. Solid understanding of data engineering principles, including ETL/ELT, data warehousing and data pipeline orchestration. Additional Skills & Qualifications: experience working with large-scale, high-volume data platforms. Familiarity with infrastructure-as-code and CI/CD practices ...

Title: Engineering Manager Data Platforms SENIOR LEVEL Hybrid - Sheffield 2/3 days per week Inside IR35 Contract Job Description This role leads a high-performing data engineering team focused on building and operating modern data platforms using cloud-native technologies. You will oversee … technical environment. Solid understanding of data engineering principles, including ETL/ELT, data warehousing and data pipeline orchestration. Additional Skills & Qualifications: experience working with large-scale, high-volume data platforms. Familiarity with infrastructure-as-code and CI/CD practices ...

seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer … Data Factory, Azure Blob Storage, and Azure SQL Proven expertise with Databricks, including hands-on implementation experience Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources ...

Data Engineer (Cloud Architecture) Contract until 31 March 2027 | East Midlands | Hybrid Working | Inside IR35 Rate: Negotiable Dependent on Experience Data Careers is supporting a secure public sector organisation in the East Midlands in the search for an experienced Data Engineer/Cloud Architect. … ingestion and integration from multiple source systems. Cloud-based data platform experience, ideally Azure. API integration and data pipeline development. SQL and data modelling expertise. Experience working with large and complex datasets. Strong understanding of modern data architecture principles. ...

Data Modeller 9-Month Contract | Glasgow (Hybrid) | £525 per day via Umbrella We're supporting a large-scale data and analytics programme and are looking for an experienced Data Modeller to join the team on an initial 9-month contract. This role will focus … designing and developing high-quality data models and datamarts that enable accurate reporting, analytics, and Power BI solutions. You'll work closely with Data Engineers, Business Analysts, and Power BI Developers to ensure data is structured, governed, and optimised for business use. Key Responsibilities ...

Power BI and for decisions across the business. Required Skills & Experience: Strong SQL and T-SQL, including stored procedures. Proven ETL/ELT pipeline development on Azure and SQL Server. Hands-on orchestration experience with SSIS, SQL Agent, and Azure Data Factory. Solid data modelling … transformations. Implement data observability, testing, and validation checks (such as DBT tests) to protect data integrity. Set up dynamic pipeline orchestration and CI/CD automation of validated code. Work closely with stakeholders to turn business requirements into production-ready data products. ...

Azure Data Engineer Up to £65,000 - Fully Remote We are seeking a Data Engineer to join a well-established, international organisation operating within a sustainability-focused industry. Our client is a global leader in chemical cleaning and environmental solutions, offering a fully integrated service across … Azure Data Factory, Azure Data Lake and Azure Synapse Analytics Solid understanding of ETL processes, data integration and pipeline development Advanced SQL skills as well as Python/PySpark experience for data processing Exposure to Power BI or other reporting tools ...

Implement retrieval-augmented generation (RAG) architectures and manage vector databases such as Pinecone , Weaviate , FAISS , and Milvus to support enterprise knowledge intelligence systems. Data Platform & Engineering Excellence Lead the evolution of the enterprise data estate, leveraging modern data platforms such as Databricks , Snowflake , Azure … Synapse , and BigQuery . Oversee data engineering using Apache Airflow , dbt , and Prefect , ensuring data pipelines are performant, governed, and aligned with enterprise metadata standards ( Collibra , Alation , Microsoft Purview ). Drive the adoption of Delta Lake , Iceberg , and Hudi for scalable data lakehouse architectures. ...

driving the evolution of our enterprise data engineering capabilities across our cloud and legacy environments. Your remit spans cloud platform engineering, pipeline automation, real‐time data processing, curation, and the enablement of business intelligence, data science and AI teams. You will … concepts clearly and frame engineering decisions in terms of business impact. Ensure data platforms meet regulatory, security, and compliance requirements, including secure pipeline design, access control, and lineage. Embed good governance practices across metadata, cataloguing, quality, and monitoring. Define and maintain data engineering standards, documentation ...

have a background in Automotive Data Quality, are you excited about data management and validation? Expleo are seeking a highly organised and proactive Data Quality Engineer, you will be a part of the team testing the next generation of electrified propulsion systems, based … Warwickshire on a Contract basis. Key Responsibilities of the Data Quality Engineer include: * Work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power in loop (PiL) and Vehicle in Loop (ViL) test beds * Provide timely, accurate, secured and accessible test data for wider engineering ...

requires in terms of skills and experience If you are a good match, make an application. \n Description \n As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping … them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. \n Key Responsibilities ...

markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. \n Leonardo's Data practice works across a diverse array of sectors including Defence … oriented with a focus on ensuring data accuracy, quality, and security.Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues.\n Desirable: \n \n Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. \nExperience with additional data ...

exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start … delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring ...

connect them with exceptional professionals for this role. \n Job Description \n As part of our continued growth and investment in our data and analytics capabilities, we’re recruiting for an experienced Senior BI Developer to join our dynamic direct-to-consumer (D2C) business. This … opportunity to play a central role in shaping how data is leveraged to drive insight, inform decisions, and support ongoing business success. \n As the Senior BI Developer, you will play a pivotal role in designing, building, and maintaining the data assets that underpin our reporting ...