326 to 350 of 715 Data Pipeline Jobs in the UK

IR35) We're working with a fully remote, boutique AI consultancy and Palantir services partner. They help organisations in energy, healthcare, financial services, media, and recruitment use modern data and AI platforms to solve complex business challenges. They are building a Palantir Foundry practice led by ex-Palantir leadership. Thanks to these relationships, they're trusted with high … to see their work make an immediate impact. What You'll Do Work closely with clients to solve their toughest challenges using Palantir Foundry and modern AI/data tools. Design and deploy scalable data pipelines, workflows, and applications. Model complex datasets and create APIs that deliver real business value. Collaborate with technical and non-technical … data platforms such as: Snowflake, Databricks, AWS Glue/Redshift, Google BigQuery Software engineering skills in Python, Java, or TypeScript/React. Strong data modelling, pipeline development, and API design experience. Excellent problem-solving and communication skills. Why This Role Stands Out Impactful work at the intersection of AI, data, and business transformation. More ❯

Data Engineer (Snowflake & Asset Management) 6 Month Contract London (Hybrid) Via Umbrella Our UK leading Life Insurance client are looking for a Data Engineer to join their team on an initial 6-month contract. Key skills/knowledge required: Proficiency in Python and SQL for data engineering and application development Experience building data pipelines and ETL processes for capital markets data Hands-on experience with AWS cloud services and Snowflake data platform Experience with cloud-native development patterns and AWS services (Lambda, S3, RDS, etc.) Hands-on experience integrating with OMS platforms (Aladdin, Murex, Charles River, etc.) including data extraction, transformation, and real-time feeds … into technical solutions Strong collaboration and communication skills, with ability to work effectively in cross-functional teams Understanding of trading workflows, trade lifecycle, and settlement processes Knowledge of data engineering workflows, pipelines, and integration patterns Awareness of regulatory and compliance considerations in capital markets delivery Familiarity with agile principles and team-based delivery Desirable: Familiarity with agile delivery More ❯

We are looking for a talented Data Engineer , specialising in designing and optimising scalable data pipelines, and cloud-based data solutions. This position requires expertise in Python, SQL, dpt and experience with Snowflake. If you have industry experience working with Retail and CPG this could be the role for you! Our client is the … leading collaborative commerce platform that connects CPG brands to real-time sales and inventory data from 40+ retailers and distributors. We serve 7,000+ brands representing over $2.5T in retail sales across 250K+ stores, working with industry leaders like Nestlé, and KraftHeinz. This business believes that teamwork drives innovation. By uniting talented, motivated creators from diverse backgrounds, they … and efficient. If youre passionate about solving meaningful problems while building a company youll be proud of, wed love to hear from you. About the position As a Data Engineer, youll play a vital role in turning complex, messy datasets into reliable, actionable insights that drive smarter decisions for our customers. Youll design and optimise scalable data More ❯

grown into a dynamic team with a strong reputation for digital innovation and customer-centricity - and they're just getting started. With an award-winning platform and a data-driven approach to decision-making, they combine cutting-edge technology with a commitment to transparency and service excellence. With a strong focus on digital transformation, automation, and AI, they … and redesign manual processes. Supporting integration of APIs, SaaS platforms, and internal systems (e.g. SQL Server, Azure). Experimenting with generative AI and agentic workflows (e.g. intelligent routing, data extraction). Working with the Data Engineering team to enable automations with trusted data pipelines. Documenting workflows, decision rules, and automation logic for transparency and … audit. Participating in Agile sprints & code reviews. Job requirements - Automation Developer Graduate in Computer Science, Software Engineering, Data Science, AI/ML, Information Systems, or a related STEM field. Curiosity and passion for AI, automation, and problem-solving. Evidence of working on AI/Automation/Workflow projects - this can be from university, personal projects, internships, or work More ❯

Primesource Consulting LLP seeks a talented Data Scientist to join their team. This role involves leveraging data science to design and develop machine learning models to address real-world business challenges. The candidate should possess a strong foundation in data science, machine learning, and cloud-based data systems. In this role you … can expect to have the responsibilities: Apply various data science techniques and tools to business problems. Design and deliver data science products aligned with organizational objectives. Collaborate with cross-functional experts to achieve organizational goals. Communicate insights for management and operational efficiency. Ensure data ethics and preparation are integral to projects. Develop machine learning … models and algorithms for complex challenges. Code in R or Python, utilizing libraries like numpy, scipy, and pandas. Conduct exploratory data analysis, model development, and evaluation. Work with both RDBMS and distributed datasets, demonstrating strong SQL skills. Design cloud-based data pipelines for scalable and reliable solutions. This role comes with the following benefits: Competitive salary More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

MI Developer has become available within Saga's finance department. Supporting both the Finance team and the wider Insurance business, this role sits within a team of 4 Data and Analytics professionals and provides the opportunity to work across multiple data sources, platforms and analytics tools. The role is all about providing technical data … Academy, our bespoke learning platform Main Responsibilities Following our Business Code of Conduct and always acting with integrity and due diligence Supporting our Ops MI team with their data pipelines, troubleshooting issues as they occur and amending processes as business requirements develop Specifying, designing and automating of business processes using BI tools Creating and maintaining technical documentation and … best practices for all aspect of data extraction and transformation Assisting the team with identifying gaps in data sets and ensuring we have optimal data quality for accurate and timely reporting and MI Working with the business and technical stakeholders, identify and develop data sets to assist in efficient reporting and MI More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

Integration Engineer Mainly Remote (monthly meet ups with team) Outside IR35 Experienced Integration Engineer needed to help design and develop data integration solutions using Informatica IPaaS and Snowflake data Lakehouse You will Design, develop and implement ELT & ETL pipelines and workflows using Informatica PowerCenter and Informatica Cloud. Build connectors from multiple sources including Cloud platforms, bespoke … and out of the box APIs, databases, and flat files. Develop and maintain data mappings, transformations, data pipelines and integration workflows. Implement real-time and … batch data integration solutions to support business requirements Ensure any integration pipelines or ELT/ETL workflows are built with error and exception handling built into the pipeline/workflow. Your experience Proven experience in a similar role so you can provide advice and guidance to the team Excellent experience in Informatica ELT & ETL development and integration More ❯

expose AI capabilities via RESTful APIs or cloud-native platforms (e.g., Azure, AWS). Ensure high availability and fault tolerance of AI services in production environments. Build robust data pipelines for preprocessing, feature engineering, and real-time inference. Set up monitoring tools to track model performance, drift, and system health. Iterate quickly based on feedback, usage metrics, and More ❯

Here at the Mick George Group, we are currently recruiting a Data Engineer (T-SQL, Python) to join the Technology department. Location: Mick George Head Office - Huntingdon Working Hours: Monday – Friday 8am – 5pm Pay: To be discussed during interview. Benefits: Company Pension, Employee Assistance Programme, 28-Days holiday inclusive of bank holidays, Company benefit platform, Cycle to work … with any aspect of our business, whether that be as an employee, supplier, customer or other. Role Purpose As part of our continued growth, we are seeking a Data Engineer with expertise in T-SQL, Python, and some SQL Database Administration (DBA) to join our dynamic team. You will play a pivotal role in the reporting, design, development … and optimisation of our data infrastructure. You will be responsible for managing and reporting on our databases, building robust data pipelines, and ensuring the integrity and performance of critical systems and data warehouses. This is an excellent opportunity for someone who is passionate about data and wants to work in a fast More ❯

re recruiting on behalf of a leading organisation undergoing a major digital transformation. This is a hands-on, senior engineering role for someone who thrives on solving complex data challenges, building scalable platforms, and integrating operational systems across a diverse business landscape. You'll work closely with stakeholders in Logistics, Operations, Finance, and Compliance to modernise data infrastructure, automate workflows, and embed AI into BI and operational processes. If you're ready to take ownership of high-impact projects and shape the future of data in logistics, this is the role for you. What You'll Be DoingData Platform & BI Engineering Architect and implement cloud-native data platforms (AWS S3, Glue, Athena … Redshift, QuickSight). Build reliable, governed data pipelines with CI/CD and infrastructure as code. Design dimensional models and deliver robust SQL/Python transformations. Systems Integration & Application Support Provide expert-level support for transport, warehouse, and fleet systems (TMS/WMS/FMS). Develop and maintain integrations using REST/SOAP APIs, EDI (XML/ More ❯

purpose-driven consultancy that sits at the intersection of advanced analytics, software engineering, and AI. They're on a mission to deliver real-world impact, through high-value, data-driven platforms and tools, across financial services, government, retail, SaaS, and beyond. To support this mission, we’re looking for two exceptional Engineering Managers to lead their Software Engineering … and Analytics Engineering functions respectively. These roles offer the chance to architect scalable products, lead talented technical teams, and shape the future of data and digital platforms in both the public and private sectors. Key Responsibilities: Depending on your background (Software or Data/Analytics), your focus will include: Software Engineering Leaders: Lead the design and … functional teams through agile delivery, technical planning, and product development. Translate business requirements into scalable technical solutions that support critical client outcomes. Analytics Engineering Leaders: Architect and optimise data pipelines, ELT workflows, and cloud warehouse platforms (Snowflake, BigQuery, Redshift). Lead teams working with dbt, SQL, Python, and Airflow to drive data transformation at scale. Ensure More ❯

purpose-driven consultancy that sits at the intersection of advanced analytics, software engineering, and AI. They're on a mission to deliver real-world impact, through high-value, data-driven platforms and tools, across financial services, government, retail, SaaS, and beyond. To support this mission, we’re looking for two exceptional Engineering Managers to lead their Software Engineering … and Analytics Engineering functions respectively. These roles offer the chance to architect scalable products, lead talented technical teams, and shape the future of data and digital platforms in both the public and private sectors. Key Responsibilities: Depending on your background (Software or Data/Analytics), your focus will include: Software Engineering Leaders: Lead the design and … functional teams through agile delivery, technical planning, and product development. Translate business requirements into scalable technical solutions that support critical client outcomes. Analytics Engineering Leaders: Architect and optimise data pipelines, ELT workflows, and cloud warehouse platforms (Snowflake, BigQuery, Redshift). Lead teams working with dbt, SQL, Python, and Airflow to drive data transformation at scale. Ensure More ❯

purpose-driven consultancy that sits at the intersection of advanced analytics, software engineering, and AI. They're on a mission to deliver real-world impact, through high-value, data-driven platforms and tools, across financial services, government, retail, SaaS, and beyond. To support this mission, we’re looking for two exceptional Engineering Managers to lead their Software Engineering … and Analytics Engineering functions respectively. These roles offer the chance to architect scalable products, lead talented technical teams, and shape the future of data and digital platforms in both the public and private sectors. Key Responsibilities: Depending on your background (Software or Data/Analytics), your focus will include: Software Engineering Leaders: Lead the design and … functional teams through agile delivery, technical planning, and product development. Translate business requirements into scalable technical solutions that support critical client outcomes. Analytics Engineering Leaders: Architect and optimise data pipelines, ELT workflows, and cloud warehouse platforms (Snowflake, BigQuery, Redshift). Lead teams working with dbt, SQL, Python, and Airflow to drive data transformation at scale. Ensure More ❯

purpose-driven consultancy that sits at the intersection of advanced analytics, software engineering, and AI. They're on a mission to deliver real-world impact, through high-value, data-driven platforms and tools, across financial services, government, retail, SaaS, and beyond. To support this mission, we’re looking for two exceptional Engineering Managers to lead their Software Engineering … and Analytics Engineering functions respectively. These roles offer the chance to architect scalable products, lead talented technical teams, and shape the future of data and digital platforms in both the public and private sectors. Key Responsibilities: Depending on your background (Software or Data/Analytics), your focus will include: Software Engineering Leaders: Lead the design and … functional teams through agile delivery, technical planning, and product development. Translate business requirements into scalable technical solutions that support critical client outcomes. Analytics Engineering Leaders: Architect and optimise data pipelines, ELT workflows, and cloud warehouse platforms (Snowflake, BigQuery, Redshift). Lead teams working with dbt, SQL, Python, and Airflow to drive data transformation at scale. Ensure More ❯

purpose-driven consultancy that sits at the intersection of advanced analytics, software engineering, and AI. They're on a mission to deliver real-world impact, through high-value, data-driven platforms and tools, across financial services, government, retail, SaaS, and beyond. To support this mission, we’re looking for two exceptional Engineering Managers to lead their Software Engineering … and Analytics Engineering functions respectively. These roles offer the chance to architect scalable products, lead talented technical teams, and shape the future of data and digital platforms in both the public and private sectors. Key Responsibilities: Depending on your background (Software or Data/Analytics), your focus will include: Software Engineering Leaders: Lead the design and … functional teams through agile delivery, technical planning, and product development. Translate business requirements into scalable technical solutions that support critical client outcomes. Analytics Engineering Leaders: Architect and optimise data pipelines, ELT workflows, and cloud warehouse platforms (Snowflake, BigQuery, Redshift). Lead teams working with dbt, SQL, Python, and Airflow to drive data transformation at scale. Ensure More ❯

into the clear and concise technical development specifications Managing and updating the project management board for responsible projects aligned with the I&D Analytics project roadmap Working with data engineers and business owners to create data pipelines for reporting and analytics with consideration of the planned system integration, transformation and data migration Delivering Power … BI data models and reports with the Power BI developers' best practise and compliance with the SNG data policies and procedures Supporting the maintenance, management and enhancement of I&D systems and ensuring they are fit for purpose and continuously improved, and supporting the routine review of the quality and completeness of data What … a similar role as an Insight Analyst, ideally in the Real Estate, or broader Investment and Development sectors. You will need strong Power BI reporting experience with advanced data analytics and visualisation skills. You'll also have: Strong financial acumen and commercial knowledge to interpret complex financial and investment analysis Excellent stakeholder management skills with clear communication and More ❯

into the clear and concise technical development specifications Managing and updating the project management board for responsible projects aligned with the I&D Analytics project roadmap Working with data engineers and business owners to create data pipelines for reporting and analytics with consideration of the planned system integration, transformation and data migration Delivering Power … BI data models and reports with the Power BI developers' best practise and compliance with the SNG data policies and procedures Supporting the maintenance, management and enhancement of I&D systems and ensuring they are fit for purpose and continuously improved, and supporting the routine review of the quality and completeness of data What … a similar role as an Insight Analyst, ideally in the Real Estate, or broader Investment and Development sectors. You will need strong Power BI reporting experience with advanced data analytics and visualisation skills. You'll also have: Strong financial acumen and commercial knowledge to interpret complex financial and investment analysis Excellent stakeholder management skills with clear communication and More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … planning, resource allocation, and optimization of Airflow workers. Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure … using AWS and SQL technologies. Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … planning, resource allocation, and optimization of Airflow workers. Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure … using AWS and SQL technologies. Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the More ❯