526 to 550 of 1,138 Data Pipeline Jobs in the UK excluding London

Data Engineering Lead - Hybrid - Azure/Databricks - London Permanent Salary: £90,000 Are you a seasoned Data Engineering professional ready to lead the charge in building scalable, high-performance data platforms? An industry leading, global firm is seeking a Data Engineering Lead to drive innovation across their hybrid Azure/Databricks environment. … About the role: Shape data strategy for global projects Lead a talented team of BI Developers Enjoy a flexible working culture and industry-leading benefits Work with cutting-edge tech in a collaborative, inclusive environment Key Responsibilities: Architect and optimize robust data pipelines for large-scale ingestion, transformation, and delivery Leverage Azure and Databricks to enable … seamless data integration and enrichment Implement best practices for orchestration, monitoring, and error handling Lead and mentor a BI team, ensuring timely delivery of dashboards and data products Champion data governance, quality, and security across platforms Requirements: Proven expertise in Azure, SQL, Databricks, and Azure Data Factory Experience implementing medallion architecture frameworks More ❯

Role : Data Scientist Location : Remote within the UK, hybrid attendance only when required Type : Contract (6 Months, Inside IR35) My client, a global IT services provider, is seeking a Data Scientist to support a high-impact AI initiative within a commercial banking environment. This role sits within a collaborative delivery team focused on advanced analytics and … machine learning solutions that drive strategic insights and operational efficiency. Responsibilities Collect, clean, and preprocess structured and unstructured data from diverse sources Perform exploratory data analysis (EDA) to uncover trends and anomalies Design and implement data pipelines in collaboration with data engineering teams Apply feature engineering and selection techniques to enhance model … or Python Engage with stakeholders to define use cases and success metrics Participate in Agile ceremonies and contribute to the enterprise AI roadmap Required Skills Proven experience in data science and machine learning Strong Python skills and familiarity with ML libraries (Scikit-learn, TensorFlow, PyTorch) Experience with data visualization tools (Power BI, Tableau, Matplotlib, Seaborn) Ability More ❯

our stakeholders across the UK property market. You'll be at the heart of a greenfield opportunity - building, deploying, and operating machine learning systems that leverage Rightmove's data at large scale. You'll have the opportunity to shape best practices, own and grow the ML Ops discipline, and help us move from first launches to robust, sustainable … role, you will work in a cross-functional team to productionise machine learning and AI models, ensuring they are robust, scalable, and measurable. You'll collaborate closely with data scientists, engineers, and product teams to automate workflows, monitor performance, and retrain models as needed. You'll bring a passion for building reliable ML infrastructure, a strong technical foundation … at scale. Working with data scientists to take models from development to production-grade systems, ensuring scalability, reproducibility, and robustness. Automating feature engineering and data pipeline processes, ensuring reproducibility and auditability. Implementing monitoring and observability to detect drift, bias, and performance degradation, and setting up rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines More ❯

our stakeholders across the UK property market. You'll be at the heart of a greenfield opportunity - building, deploying, and operating machine learning systems that leverage Rightmove's data at large scale. You'll have the opportunity to shape best practices, own and grow the ML Ops discipline, and help us move from first launches to robust, sustainable … role, you will work in a cross-functional team to productionise machine learning and AI models, ensuring they are robust, scalable, and measurable. You'll collaborate closely with data scientists, engineers, and product teams to automate workflows, monitor performance, and retrain models as needed. You'll bring a passion for building reliable ML infrastructure, a strong technical foundation … at scale. Working with data scientists to take models from development to production-grade systems, ensuring scalability, reproducibility, and robustness. Automating feature engineering and data pipeline processes, ensuring reproducibility and auditability. Implementing monitoring and observability to detect drift, bias, and performance degradation, and setting up rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines More ❯

our stakeholders across the UK property market. You'll be at the heart of a greenfield opportunity - building, deploying, and operating machine learning systems that leverage Rightmove's data at large scale. You'll have the opportunity to shape best practices, own and grow the ML Ops discipline, and help us move from first launches to robust, sustainable … role, you will work in a cross-functional team to productionise machine learning and AI models, ensuring they are robust, scalable, and measurable. You'll collaborate closely with data scientists, engineers, and product teams to automate workflows, monitor performance, and retrain models as needed. You'll bring a passion for building reliable ML infrastructure, a strong technical foundation … at scale. Working with data scientists to take models from development to production-grade systems, ensuring scalability, reproducibility, and robustness. Automating feature engineering and data pipeline processes, ensuring reproducibility and auditability. Implementing monitoring and observability to detect drift, bias, and performance degradation, and setting up rollback/recovery processes. Using MLOps tools (e.g., Vertex Pipelines More ❯

Senior Data Engineer (SQL Python AWS) Cheshire to £100k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cyber Security technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Job Title: Data Consultants - Multiple Positions ranging from Junior to Senior Principal Location: London (Hybrid – Flexible working with client site travel required) Salary: Competitive, based on experience (from 1 year to Principal level) -Multiple positions required Clearance Requirement: Active SC or DV Clearance is essential About the Company Leading consultancy partner headquartered in London Rapidly growing with ambitious … expansion plans Collaborative and forward-thinking culture Focused on delivering data solutions that drive measurable business impact Role Overview Broad role spanning data science, engineering, analytics, and strategy Client-facing position with opportunities across diverse industries Design, implement, and optimize end-to-end data solutions Work on high-impact, dynamic projects with flexibility to … innovate Key Responsibilities Translate client challenges into actionable data solutions Develop and deploy scalable data pipelines and architectures Perform data analysis, modeling, and machine learning tasks Deliver actionable insights via reports, dashboards, and visualizations Advise on data governance, compliance, and best practices Collaborate across multidisciplinary teams to deliver project goals Keep pace More ❯

Job Title: Data Consultants - Multiple Positions ranging from Junior to Senior Principal Location: London (Hybrid – Flexible working with client site travel required) Salary: Competitive, based on experience (from 1 year to Principal level) -Multiple positions required Clearance Requirement: Active SC or DV Clearance is essential About the Company Leading consultancy partner headquartered in London Rapidly growing with ambitious … expansion plans Collaborative and forward-thinking culture Focused on delivering data solutions that drive measurable business impact Role Overview Broad role spanning data science, engineering, analytics, and strategy Client-facing position with opportunities across diverse industries Design, implement, and optimize end-to-end data solutions Work on high-impact, dynamic projects with flexibility to … innovate Key Responsibilities Translate client challenges into actionable data solutions Develop and deploy scalable data pipelines and architectures Perform data analysis, modeling, and machine learning tasks Deliver actionable insights via reports, dashboards, and visualizations Advise on data governance, compliance, and best practices Collaborate across multidisciplinary teams to deliver project goals Keep pace More ❯

Job Title: Data Consultants - Multiple Positions ranging from Junior to Senior Principal Location: London (Hybrid – Flexible working with client site travel required) Salary: Competitive, based on experience (from 1 year to Principal level) -Multiple positions required Clearance Requirement: Active SC or DV Clearance is essential About the Company Leading consultancy partner headquartered in London Rapidly growing with ambitious … expansion plans Collaborative and forward-thinking culture Focused on delivering data solutions that drive measurable business impact Role Overview Broad role spanning data science, engineering, analytics, and strategy Client-facing position with opportunities across diverse industries Design, implement, and optimize end-to-end data solutions Work on high-impact, dynamic projects with flexibility to … innovate Key Responsibilities Translate client challenges into actionable data solutions Develop and deploy scalable data pipelines and architectures Perform data analysis, modeling, and machine learning tasks Deliver actionable insights via reports, dashboards, and visualizations Advise on data governance, compliance, and best practices Collaborate across multidisciplinary teams to deliver project goals Keep pace More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data and reporting solutions from our Dynamics, in-house and 3rd party sources, using the … latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly with business users to understand and document business requirements, Undertake/support the monitoring of More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

Senior Data Engineer (Python AWS SQL DBT) Cheshire to £90k Are you a data technologist looking for an opportunity to progress your career in a hands-on, impactful role with lots of ownership? You could be joining a Cybersecurity technology company and enjoying a huge range of perks and benefits from continual learning and self-development … opportunities (including "buy any book" policy) through to health and well-being, enhanced paternity packages, generous holiday allowance, inclusive social events and much more. As a Senior Data Engineer you'll lead a significant data re-architecture project, with the autonomy to make the critical data architecture decisions, laying the foundations that will empower … the entire business, from product and analytics through to customer intelligence and commercial growth. You'll collaborate with the business and Data Analysts to expand on and re-engineer the data pipelines, building new scalable services within a modern cloud based (AWS) environment. There's a culture of software engineering excellence, with a collaborative team environment More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … and deep learning architectures . Hands-on experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Vertex AI). Experience with data engineering concepts — ETL pipelines, data lakes, and cloud data platforms. Proficiency with cloud services (AWS, Azure, or GCP) for model deployment and orchestration. Knowledge of containerization and orchestration tools (Docker, Kubernetes More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership … Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What's Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and More ❯

Our client, a global asset management firm is seeking to hire an ESG Data Scientist to join their Sustainable Research team. This role will play a key part in developing the tools, infrastructure and analytics that drive the firm’s ESG and sustainability capabilities. Key Responsibilities: Build analytics tools and machine learning models to assess ESG and sustainability … characteristics of companies Design and implement scalable, high-performance sustainability data systems and infrastructure Develop, maintain and enhance dashboards and tools for investment teams Build data pipelines integrating multiple sources into a unified, high-quality and trusted data environment Collaborate with investment and technology teams to prototype new metrics and deploy AI-driven insights … that enhance ESG integration and sustainability performance measurements Monitor and improve data quality, investigating and resolving data issues Engage with internal stakeholders across the firm to understand business needs and translate them into technical solutions Contribute to vendor evaluations and development of data governance standards Candidate Requirements: Minimum 4 years of experience in a More ❯

Our client, a global asset management firm is seeking to hire an ESG Data Scientist to join their Sustainable Research team. This role will play a key part in developing the tools, infrastructure and analytics that drive the firm’s ESG and sustainability capabilities. Key Responsibilities: Build analytics tools and machine learning models to assess ESG and sustainability … characteristics of companies Design and implement scalable, high-performance sustainability data systems and infrastructure Develop, maintain and enhance dashboards and tools for investment teams Build data pipelines integrating multiple sources into a unified, high-quality and trusted data environment Collaborate with investment and technology teams to prototype new metrics and deploy AI-driven insights … that enhance ESG integration and sustainability performance measurements Monitor and improve data quality, investigating and resolving data issues Engage with internal stakeholders across the firm to understand business needs and translate them into technical solutions Contribute to vendor evaluations and development of data governance standards Candidate Requirements: Minimum 4 years of experience in a More ❯

Our client, a global asset management firm is seeking to hire an ESG Data Scientist to join their Sustainable Research team. This role will play a key part in developing the tools, infrastructure and analytics that drive the firm’s ESG and sustainability capabilities. Key Responsibilities: Build analytics tools and machine learning models to assess ESG and sustainability … characteristics of companies Design and implement scalable, high-performance sustainability data systems and infrastructure Develop, maintain and enhance dashboards and tools for investment teams Build data pipelines integrating multiple sources into a unified, high-quality and trusted data environment Collaborate with investment and technology teams to prototype new metrics and deploy AI-driven insights … that enhance ESG integration and sustainability performance measurements Monitor and improve data quality, investigating and resolving data issues Engage with internal stakeholders across the firm to understand business needs and translate them into technical solutions Contribute to vendor evaluations and development of data governance standards Candidate Requirements: Minimum 4 years of experience in a More ❯

A large global organisation are looking to hire a Senior Data Analyst to lead end-to-end data workflows from requirement to delivery including data product creation and secure data transfer from Google Cloud Platform to PostgreSQL. This will be a full time permanent position. The role will be on a Hybrid … automate those views, ensuring reliable execution on daily, weekly, or customized schedules. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to extract data from GCP (such as BigQuery or GCS) and load it into PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data … pipelines are reliable and idempotent. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document resolutions to strengthen system resilience. Design, Build, & Govern Data Products Architect, construct, and More ❯

A large global organisation are looking to hire a Senior Data Analyst to lead end-to-end data workflows from requirement to delivery including data product creation and secure data transfer from Google Cloud Platform to PostgreSQL. This will be a full time permanent position. The role will be on a Hybrid … automate those views, ensuring reliable execution on daily, weekly, or customized schedules. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to extract data from GCP (such as BigQuery or GCS) and load it into PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data … pipelines are reliable and idempotent. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document resolutions to strengthen system resilience. Design, Build, & Govern Data Products Architect, construct, and More ❯

A large global organisation are looking to hire a Senior Data Analyst to lead end-to-end data workflows from requirement to delivery including data product creation and secure data transfer from Google Cloud Platform to PostgreSQL. This will be a full time permanent position. The role will be on a Hybrid … automate those views, ensuring reliable execution on daily, weekly, or customized schedules. Execute Cross‐Platform ETL with AWS Glue Develop, deploy, and maintain AWS Glue jobs to extract data from GCP (such as BigQuery or GCS) and load it into PostgreSQL. Set up secure connectivity, schedule jobs via cron or trigger mechanisms, and ensure data … pipelines are reliable and idempotent. Monitor, Troubleshoot & Resolve Incidents Continuously oversee ETL workflows in Airflow and AWS Glue, proactively responding to alerts and errors. Conduct root cause analysis for pipeline failures—whether due to schema mismatches or performance bottlenecks—and apply robust fixes. Document resolutions to strengthen system resilience. Design, Build, & Govern Data Products Architect, construct, and More ❯

As a Business Intelligence Analyst, you will play a key role in driving data-informed decision-making by delivering insightful analyses and reports. You will contribute to gathering, analysing, and visualising data to uncover trends and actionable insights that enhance business operations, customer satisfaction, and overall performance. Working closely with cross-functional teams, you will leverage … and optimise Power BI dashboards and interactive reports tailored to various stakeholders and needs. Automate and streamline recurring reports to improve efficiency and reduce manual effort. Translate complex data into visually intuitive reports that cater to both technical and non-technical audiences. Write and optimise advanced SQL queries to extract, transform, and analyse data. Design and implement data models to support reporting and analysis needs. Ensure data pipelines are efficient, reliable, and scalable. Track and report on Key Performance Indicators (KPIs) across multiple business areas and divisions. Highlight trends and anomalies to seniors and managers, while also analysing and resolving them to ensure a clear understanding of root causes and implementing necessary solutions. Work More ❯

Senior Data Engineer Location: Trowbridge (Hybrid, 2 days in office) Salary: £70,000 Be part of a forward-thinking data and analytics team shaping the future of our client's operations across the UK, Ireland, and North America. This is a fantastic opportunity to lead data infrastructure projects, including a major cloud migration to … Azure, and support strategic analytics initiatives for both B2C and B2B businesses. Key Responsibilities: Manage and optimize cloud-based data infrastructure (Azure). Lead the migration of data environments to Azure. Maintain high-quality, secure data pipelines with a strong focus on governance. Mentor and support a Data Engineer apprentice. Collaborate across … teams to enhance reporting, analytics, and business intelligence solutions. What You Bring: 5+ years of experience in SQL production environments and data engineering. Strong expertise in SQL, T-SQL, Azure, DataBricks, and SSIS. Experience with data integration, modeling, and performance optimization. Problem-solving mindset and a collaborative approach. Desirable: Experience handling data from APIs More ❯