776 to 800 of 997 Data Engineering Jobs in the UK

Data Science Engineer My client is recruiting for a Data Science Engineer to design, develop, and deliver AI and analytics solutions aligned with the organisations Data & AI strategy. Key Responsibilities * End-to-end development of AI/ML solutions. * MLOps practices: CI/CD, model monitoring, retraining. * Use of open-source and enterprise tools (LangChain, Azure OpenAI … Databricks). * Generative AI features: embeddings, RAG, AI agents. * Clean, testable code with modern engineering practices. * Align with enterprise architecture and governance. * Collaborate with architects and stakeholders. * Lifecycle management of models. * Pilot emerging technologies. Experience & Skills * 2-4 years in production-level AI/ML delivery. * Legal/professional services experience is a plus. * AI/ML frameworks: PyTorch … TensorFlow, LangChain. * Cloud: Azure (preferred), AWS, GCP. * MLOps: CI/CD, model lifecycle, monitoring. * Generative AI: LLMs, RAG, chat agents. * Data engineering alignment: ETL, governance. * Strong coding, communication, and collaboration skills. * Strategic thinking, problem-solving, and stakeholder engagement. In accordance with the Employment Agencies and Employment Businesses Regulations 2003, this position is advertised based upon DGH Recruitment Limited More ❯

As a Data and Analytics Engineer, you are at the forefront of turning raw data into actionable insights. You develop and maintain solid data infrastructure, creating structured datasets optimised for analysis with modern BI tools and data users. This role combines the technical expertise of data engineering with the strategic understanding of a data More ❯

We’re seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You’ll own the full data lifecycle — from ingestion and processing to deployment and monitoring of machine learning models — while leading a small, high-performing team. What You’ll Do Build and maintain data pipelines … cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging AI tech. What We’re … Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience in digital marketing or More ❯

We're seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You'll own the full data life cycle - from ingestion and processing to deployment and monitoring of machine learning models - while leading a small, high-performing team. What You'll Do Build and maintain data … cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging AI tech. What We're … Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience in digital marketing or More ❯

potential extension) Start: ASAP Rate: Market rate - Inside IR35 We’re looking for experienced PySpark + Fabric Developers to join a major transformation programme with a leading global financial data and infrastructure organisation. This is an exciting opportunity to work on cutting-edge data engineering solutions, driving innovation and performance at scale. Key Responsibilities Design, build, and … optimise data pipelines for both batch and streaming workloads. Develop and manage dataflows and semantic models to support analytics and reporting. Implement complex data transformations, aggregations, and joins with a focus on performance and reliability. Apply robust data validation, cleansing, and profiling techniques to maintain accuracy. Enforce role-based access, data masking, and compliance standards. Tune … Strong hands-on experience with PySpark (RDDs, DataFrames, Spark SQL). Proven ability to build and optimise ETL pipelines and dataflows. Familiar with Microsoft Fabric or similar lakehouse/data platform environments. Experience with Git, CI/CD pipelines, and automated deployment. Knowledge of market data, transactional systems, or financial datasets. Excellent communication skills and collaborative mindset. Desirable More ❯

the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are seeking a skilled and hands-on AWS Data Engineer with strong coding expertise and deep experience in building scalable data solutions using AWS services. The ideal candidate will have a solid background in data engineering, Python development, and cloud-native architecture. YOUR PROFILE Design, develop, and maintain robust data pipelines and ETL workflows using AWS services. Implement scalable data processing solutions using PySpark and AWS Glue. Build and manage infrastructure as code using CloudFormation. Develop and deploy serverless applications using AWS Lambda, Step Functions, and S3. Perform data querying and analysis … using Athena. Collaborate with Data Scientists to operationalize models using SageMaker. Ensure secure and compliant data handling using IAM, KMS, and VPC configurations. Containerize applications using ECS for scalable deployment. Write clean, testable code in Python, with a strong emphasis on unit testing. Use GitLab for version control, CI/CD, and collaboration. Strong coding background in Python More ❯

projects across multiple domains. Key Responsibilities Design, develop, and optimize Transformer-based architectures (GPT, LLaMA, Mistral, Claude) Fine-tune large language models for domain-specific applications Implement advanced prompt engineering strategies Leverage Retrieval-Augmented Generation (RAG) for enhanced contextual performance Build intelligent agents using frameworks like LangChain, LlamaIndex, CrewAI, AutoGen Apply reinforcement learning techniques including Q-learning , policy gradients … and RLlib Collaborate with cross-functional teams to integrate AI solutions into scalable products Ensure best practices in data engineering and contribute to architectural decisions Contribute to the mentoring and development of junior team members. Support senior team members in identifying and addressing data science opportunities. Required Skills & Experience Proven experience with Transformer models and LLMs (GPT … LLaMA, Mistral, Claude) Strong background in fine-tuning and prompt engineering Hands-on experience with RAG pipelines Familiarity with Agent Frameworks (LangChain, LlamaIndex, CrewAI, AutoGen) Solid understanding of reinforcement learning concepts and tools (Q-learning, policy gradients, RLlib) Azure AI Engineer Associate certification (or willingness to obtain) Bachelor's degree in a relevant field or equivalent combination of education More ❯

Data Science Engineer - MLOPS, Machine Learning, AI, Artificial Intelligence, Azure, PyTorch, TensorFlow, LangChain, OpenAI, Docker, Kubernetes, GenAI, ETL We are actively working with a global law firm who are actively looking to bolster their IT team as they undergo a global-scale cloud transformation. At present they are looking to take on a new Data Science Engineer (MLOPS … join a top-tier global law firm who have a long-stream of projects in the pipeline alongside a diverse and collaborative team environment. To be considered for this Data Science Engineer (MLOPS, Machine Learning, AI, Artificial Intelligence, Azure, PyTorch, TensorFlow, LangChain, OpenAI, Docker, Kubernetes, GenAI, ETL) role, it's ideal you have: Ideal but not required law firm … experience 2-4 years experience within AI/ML positions Knowledge of cloud platforms (Ideally Azure) AI/ML Frameworks Generative AI Data engineering knowledge Solution Delivery Design, build, and deploy data science and AI solutions end-to-end, from design and development through testing, release, monitoring, and support. Operationalize models with CI/CD pipelines, automated More ❯

A leading global investment firm is seeking a Weather Data Engineer to help build proprietary weather analytics and infrastructure that directly powers alpha generation across its commodities trading strategies. This is a high-impact opportunity to work at the intersection of data engineering, meteorology, and AI-driven forecasting. Weather data is central to the firm's … edge - from raw satellite observations to climate simulations and proprietary model outputs. You'll be part of a specialist team driving innovation in how weather data is ingested, transformed, and deployed across the investment process. Responsibilities: Design and maintain scalable, cloud-native (AWS) pipelines for ingesting and processing real-time and historical weather data. Build robust APIs and data services to serve weather data and AI model outputs to researchers, quants, and traders. Support the development and deployment of proprietary forecasting models, including workflows for blending, debiasing, and fine-tuning. Collaborate with meteorologists, data scientists, and AI researchers to onboard new datasets and accelerate research. Implement automated data validation, monitoring, and alerting to ensure reliability More ❯

Data Engineer - Sought by Boutique Hedge Fund - Permanent - London Salary : £95 - 125k + Bonus About the Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL … Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software development and data engineering experience. Must have strong financial or trading background. Strong Python & SQL skills: writing clean, testable code following SOLID principles. Hands-on experience using Athena, Trino, ClickHouse, or other distributed SQL engines and knowledge of cost/scan optimization. … Experience with cloud platforms (AWS/Azure/GCP): working with object storage, managed query services, and data catalogs. More ❯

Data Engineer - Sought by Boutique Hedge Fund - Permanent - London Salary : £95 - 125k + Bonus About the Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL … Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software development and data engineering experience. Must have strong financial or trading background. Strong Python & SQL skills: writing clean, testable code following SOLID principles. Hands-on experience using Athena, Trino, ClickHouse, or other distributed SQL engines and knowledge of cost/scan optimization. … Experience with cloud platforms (AWS/Azure/GCP): working with object storage, managed query services, and data catalogs. More ❯

About the role Position: Senior Product Manager Location: London, UK Work Style: Hybrid Simple Machines. Data Engineered to Life Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments better connect with and understand their organisations, their people, their customers, and citizens. We are a team of creative engineers and technologists dedicated to unleashing the potential of data in new and impactful ways. We design and build bespoke data platforms and … unique software products, create and deploy intelligent systems, and bring engineering expertise to life by transforming data into actionable insights and tangible outcomes. Brief overview of the role's responsibilities Lead cross-functional teams to deliver data-led solutions for enterprise clients, focusing on high-quality outcomes and measurable business value. Provide product management expertise within the More ❯

for the right candidate. A market-leading global e-commerce client is urgently seeking a Senior MLOps Lead to establish and drive operational excellence within their largest, most established data function (60+ engineers). This is a mission-critical role focused on scaling their core on-site advertising platform from daily batch processing to real-time capability. This role … suits a hands-on MLOps expert who is capable of implementing new standards, automating deployment lifecycles, and mentoring a large engineering team on best practices. What you'll be doing: MLOps Strategy & Implementation: Design and deploy end-to-end MLOps processes, focusing heavily on governance, reproducibility, and automation. Real-Time Pipeline Build: Architect and implement solutions to transition high … tracking, and deployment within the Databricks platform. DevOps for ML: Build and automate robust CI/CD pipelines using GIT to ensure stable, reliable, and frequent model releases. Performance Engineering: Profile and optimise large-scale Spark/Python codebases for production efficiency, focusing on minimising latency and cost. Knowledge Transfer: Act as the technical lead to embed MLOps standards More ❯

for the right candidate. A market-leading global e-commerce client is urgently seeking a Senior MLOps Lead to establish and drive operational excellence within their largest, most established data function (60+ engineers). This is a mission-critical role focused on scaling their core on-site advertising platform from daily batch processing to real-time capability. This role … suits a hands-on MLOps expert who is capable of implementing new standards, automating deployment lifecycles, and mentoring a large engineering team on best practices. What you'll be doing: MLOps Strategy & Implementation: Design and deploy end-to-end MLOps processes, focusing heavily on governance, reproducibility, and automation. Real-Time Pipeline Build: Architect and implement solutions to transition high … tracking, and deployment within the Databricks platform. DevOps for ML: Build and automate robust CI/CD pipelines using GIT to ensure stable, reliable, and frequent model releases. Performance Engineering: Profile and optimise large-scale Spark/Python codebases for production efficiency, focusing on minimising latency and cost. Knowledge Transfer: Act as the technical lead to embed MLOps standards More ❯

strategic initiative within Financial Services aimed at delivering a unified, trusted view of customer data. We're seeking a highly skilled Lead Databricks Engineer to design and implement scalable data pipelines that form the backbone of our Lakehouse platform, enabling accurate analytics, reporting, and regulatory compliance. You'll work with cutting-edge technologies including Databricks , PySpark , and Azure Data Factory , applying best practices in data engineering and governance to support this critical programme. Lead Databricks Engineer: Key Responsibilities Build and maintain Databricks pipelines (batch and incremental) using PySpark and SQL. Orchestrate end-to-end workflows with Azure Data Factory . Develop and optimise Delta Lake tables (partitioning, schema evolution, vacuuming). Implement Medallion Architecture (Bronze … Silver, Gold) for transforming raw data into business-ready datasets. Apply robust monitoring, logging, and error-handling frameworks. Integrate pipelines with downstream systems such as Power BI . Collaborate with analysts, business teams, and engineers to deliver consistent, well-documented datasets. Support deployments and automation via Azure DevOps CI/CD . Gather and refine requirements from business stakeholders. More ❯

Mercator Digital is looking for a Data Specialist to be part of our growing consultancy. We're looking for a dynamic, forward-thinking Data Specialist with excellent communications that wants to learn new technologies and promote best practice. Role Expectations: Understand product owners needs to translate business requirements into analytics requirements and ensure that priorities are met. Create … visualisation of data, conduct deep-dive analysis and share insights & recommendations Ensure data collection and standardisation is met and explain methodologies to stakeholders Communicating efficiently and work together within a multi-disciplinary team, fostering the open and collaborative culture Enable data driven decision making to personalize the journeys of individuals to ensure they have the best and … most appropriate experience Produce product performance dashboards, user segmentation analysis, media agency tagging implementation Produce program dashboards and weekly analysis/information updates Experience Required : Cloud & Data Engineering: Proven experience with Google Cloud Platform (Projects, IAM, Storage, Dataprep), Azure SQL, Cosmos DB, and JSON data handling Digital & Web Analytics: Hands-on expertise with Google 360 (GA, GTM More ❯

Data Engineer Initial 6 month Contract| Hybrid 3 days onsite (London)2 remote | £430p/day (Inside IR35 Via umbrella) Currently on the look for a Data Engineer for an exciting project with our consultancy client! Looking for someone who is a hands on problem solver with a strong foundation in Python development, Databricks (preferably on AWS), and … a good understanding of machine learning (ML) workflow. What I’m looking for: Strong programming experience in Python, including data processing, automation, and ETL development. Hands-on experience with Databricks (ideally on AWS), including notebook workflows, cluster management, and performance tuning. Solid understanding of data engineering principle-pipelines, orchestration, and version control (Git, CI/CD). More ❯

Data Engineer Initial 6 month Contract| Hybrid 3 days onsite (London)2 remote | £430p/day (Inside IR35 Via umbrella) Currently on the look for a Data Engineer for an exciting project with our consultancy client! Looking for someone who is a hands on problem solver with a strong foundation in Python development, Databricks (preferably on AWS), and … a good understanding of machine learning (ML) workflow. What I’m looking for: Strong programming experience in Python, including data processing, automation, and ETL development. Hands-on experience with Databricks (ideally on AWS), including notebook workflows, cluster management, and performance tuning. Solid understanding of data engineering principle-pipelines, orchestration, and version control (Git, CI/CD). More ❯

SDLC best practices. Proven expertise in cloud-native architecture, ideally within the Microsoft Azure ecosystem. Solid understanding of AI and machine learning solution patterns. Deep knowledge of API design, data integration, and security standards (OAuth2, SSO, encryption). Ability to create clear, well-structured architectural documentation, including diagrams and roadmaps. Excellent communication and stakeholder management skills, with the ability … to bridge business objectives and technical delivery. Desirable Skills Background in full-stack or backend engineering, using technologies such as Python, TypeScript, or .NET. Experience with data engineering and data architecture concepts. Familiarity with MLOps practices and AI development frameworks (e.g., Azure AI, LangChain, Hugging Face). Relevant certifications in Azure Architecture, Data, or AI More ❯

Your New Role We're looking for a Senior Data Scientist to lead the development and application of advanced analytics and machine learning techniques that answer complex business questions and drive strategic decisions. You'll work closely with data engineering and business teams to design models and analytical solutions that improve customer experience, optimise operations, and support … financial and strategic planning.This role combines technical expertise with leadership responsibilities, including mentoring analysts and engineers, translating insights into actionable recommendations, and ensuring data science practices align with organisational goals. Key Responsibilities Customer Insights: Build churn prediction models, apply clustering and segmentation, and use NLP for sentiment analysis to improve service quality and retention strategies. Operational Performance: Develop forecasting … models, profitability analysis, and scenario modelling to guide investment and regulatory decisions. Geospatial Analytics: Apply spatial modelling and visualisation techniques to support network planning, operational assessments, and customer analysis. Data Science Leadership: Mentor team members, present insights clearly to technical and non-technical audiences, and ensure best practices in analytical workflows. Technical Delivery: Engineer and optimise analytical and spatial More ❯

you thrive on solving complex challenges, uncovering insights, and driving innovation with advanced analytics? If so, we could have the perfect opportunity for you! We're seeking an experienced Data Scientist to join our award-winning digital team at Stantec. You will be working alongside leading Analysts and Data Engineering experts to transform how we and our … be based from either our High Wycombe or London offices, with hybrid working allowing for a mix of in-office and home working. What You'll Be Doing Leading Data Science Initiatives - apply your expertise in data modelling, cleansing, and analytics to create innovative solutions that drive digital transformation. Deriving Powerful Insights - use predictive analytics and optimization techniques … to help clients make smarter, data-driven decisions. Building Intelligent Tools - develop automated solutions that enhance efficiency and provide clear, actionable insights. Driving Digital Innovation - work with technology and data to shape digital solutions that transform industry processes. Client Collaboration & Technical Delivery - partner directly with clients in the water industry, understanding their needs, designing solutions, and delivering high More ❯

to be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. We’re seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world … Doing You’ll be embedded in a fast-paced, mission-led programme where your work directly supports UK Government operations. Day-to-day, you’ll: ⚙️ Build and maintain scalable data pipelines within Palantir Foundry or Gotham 🔄 Ingest, transform, and integrate both structured and unstructured sensitive data sources 🔐 Enable secure access control, data modelling, and operational logic within … highly classified environments 🤝 Collaborate with multidisciplinary teams of analysts, engineers, and delivery experts to design secure, data-driven solutions 🚀 Contribute to a long-term agile delivery roadmap for mission-critical national programmes 🧠 What We're Looking For We're interested in engineers who are motivated by impact , not just tech for tech's sake. You should have: ✅ Proven hands More ❯

to be partnering with a leading force in the UK Government & Defence space to help build a high-impact team delivering one of the most sensitive and strategically important data programmes in the country. We’re seeking SC/DV Cleared Palantir Engineers who are driven by purpose, thrive in secure environments, and want to work on real-world … Doing You’ll be embedded in a fast-paced, mission-led programme where your work directly supports UK Government operations. Day-to-day, you’ll: ⚙️ Build and maintain scalable data pipelines within Palantir Foundry or Gotham 🔄 Ingest, transform, and integrate both structured and unstructured sensitive data sources 🔐 Enable secure access control, data modelling, and operational logic within … highly classified environments 🤝 Collaborate with multidisciplinary teams of analysts, engineers, and delivery experts to design secure, data-driven solutions 🚀 Contribute to a long-term agile delivery roadmap for mission-critical national programmes 🧠 What We're Looking For We're interested in engineers who are motivated by impact , not just tech for tech's sake. You should have: ✅ Proven hands More ❯

Fabric) Work Location: London (Office Based) The Role The role will be integral to realizing the customer's vision and strategy in transforming some of their critical application and data engineering components. As a global financial markets infrastructure and data provider , the customer leverages cutting-edge technologies to support its core services and business requirements. This role … is critical in enabling the technical thought leadership and excellence required for that purpose. Your Responsibilities Design, build, and optimise scalable data pipelines for batch and streaming workloads. Develop and manage dataflows and semantic models to support analytics-related business requirements. Implement complex transformations, aggregations, and joins ensuring performance and reliability. Apply robust data validations, cleansing, and profiling … techniques to ensure data accuracy and consistency. Implement role-based access, data masking, and compliance protocols. Performance tune and optimise jobs and workloads to reduce latency. Collaborate with analysts and business stakeholders to translate requirements into technical solutions. Create, maintain, and update documentation and internal knowledge repositories. Your Profile Essential Skills/Knowledge/Experience Ability to write More ❯

Senior Data Scientist (Contract) – Applied ML | AI | Optimisation Remote | UK/EU Time Zones | B2B/Outside IR35 *One-stage Interviews are taking place next week We’re hiring a Senior Data Scientist for a long-term contract with a scaling digital platform that’s investing heavily in its data and AI capability. This is a hands … across multiple products Developing new models focused on pricing optimisation, lead forecasting, and customer behaviour Contributing to new AI-driven initiatives, including text and sentiment analysis Collaborating closely with Data Engineering and BI to deliver robust, end-to-end ML pipelines and model monitoring Tech Environment: Python (pandas, scikit-learn, modern ML frameworks) SQL for analysis and model … input preparation Cloud environment (AWS/GCP/Azure) Exposure to NLP, MLOps, or CI/CD pipelines is a plus What We’re Looking For: Experienced Senior Data Scientist with a proven applied ML background Confident in owning end-to-end model development and optimisation Naturally collaborative, but comfortable working independently when needed Curious, pragmatic, and focused on More ❯