826 to 850 of 988 Data Engineering Jobs in the UK

Spring, Microservices and AWS We are looking for 8+ years experienced highly skilled Software Engineer with strong experience in Java, Spring, and Microservices development, along with exposure to big data processing and cloud-native technologies. The ideal candidate will design, build, and maintain scalable systems that process large volumes of data in real time. JD: Design, develop, and … maintain scalable microservices using Java and Spring Boot. Build and optimize real-time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage, and monitor services in containerized environments (Docker/Kubernetes). Write efficient and optimized SQL queries for relational databases. Integrate and manage … Strong programming skills in Java and Spring Boot. Hands-on experience with Microservices architecture and RESTful APIs. Proficiency with Kafka and distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc. More ❯

Tick Data Engineer – London (Buy-Side) Our client, a leading London buy-side firm, is looking for a Tick Data Engineer to build and maintain the data infrastructure that powers their trading and research teams. You’ll be responsible for: Handling billions of ticks per day efficiently Building low-latency, scalable pipelines Delivering reliable, query-ready datasets … to quants and researchers What they are looking for: Experience in distributed data engineering at scale Strong coding skills in Python, C++ or Java Familiarity with kdb+, ClickHouse, Kafka, Parquet/Arrow Previous experience with tick-level financial data is a strong advantage More ❯

Tick Data Engineer – London (Buy-Side) Our client, a leading London buy-side firm, is looking for a Tick Data Engineer to build and maintain the data infrastructure that powers their trading and research teams. You’ll be responsible for: Handling billions of ticks per day efficiently Building low-latency, scalable pipelines Delivering reliable, query-ready datasets … to quants and researchers What they are looking for: Experience in distributed data engineering at scale Strong coding skills in Python, C++ or Java Familiarity with kdb+, ClickHouse, Kafka, Parquet/Arrow Previous experience with tick-level financial data is a strong advantage More ❯

cross-product integration Shape the Future: we are positioned to define the next generation of intelligent digital interaction across global brands The Role We are seeking an exceptional Staff Data Scientist who will architect and technically lead projects dedicated to pushing the boundaries of AI-driven digital experiences. In this pivotal role, you will guide the development of cutting … in this order of relevanceGitHub, Docker, GitHub Actions, Terraform, KubernetesPandas, PySpark and SparkVertex AI, Azure OpenAI for LLMs Job Responsibilities Lead the execution of projects in a high-performing data science team, fostering professional growth and creating an inclusive and collaborative environment Architect and design scalable machine learning systems that solve complex challenges Develop and execute the data science team's strategic roadmap, managing complex projects from conception to deployment Make high-impact technical decisions and provide guidance Establish best practices in software engineering and machine learning development Implement rigorous code quality and testing standards across data science projects Support talent acquisition and continuous learning initiatives Knowledge and Experience Knowledge of ML model development and More ❯

We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB Atlas, is the only globally distributed, multi-cloud database and is available in more than 115 regions across AWS, Google Cloud, and Microsoft Azure. Atlas allows customers … platform and the needs of our customers. MongoDB Pre-Sales Solution Architects are responsible for guiding our customers and users to design and build reliable, scalable systems using our data platform. Our team is made up of seasoned technical sales professionals, software architects, entrepreneurs, and developers who take direct responsibility for customer success, including the design of their software … degree or equivalent work experience You may also have: Experience selling databases and/or deploying applications with any of the major cloud providers Experience with database programming and data models Experience in data engineering or AI/ML projects Experience in transforming legacy systems and platforms into modern, scalable, and efficient technology stacks Understanding of popular More ❯

not just building technology — we’re shaping the future. With 226,500+ innovators across 60 countries and $14.2B in revenue, we’re powering transformation across industries through AI, cloud, engineering, and software. Now, we’re scaling our Generative AI capabilities — and we want you to lead the charge. Generative AI Architect We’re looking for a trailblazing Gen AI … in fast-paced, innovation-driven environments. What You’ll Build & Lead AI System Architecture : Architect scalable, modular Gen AI platforms that power real-time intelligence across domains. Foundation Model Engineering : Fine-tune and optimize LLMs, transformers, and diffusion models for enterprise-grade performance. Data Strategy : Lead data sourcing, integration, and transformation pipelines to fuel high-quality model … with TensorFlow, PyTorch, Keras, Hugging Face, LangChain Cloud-native mindset: AWS, Azure, GCP + Docker, Kubernetes, CI/CD Deep understanding of ML/DL algorithms, model evaluation, and data engineering Strong communicator and collaborator across technical and business teams Bonus Points Experience with NVIDIA CUDA, cuDNN, TensorRT, and GPU acceleration Familiarity with HPC workloads and vector databases More ❯

Senior AI/ML Engineer UK Based (Remote) - Up to $180,000 Join a leading blockchain analytics platform that combines on-chain data with millions of wallet labels to help investors, institutions, and crypto-native teams make faster, more informed decisions in the decentralised economy. Responsibilities: Lead the design, implementation, and use of AI/ML models to process … or related fields. Proven experience as an AI/ML Engineer or similar role A passion for blockchain, crypto, and Web3 technologies An ability to work full-stack with data; some data engineering experience is a big plus Strong coding skills in Python Strong communication skills, with the ability to work effectively in a fast-paced, collaborative More ❯

in office) Contract length - initially 6 months Sponsorship is not available for this role We’re working with a forward-thinking tech team looking to bring on a seasoned Data Engineer to lead the delivery of scalable, cloud-native data solutions. Required skillset: 5+ years professional experience within data engineering roles Strong Python skills for data … performance tuning API development using Django or Flask Solid understanding of legacy-to-cloud migration Familiarity with RDBMS (Sybase IQ, Oracle, SQL Server, PostgreSQL) Bonus: Kafka/Spark Streaming, data governance exposure More ❯

Principal Software Engineer - Snowflake page is loaded Principal Software Engineer - Snowflakeremote type: Hybridlocations: Edinburgh, GBtime type: Full timeposted on: Posted Todayjob requisition id: JR2454Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need reliable and actionable … Focused - we accelerate change Curious - we turn knowledge into action About the Role We're looking for a Principal Software Engineer to join our Snowflake Platform team within our Data Platform group. You'll be responsible for the systems and infrastructure that integrate Snowflake into our broader data ecosystem, ensuring our platform is maintainable and continues to technically … to solve complex technical problems, particularly around Snowflake integration and platform adoption Have expert-level experience with Snowflake, including its architecture, capabilities, and how it integrates within a wider data platform ecosystem Have strong experience building web-based applications, supporting micro-services and deploying them in a cloud environment, with specific focus on data platform infrastructure Lead and More ❯

the heart of their organisation by identifying and delivering products and services that are right for their customers. Due to a recent merger, my client is looking for a Data Engineer to join their Data team to design, develop and test quality data engineering solutions and to challenge/improve processes, tools and approaches. There is … a potential for the role to be extended or to be moved into a permanent position in the future. Main responsibilities Migration and integration of data into their new ecosystem Undertake review and assurance activity Provide team members with guidance on design, build and test activity Deliver solutions that meet business needs in a timely manner Take responsibility for … testing of solutions including the analysis of requirements, designs of test cases/scripts, preparing test date and creating/executing tests Requirements Strong experience as a Data Engineer (migrating legacy systems onto AWS, building data pipelines) Strong Python experience Tech stack experience required: AWS Glue, Redshift, Lambda, PySpark, Airflow SSIS or SAS experience (Desirable) Benefits Salary up More ❯

the heart of their organisation by identifying and delivering products and services that are right for their customers. Due to a recent merger, my client is looking for a Data Engineer to join their Data team to design, develop and test quality data engineering solutions and to challenge/improve processes, tools and approaches. There is … a potential for the role to be extended or to be moved into a permanent position in the future. Main responsibilities Migration and integration of data into their new ecosystem Undertake review and assurance activity Provide team members with guidance on design, build and test activity Deliver solutions that meet business needs in a timely manner Take responsibility for … testing of solutions including the analysis of requirements, designs of test cases/scripts, preparing test date and creating/executing tests Requirements Strong experience as a Data Engineer (migrating legacy systems onto AWS, building data pipelines) Strong Python experience Tech stack experience required: AWS Glue, Redshift, Lambda, PySpark, Airflow SSIS or SAS experience (Desirable) Benefits Salary up More ❯

Scala Developer A leading Data & Analytics company seek a Scala Developer to build high-performance data systems that power real insight and innovation. What You’ll Do: Design, build, and optimise data pipelines and distributed systems in Scala. Collaborate with data scientists, engineers, and analysts to turn complex data challenges into elegant, scalable solutions. Work … with modern data technologies (e.g. Spark, Kafka, AWS/GCP, Docker, Kubernetes). Contribute to a culture of technical excellence, knowledge sharing, and continuous improvement. What We’re Looking For: Strong experience with Scala (and ideally the wider JVM ecosystem). Background in data engineering, backend development, or distributed systems. Familiarity with functional programming principles. A collaborative More ❯

Scala Developer A leading Data & Analytics company seek a Scala Developer to build high-performance data systems that power real insight and innovation. What You’ll Do: Design, build, and optimise data pipelines and distributed systems in Scala. Collaborate with data scientists, engineers, and analysts to turn complex data challenges into elegant, scalable solutions. Work … with modern data technologies (e.g. Spark, Kafka, AWS/GCP, Docker, Kubernetes). Contribute to a culture of technical excellence, knowledge sharing, and continuous improvement. What We’re Looking For: Strong experience with Scala (and ideally the wider JVM ecosystem). Background in data engineering, backend development, or distributed systems. Familiarity with functional programming principles. A collaborative More ❯

pension Contract: Full-time, permanent - Open to considering candidates seeking a 4-day work week on a pro rata basis (Fridays off) We are partnering with a specialist data analytics consultancy that has successfully grown into a multi-million-pound business. As they enter an exciting new growth phase, they are seeking a Client Consultancy Lead to help diversify … departments such as DWP, Home Office, MoD, etc. This role is ideal for a commercially minded senior/principal delivery consultant who combines strong technical delivery awareness in digital, data or technology services with excellent relationship-building skills, looking for a less utilisation-heavy role and more of a client relationship lead. The consultancy offers a strong company-wide … Consultancy Lead/Principal Consultant to spearhead growth and open new doors in the UK public sector. The ideal candidate will be a senior consultant who has worked within data, digital transformation, or IT consulting services in central government departments, who is now looking to focus on relationship building and being a trusted advisor to the board. You will More ❯

pension Contract: Full-time, permanent - Open to considering candidates seeking a 4-day work week on a pro rata basis (Fridays off) We are partnering with a specialist data analytics consultancy that has successfully grown into a multi-million-pound business. As they enter an exciting new growth phase, they are seeking a Client Consultancy Lead to help diversify … departments such as DWP, Home Office, MoD, etc. This role is ideal for a commercially minded senior/principal delivery consultant who combines strong technical delivery awareness in digital, data or technology services with excellent relationship-building skills, looking for a less utilisation-heavy role and more of a client relationship lead. The consultancy offers a strong company-wide … Consultancy Lead/Principal Consultant to spearhead growth and open new doors in the UK public sector. The ideal candidate will be a senior consultant who has worked within data, digital transformation, or IT consulting services in central government departments, who is now looking to focus on relationship building and being a trusted advisor to the board. You will More ❯

complex, high-impact solutions for clients across the UK. This is a unique opportunity to combine deep technical expertise with leadership, working hands-on with modern technologies while shaping engineering standards and mentoring high-performing teams. This role sits within a growing Software Engineering function and offers the chance to work across a variety of industries and projects. … You’ll collaborate with architects, consultants, and stakeholders to design and deliver scalable, secure, and innovative systems — all while contributing to a strong internal engineering culture. Within this role: Leading engineering delivery on complex client engagements Setting and embedding best practices: CI/CD, cloud-native, DevOps, test automation, AI-assisted development Mentoring and managing engineers, shaping frameworks … and engineering culture Staying hands-on with coding, prototyping, and emerging technologies Collaborating with clients and stakeholders to design end-to-end solutions What we’re looking for: Proven experience leading engineering teams and delivering enterprise-grade solutions Deep expertise in Java and Spring Strong background in API and data engineering Proficiency with cloud platforms (AWS More ❯

complex, high-impact solutions for clients across the UK. This is a unique opportunity to combine deep technical expertise with leadership, working hands-on with modern technologies while shaping engineering standards and mentoring high-performing teams. This role sits within a growing Software Engineering function and offers the chance to work across a variety of industries and projects. … You’ll collaborate with architects, consultants, and stakeholders to design and deliver scalable, secure, and innovative systems — all while contributing to a strong internal engineering culture. Within this role: Leading engineering delivery on complex client engagements Setting and embedding best practices: CI/CD, cloud-native, DevOps, test automation, AI-assisted development Mentoring and managing engineers, shaping frameworks … and engineering culture Staying hands-on with coding, prototyping, and emerging technologies Collaborating with clients and stakeholders to design end-to-end solutions What we’re looking for: Proven experience leading engineering teams and delivering enterprise-grade solutions Deep expertise in Java and Spring Strong background in API and data engineering Proficiency with cloud platforms (AWS More ❯

complex, high-impact solutions for clients across the UK. This is a unique opportunity to combine deep technical expertise with leadership, working hands-on with modern technologies while shaping engineering standards and mentoring high-performing teams. This role sits within a growing Software Engineering function and offers the chance to work across a variety of industries and projects. … You’ll collaborate with architects, consultants, and stakeholders to design and deliver scalable, secure, and innovative systems — all while contributing to a strong internal engineering culture. Within this role: Leading engineering delivery on complex client engagements Setting and embedding best practices: CI/CD, cloud-native, DevOps, test automation, AI-assisted development Mentoring and managing engineers, shaping frameworks … and engineering culture Staying hands-on with coding, prototyping, and emerging technologies Collaborating with clients and stakeholders to design end-to-end solutions What we’re looking for: Proven experience leading engineering teams and delivering enterprise-grade solutions Deep expertise in Java and Spring Strong background in API and data engineering Proficiency with cloud platforms (AWS More ❯

re building the future of responsible finance. We're looking for a hands-on Chief Technology Officer (CTO) to lead our tech strategy, drive sprint-based delivery, and own data integrity across our lending platforms. This is a high-impact role, reporting to the board and shaping the direction of both our B2B and B2C tech products. What You … ll Do: · Define and execute the technology roadmap for our SME and consumer lending platforms · Lead and mentor a cross-functional team of 7+ developers · Architect and maintain scalable data pipelines and integrations · Oversee agile delivery cycles with clear outcomes and accountability · Ensure platform compliance with FCA, CCA, and data protection regulations · Manage third-party tech partnerships (e.g. … Simform, NexGen) · Consolidate ownership of Lovey's full technology ecosystem · Lead architectural design for data flow, resilience, and automation across lending systems · Oversee sprint governance, partner performance, and system uptime · Implement robust data and cyber risk frameworks aligned with FCA expectations · Represent technology and innovation strategy to investors and the Board Technology Background of the CTO: · Languages: Python More ❯

test-driven software solutions using the latest tools and methodologies What We’re Looking For Strong background in .NET (C#), SQL Server, SSIS/SSAS, T-SQL Experience of data engineering, ETL/ELT pipelines, Azure services (Data Factory, Synapse, Data Lake) Exposure with React/Angular/TypeScript Knowledge of CI/CD and DevOps More ❯

test-driven software solutions using the latest tools and methodologies What We’re Looking For Strong background in .NET (C#), SQL Server, SSIS/SSAS, T-SQL Experience of data engineering, ETL/ELT pipelines, Azure services (Data Factory, Synapse, Data Lake) Exposure with React/Angular/TypeScript Knowledge of CI/CD and DevOps More ❯

BI Report Engineer (Azure/Databricks) Glasgow | 3-4 days onsite | Exclusive Opportunity with a Leading UK Consumer Brand Are you a Power BI specialist who loves clean, governed data and high-performance semantic models Do you want to work with a business that's rebuilding its entire BI estate the right way-proper Lakehouse architecture, curated Gold tables … PBIP, Git, and end-to-end governance? If so, this is one of the most modern, forward-thinking Power BI engineering roles in Scotland. Our Glasgow-based client is transforming its reporting platform using Azure + Databricks , with Power BI sitting on top of a fully curated Gold Layer. They develop everything using PBIP + Git + Tabular Editor … and semantic modelling is treated as a first-class engineering discipline. This is your chance to own the creation of high-quality datasets and dashboards used across Operations, Finance, Sales, Logistics and Customer Care-turning trusted Lakehouse data into insights the business relies on every day. Why This Role Exists To turn clean, curated Gold Lakehouse data More ❯

BI Report Engineer (Azure/Databricks) Glasgow | 3-4 days onsite | Exclusive Opportunity with a Leading UK Consumer Brand Are you a Power BI specialist who loves clean, governed data and high-performance semantic models? Do you want to work with a business that's rebuilding its entire BI estate the right way-proper Lakehouse architecture, curated Gold tables … PBIP, Git, and end-to-end governance? If so, this is one of the most modern, forward-thinking Power BI engineering roles in Scotland. Our Glasgow-based client is transforming its reporting platform using Azure + Databricks , with Power BI sitting on top of a fully curated Gold Layer. They develop everything using PBIP + Git + Tabular Editor … and semantic modelling is treated as a first-class engineering discipline. This is your chance to own the creation of high-quality datasets and dashboards used across Operations, Finance, Sales, Logistics and Customer Care-turning trusted Lakehouse data into insights the business relies on every day. ? Why This Role Exists To turn clean, curated Gold Lakehouse data More ❯

Title: Data Scientist - AI Client: Home Office Rate: Up to £520 Contract: Inside IR35 Clearance: Active SC Clearance required (minimum 5 years' UK residency) We're seeking a skilled Data Scientist with AI experience to join a high-profile rogramme within a Central Government agency, working on advanced data and AI-driven solutions to support a mission … opportunity to work on cutting-edge initiatives applying Machine Learning, Natural Language Processing, and Large Language Models (LLMs) within a secure environment. Key Skills & Experience: Proven experience as a Data Scientist , ideally in a government or large-scale enterprise environment. Strong Python programming skills, including experience with data science and AI/ML frameworks (e.g., Pandas, NumPy, Scikit … generative AI tools. Hands-on experience with Microsoft Azure (Azure ML, Databricks, or other AI services). Ability to handle, process, and analyse large, complex datasets. Strong understanding of data ethics, governance, and responsible AI principles. Must have SC Clearance and 5 years' continuous UK residency . Desirable: Experience with MLOps or deploying ML models into production. Familiarity with More ❯

Title: Data Scientist - AI Client: Home Office Rate: Up to £520 Contract: Inside IR35 Clearance: Active SC Clearance required (minimum 5 years' UK residency) We're seeking a skilled Data Scientist with AI experience to join a high-profile rogramme within a Central Government agency, working on advanced data and AI-driven solutions to support a mission … opportunity to work on cutting-edge initiatives applying Machine Learning, Natural Language Processing, and Large Language Models (LLMs) within a secure environment. Key Skills & Experience: Proven experience as a Data Scientist , ideally in a government or large-scale enterprise environment. Strong Python programming skills, including experience with data science and AI/ML frameworks (e.g., Pandas, NumPy, Scikit … generative AI tools. Hands-on experience with Microsoft Azure (Azure ML, Databricks, or other AI services). Ability to handle, process, and analyse large, complex datasets. Strong understanding of data ethics, governance, and responsible AI principles. Must have SC Clearance and 5 years' continuous UK residency . Desirable: Experience with MLOps or deploying ML models into production. Familiarity with More ❯