151 to 175 of 185 Data Engineering Jobs in the Thames Valley

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … re looking for a Staff Software Engineer to join our Engineering team. You will provide technical leadership for both delivery squads and the wider engineering organisation. Along with our engineering leadership, you’ll champion engineering excellence and high standards of quality through an environment of continuous improvement. You will be hands-on, directly delivering new impactful … for growth and improvement - Build mock-ups or prototypes to explore and troubleshoot new initiatives - Explore new ideas and emerging technologies, develop prototypes quickly - Uphold and advance the wider engineering team’s principles and ways of working - Promote a culture of continuous improvement, positively influence current ways of working, leading by example - Serve as a domain expert in many More ❯

Mid & Senior Data Engineers (Databricks) | London | up to £85k + Bonus Multiple roles Are you a Databricks expert ready to make a real impact? Join our high-growth consultancy and help shape the future of data platforms for some of the UK’s most asset-intensive industries. 📍 Location: London (Hybrid – 2 days/week onsite) 📄 Role Type: Permanent … base + up to 20% bonus (based on performance & commercial impact) 🔍 What’s the Opportunity? We’re on the lookout for a Mid/Senior Data Engineer to take a leading role in our expanding Databricks practice . With two senior team members moving on and demand growing fast, this is your chance to step into a high-impact … a values-driven consultancy with a strong presence in utilities, manufacturing, and aviation . Our team thrives on collaboration, technical excellence, and clear communication. We don’t just build data platforms—we solve real business problems. 🛠️ What You’ll Be Doing Designing and building scalable data pipelines using Databricks and medallion architecture Leveraging Delta Live Tables (DLT) for More ❯

options About the Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … AI Infrastructure/AI Platform Lead Hybrid London office: minimum 3 days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and … to streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Who are Inference Group? We’re a team of passionate innovators empowering businesses through the transformative power of data, machine learning, and artificial intelligence. At Inference Group, our mission is simple: to help organisations unlock their true potential and drive sustainable growth. As we expand rapidly, we’re looking for creative, curious minds who want to make a real … impact. Here, you’ll collaborate with leading experts in data, AI, and technology to help clients harness the full potential of their data. We believe in making the most of the journey. If you’re ambitious, inventive, and eager to contribute to the early stages of a fast-growing consultancy, we’d love to have you on board. We … ll explore the limitless opportunities of data and AI - driving excellence and having plenty of fun along the way. We’re looking for a highly talented AI & Machine Learning Solutions Architect to design, build, and deliver next-generation data and AI solutions for our clients. You’ll work at the intersection of strategy, technology, and innovation. Shaping how More ❯

About the Role We are seeking a motivated Data Engineer to join our team supporting the a major digitization project. This role is ideal for a recent graduate with a strong academic background in GIS, Remote Sensing, Geomatics, or a related discipline who is eager to apply technical skills in real-world geospatial data processing and digital mapping. … Key Responsibilities Process and manage large-scale spatial datasets from local authorities and government sources. Work with tools such as ArcGIS, QGIS, FME, and Python to support data transformation and automation workflows. Perform data validation, quality assurance, and topological checks to ensure accuracy and consistency. Contribute to digitization workflows, aligning with data specifications and project standards. Collaborate … with the data and QA teams to resolve mapping or attribute discrepancies. Prepare maps, reports, and spatial deliverables as required by project managers. Skills & Qualifications Bachelor’s degree in Geography, Geomatics, GIS, Remote Sensing, or Computer Science. Proficiency in ArcGIS or QGIS for spatial data handling. Familiarity with spatial databases (PostGIS, GeoPackage, etc.) and data formats (Shapefile More ❯

About the Role We are seeking a motivated Data Engineer to join our team supporting the a major digitization project. This role is ideal for a recent graduate with a strong academic background in GIS, Remote Sensing, Geomatics, or a related discipline who is eager to apply technical skills in real-world geospatial data processing and digital mapping. … Key Responsibilities Process and manage large-scale spatial datasets from local authorities and government sources. Work with tools such as ArcGIS, QGIS, FME, and Python to support data transformation and automation workflows. Perform data validation, quality assurance, and topological checks to ensure accuracy and consistency. Contribute to digitization workflows, aligning with data specifications and project standards. Collaborate … with the data and QA teams to resolve mapping or attribute discrepancies. Prepare maps, reports, and spatial deliverables as required by project managers. Skills & Qualifications Bachelor’s degree in Geography, Geomatics, GIS, Remote Sensing, or Computer Science. Proficiency in ArcGIS or QGIS for spatial data handling. Familiarity with spatial databases (PostGIS, GeoPackage, etc.) and data formats (Shapefile More ❯

Key Responsibilities: Design, develop, and maintain scalable data pipelines for ingestion, transformation, and delivery of structured and unstructured data. Collaborate directly with traders, quantitative analysts, and portfolio managers to understand data needs and deliver actionable insights. Integrate and manage real-time market data feeds (e.g., Bloomberg, ICE, CME) and internal trading systems. Build and optimize data models for pricing, risk, and PnL analytics. Ensure high availability and performance of data infrastructure in a low-latency trading environment . Implement data quality checks , monitoring, and alerting systems. Work closely with DevOps and infrastructure teams to deploy solutions in cloud and on-prem environments. Required Skills & Experience Strong proficiency in Python , including libraries such as … Pandas, NumPy, and PySpark. Experience with data engineering tools (e.g., Airflow, Kafka, SQL, Parquet). Solid understanding of commodities markets , trading workflows, and financial instruments. Familiarity with cloud platforms (AWS, Azure, or GCP) and containerization (Docker, Kubernetes). Proven ability to work in fast-paced, high-pressure environments with direct exposure to the Front Office. Excellent communication skills More ❯

Principal Python Engineer Salary: Up to £130k + bonus Location: London (3x per week) I’m working with a global financial organisation that’s investing heavily in its data and cloud technology platform, and they’re looking for a Python Engineer to join their growing Investment Technology team. You’ll be: Building clean, scalable Python back-end systems Designing … cloud-first solutions in AWS (Lambda, AppSync, DynamoDB) Collaborating with data, investment, and engineering teams Shaping best practices across CI/CD, DevOps, and agile development What we’re looking for: 5+ years’ experience in software engineering (3+ in Python) Needs to have experience within financial services, fintech, or investment tech! Strong AWS and data engineering … of APIs, SQL/NoSQL, and modern software design A problem-solver who enjoys working closely with the business If you’re a Python engineer who loves solving complex data challenges in a collaborative, cloud-first environment — drop me a message: daniel.wexler@sourcegroupinternational.com THIS ROLE DOES NOT PROVIDE SPONSORSHIP More ❯

Senior Data Engineer - AWS 📍 London | Hybrid (3 days in office) 💼 Full-time | Permanent 💰 £75,000 – £90,000 per annum About the Role We’re seeking a technically skilled and commercially minded Senior Data Engineer with strong expertise in taking ownership over a product or task. This role sits within the Data Leadership Team and reports directly to … the Head of Data. You’ll play a key part in shaping and evolving the organisation’s event streaming analytics capability, ensuring there data ecosystem is future-proof, scalable, and impactful. Key Responsibilities Design and implement event-driven architectures to meet business needs Develop, deploy, and maintain scalable event streaming systems (including stream analytics) Ensure compliance with security standards … and regulations Collaborate with cross-functional teams to integrate event data into wider systems Monitor and optimise system performance (latency, throughput, resource utilisation) Troubleshoot issues and deliver solutions for high availability and reliability What We’re Looking For Experience 4+ years in a senior technical role, ideally within data engineering AWS stack: S3, EMR, EC2, Kinesis, Firehose More ❯

ML workflows. Ensure reliability, scalability, observability, and security of production systems and ML infrastructure. Automate deployment, orchestration, and environment management using modern DevOps tooling. Collaborate closely with software engineers, data scientists, and product teams to bring ML-powered features to production. Proactively detect, troubleshoot, and resolve infrastructure and model performance issues. Stay up to date with industry best practices … MLOps, and infrastructure engineering. Document infrastructure, workflows, and operational procedures clearly and thoroughly. We’re Looking For: Proven experience in a senior-level DevOps, MLOps, or related infrastructure-focused engineering role. Strong proficiency in Python and familiarity with ML frameworks such as TensorFlow or PyTorch. Deep experience with cloud platforms (AWS, GCP, or Azure) and container orchestration tools (Docker … Kubernetes). Solid understanding of CI/CD systems (e.g., GitHub Actions, GitLab CI, ArgoCD) and infrastructure-as-code tools (e.g., Terraform, Helm). Familiarity with data engineering concepts such as ETL pipelines, data lakes, and large-scale batch/stream processing. Ability to design scalable, secure, and observable systems in fast-moving environments. Strong debugging and More ❯

Our client is a leading hedge fund in London, leveraging cutting-edge technology and data to drive investment decisions across diverse asset classes. They're looking for a skilled Data Engineer to play a crucial role in building and optimizing the firm's data infrastructure. Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes. … Collaborate with data scientists and analysts to support data-driven strategies. Ensure data accuracy, consistency, and security across various data sources. Drive innovation by exploring new technologies and best practices in data engineering. Requirements: Bachelor’s or Master’s in Computer Science, Engineering, or a related field. 1+ years of experience in data engineering. Proficiency in SQL, Python, and big data tools like Spark. Excellent problem-solving skills and a collaborative mindset. More ❯

Senior LLM Engineer – London | Hybrid (2 days per week on-site, Bank area) My client is a long-established consultancy that originally built its reputation in data engineering and wider data transformation, and over the past few years has grown a strong applied AI practice. They tend to work with UK organisations where data security, reliability … ll be doing: • Owning the design and build of LLM-based systems end-to-end • Fine-tuning and adapting models (LoRA, instruction tuning, PEFT etc) rather than just prompt-engineering • Building RAG workflows, embedding strategies, memory layers and domain grounding • Working out how to measure output quality, reduce hallucination risk and improve robustness • Optimising inference performance (quantisation, distillation, pruning … able to be in London (Bank area) twice a week • This is a senior role – typically someone with 3+ years’ experience in ML/AI roles, ideally from a data science or applied ML background Benefits/set-up: • Modern kit (MacBook etc.) • 27 days annual leave + bank holidays • 4-week paid sabbatical after 4 years’ tenure • Regular More ❯

and physical trading teams. The role will focus on building and improving a modern metals trading analytics & visualisation platform. You’ll deliver production-grade Python systems, dashboards, automation and data pipelines that provide traders and risk teams with fast, reliable insights to support trading and risk decision-making. 📍 6 month rolling contract (strong likelihood of multi-year renewals) 💸 Rate … Python services and ETL pipelines for trading analytics. Build and enhance dashboards and visualisations (Grafana or equivalent) for traders and risk teams. Implement analytics, aggregation and automation to improve data quality, latency and reporting. Work closely with traders, risk, and data engineers to translate business requirements into reliable software. Contribute to deployment, CI/CD, containerisation and monitoring … of services. Help maintain documentation, tests and runbooks for production systems. Technical/professional skills (essential) Strong production Python experience (3+ years at senior level). Proven experience with data engineering/ETL and time-series or market data. Experience building dashboards/visualisations — Grafana highly preferable . Solid SQL skills and working knowledge of databases (Postgres, TimescaleDB More ❯

Do you come from either a Comp Sci or mathematical/algorithmic background, but feel like you haven't fully utilised that in your current data engineer role? If so, this is probably for you. This unique and culture drive hedge fund are looking for quantitative data engineers to join their world class data engineering team … that sits right next to the best algorithmic traders in the world. Some of the problems and data sets you'll work with will be incredibly complex, which is why the team is known for being wolrd class and heavily engineering focussed. You'll also be given the opportunity to use quantitative techniques to dig deep into these … data sets, and contribute to this research platform by building ETLs and coding your way towards a solution. So, who do you need to be? You're either: A Data Engineer within the Hedge Fund/Trading space Coming from an outstanding educational background, and work with complex data sets If this is you - get in touch. More ❯

Position Summary We are looking for a Data Migration Coordinator (CRM) to support our integration projects by ensuring fast, secure, and accurate access to agency CRMs. This role is focused on organizing and coordinating data exports, quality checks, and handover to our Data Engineering team — without the need for deep coding or building full ETL pipelines. … of quantities by entities (properties, landlords, tenants, tenancies, transactions, documents), spot checking of duplicates/empty values/type mismatches, validity of dates/mails. Artifacts: filling a simple data-dictionary, field mapping tables (source → our schema), Postman collections, example records. Coordination: communication with CRM vendors and agency managers, tracking deadlines, weekly updates, escalation of blockers. Transfer to DE … work: issuing access and artifacts, answers to clarifying questions about the origin of data. What is NOT required Write full-fledged connectors/ETL or complex backend. Design data models from scratch. Do advanced analytics - only basic checks according to checklists. Tools: Postman/Insomnia, WinSCP/FileZilla/Termius, SSH/SFTP/PGP, Google Sheets/Excel More ❯

About Us: Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Company Highlights: Quantiphi, a Services … AI Platforms company, has seen 2.5x growth YoY since its inception in 2013 Headquartered in Boston, with 3300+ data science professionals across 11 global offices Winner of 3X NVIDIA AI Partner of the year award Winner of the 17X Google Cloud Partner of the Year award including "Machine Learning, Breakthrough and Social Impact partner Winner of 3X AWS AI … Recognized Leaders by Gartner, Forrester, IDC, ISG, Everest Group and other leading analyst and independent research firms. Recognized in the Fast Company 2021 World Changing Ideas- AI and Data category Winner of 2021 AWS Canada Rising Star of the Year Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next More ❯

SQL Analyst, CDP & CRM Segmentation London based – hybrid working – 3 days on site 3-6 Month contract – Inside IR35 We’re standing up a Customer Data Platform (CDP) and need a hands-on SQL analyst to tighten audience segmentation, productionise segmentation logic in the warehouse, and push curated traits into Braze so CRM can operate campaigns without overloading the … data team. What you’ll do Own audience & trait definition Translate CRM/Marketing objectives into precise, reusable audience and trait specs Build and maintain warehouse-first segmentation tables/views with clear SLOs and documentation. Ship reliable data to Braze Design pipelines to push curated traits and audiences to Braze , including change-data capture and dependency … Braze counts vs. warehouse truth to ensure high confidence. Unblock campaign operations Create a self-serve library of SQL snippets, views, so CRM can launch campaigns without ad-hoc data requests. Implement suppression logic (deliverability, compliance, frequency caps) and guardrails. Partner across teams Work closely with Data Engineering, CRM, BI and Product to align event/identity More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … and UX designers to review designs, implement new features, and ensure user experience is top level • Explore new ideas and emerging technologies, develop prototypes quickly • Uphold and advance the engineering team’s principles and ways of working • Serve as a domain expert for one or more of Ki’s core technologies • Mentor and coach colleagues in both engineering and business domain subjects Required Skills and Experience: • Experience as a mid-senior level engineer working across a modern web stack • Strong software engineering principles (SOLID, DRY, ER modelling) • Professional experience with a server-side language, ideally JVM based • Professional experience building web-based single page applications, using React/Typescript or an equivalent • Knowledge of front-end More ❯

seeking a Senior Engineer with strong software experience and ambition to grow and develop their career. Responsibilities: Design and implement scalable, secure backend services to support a high-availability, data-driven SaaS platform operating in a regulated industry. Work primarily with Python to build microservices, automation tools, and backend logic, leveraging its rich ecosystem for data processing, compliance … workflows, and API development. Collaborate with cross-functional teams including product, DevOps, and data engineering to deliver end-to-end functionality that meets regulatory and business requirements. Leverage modern cloud services (AWS, Azure, or GCP) to deploy, monitor, and scale distributed systems in production environments. Establish and uphold engineering best practices, including CI/CD pipelines, automated … testing, and peer code reviews, to ensure code quality, reliability, and auditability. Mentor and guide junior engineers, providing technical leadership and helping shape the team’s engineering culture and standards. Experience: Minimum 5 years’ experience working as a software developer in a commercial environment. Strong python programming experience. Experience of managing teams. Ability to effectively share knowledge of development More ❯

Business Analyst – Power BI | Outside IR35 Location: London once a week | | 6 month contract Why this role matters If you’re a hands-on Technical BA who thrives in data-heavy environments and wants to make a visible impact fast, this one’s for you. You’ll join a global insurance group that’s on a mission to transform … how it reports, visualises and uses data across its portfolio, bringing clarity to senior stakeholders and driving smarter business decisions. What you’ll be doing You’ll take the lead on gathering, defining and refining business requirements for Power BI dashboard projects within their Underwriting Programme. Working with teams across the UK, EU, and US, you’ll bridge the … gap between business needs and data engineering, shaping how group-level reporting comes to life. Expect to: Collaborate with PMs, architects, and data engineers (Power BI & Databricks stack) Translate complex data and business logic into clear, actionable user stories Design and validate visual concepts that help senior stakeholders see the bigger picture Bring structure, speed and More ❯

its Finance Technology team. This group builds and maintains the systems that power financial control, treasury, and tax functions across the business. The role offers exposure to distributed systems, data engineering, and high-throughput platforms, with the chance to work on projects ranging from payments automation and expense management to liquidity modelling and regulatory reporting. Key Responsibilities Design … and reporting tools for regulatory requirements Work across the full SDLC, from requirements gathering to deployment and support What We’re Looking For 3–6 years of professional software engineering experience Strong academic grounding in algorithms and data structures Experience with concurrent programming and asynchronous systems Familiarity with distributed systems, microservices-based architectures Commitment to clean, disciplined software … engineering practices Proficiency in Go, JavaScript, Java, C++ or other similar statically typed languages Why Apply? Technically challenging projects in a highly collaborative, engineering-led environment Greenfield and business-critical development with rapid release cycles Flat structure with autonomy and scope for input at all levels Excellent benefits, including healthcare, pension, and daily perks Discretion is guaranteed – your More ❯

translate them into technical requirements Research emerging AI technologies to propose the most effective solutions Design scalable, practical AI architectures to solve complex client problems Collaborate with engineers and data specialists to turn concepts into reality Produce technical documentation and present solutions to both technical and non-technical stakeholders Keep pace with new developments across AI, ML, and automation … Required Skills and Experience Strong understanding of AI and machine learning technologies, including LLMs, NLP, and data pipelines Proven experience in solution design, technical consulting, or pre-sales Ability to communicate complex concepts clearly to varied audiences Familiarity with cloud AI environments such as Azure AI, AWS Sagemaker, or GCP Vertex A natural problem solver with curiosity for cutting … edge tools and frameworks Desirable Experience Experience delivering AI or ML solutions in a commercial or consultancy setting Knowledge of data engineering, MLOps, or automation workflows Previous experience engaging directly with clients and senior stakeholders Why Join This is an opportunity to join a fast-scaling AI business at a defining stage of its growth. You’ll be More ❯

About the Role Join a pioneering team that’s redefining how AI and cloud-native platforms power front-office trading. We’re hiring a hands-on engineering leader to shape the future of our Dart platform, a critical infrastructure that supports Quantitative and Strat developers in building next-generation trading solutions. This is not just another engineering role. … secure, cost-aware, scalable systems using AWS services and Kubernetes. Mentor junior engineers and set best practices for AI/ML infrastructure. Influence across organisational boundaries and champion modern engineering trends. Stay ahead of the curve in Generative AI, ML infrastructure, and cloud-native tooling. Tech Stack Programming: Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue … Be a big player in a small, high-impact team with exposure across the organisation. What We’re Looking For 10 + years of extensive experience in software/data engineering, ideally in platform or infra roles. Strong programming skills in Python; passion for code quality and testing. Demonstrable experience applying GenAI concepts to front-office/capital More ❯

ll shape the digital and AI ecosystem powering this landmark project. You’ll provide technical leadership, align multi-stakeholder teams, and ensure the secure and scalable integration of multimodal data across global partners. This opportunity offers you A high-impact role within one of Europe’s most ambitious digital health research programmes. The chance to define digital infrastructure and … for multimodal health data. Oversee vendor partnerships, system integration, and performance delivery. Collaborate with AI, software, and clinical teams to build innovative digital health tools. Ensure compliance with healthcare data standards (FHIR, HL7) and data protection regulations. Establish quality and risk frameworks, monitor KPIs, and report on platform progress. You will bring PhD (or equivalent experience) in Digital … Health, AI, Computer Science, Bioinformatics , or similar. Proven experience leading large-scale digital health or AI-driven research projects . Strong knowledge of data engineering, cloud infrastructure, and healthcare interoperability . Excellent leadership, communication, and stakeholder management skills. A collaborative mindset with a passion for advancing responsible, real-world AI in healthcare. More ❯

ll shape the digital and AI ecosystem powering this landmark project. You’ll provide technical leadership, align multi-stakeholder teams, and ensure the secure and scalable integration of multimodal data across global partners. This opportunity offers you A high-impact role within one of Europe’s most ambitious digital health research programmes. The chance to define digital infrastructure and … for multimodal health data. Oversee vendor partnerships, system integration, and performance delivery. Collaborate with AI, software, and clinical teams to build innovative digital health tools. Ensure compliance with healthcare data standards (FHIR, HL7) and data protection regulations. Establish quality and risk frameworks, monitor KPIs, and report on platform progress. You will bring BSc/MSc/PhD (or … in Digital Health, AI, Computer Science, Bioinformatics , or similar. Strong vendor management and supplier negotiation experience. Digital solutions experience within healthcare or another highly regulated industry. Strong knowledge of data engineering, cloud infrastructure, and healthcare interoperability . Excellent leadership, communication, and stakeholder management skills. A collaborative mindset with a passion for advancing responsible, real-world AI in healthcare. More ❯