151 to 175 of 303 Data Pipeline Jobs in London

experience for clients and candidates, fostering innovation and professional growth. Our client is an established fintech scale-up transforming how digital platforms use data to support smarter financial decisions. They’ve grown rapidly across the UK, Europe, and North America, with backing from a respected investment group. Their … culture is data-driven, collaborative, and built around empowering teams to deliver fast, reliable insights that drive growth and performance. About the Role We’re looking for a Senior Analytics Engineer to help build and evolve a world-class analytics environment. You’ll take ownership of designing, developing ...

experience in the financial sector. Experience with CI/CD , microservices , and event-driven architectures is essential, and knowledge of Python (pyspark) for data-driven workflows is advantageous Key Responsibilities Design, develop, and maintain full stack applications using React JS , C#.NET Core , and supporting technologies. Build high-performance … stakeholders and risk, Regulatory Reporting and Finance domain experts to deliver solutions in these domains. Have a strong understanding of Power BI dashboards , data models, and analytical reports for business users. Work with DevSecOps to implement and optimize CI/CD pipelines , ensuring robust automated testing, deployment ...

experience in the financial sector. Experience with CI/CD , microservices , and event-driven architectures is essential, and knowledge of Python (pyspark) for data-driven workflows is advantageous Key Responsibilities Design, develop, and maintain full stack applications using React JS , C#.NET Core , and supporting technologies. Build high-performance … stakeholders and risk, Regulatory Reporting and Finance domain experts to deliver solutions in these domains. Have a strong understanding of Power BI dashboards , data models, and analytical reports for business users. Work with DevSecOps to implement and optimize CI/CD pipelines , ensuring robust automated testing, deployment ...

Data Engineer (AWS) Location: (Hybrid 2-3 days onsite) Salary: £60,000 - £70,000 + Bens, Perks, Healthcare Options, Unlimited Training Budget Security Clearance: Must be eligible for SC Clearance (5+ years UK residency) Sector: Public Sector & Government Client Build the Data Infrastructure That Powers … Public Sector We are looking for experienced Data Engineers to join a long-standing, high-impact public sector partnership. This isn't just about moving data; it's about modernizing essential services and delivering secure, reliable data products at scale. You will play ...

security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution ...

APIs, cloud platforms (AWS, GCP, Azure), containerisation Experience integrating AI into real-world systems, not just building models in isolation Strong understanding of data pipelines and system design Ideal candidate profile: Has worked as a Forward Deployed Engineer, Solutions Engineer or AI Consultant previously Equally comfortable writing production ...

Title: Senior Platform Engineer (AWS) – Data Platform Focus Location: Hybrid, 2days/week onsite-London, UK Duration: 6Months+ Contract Outside IR35 520GBP/Day Outside IR35 Overview We are hiring a Senior Platform Engineer (AWS) to work on a large project focused on moving data to AWS and building a modern data platform. The role is mainly platform and DevOps focused, with some involvement in data migration and data pipelines. We’re looking for someone who is strong in AWS, infrastructure, and automation, and can help build ...

Role: Data Scientist Type: Contracts (6 Months) Location: London, UK (REMOTE) Working Model: Fully Remote Payrate: (Apply online only) GBP/day on PAYE (Apply online only) GBP/day on RUPAYE (Apply online only) GBP/day on Inside IR35 on Umbrella The Role: Join our team … drive data quality and empower cross-functional decision-making by building robust pipelines and self-serve data products. You will be essential in defining metrics for platform health, developer productivity, and ML/AI adoption . What You Will Do: Own end-to-end analytical data ...

Description Data Engineer l Azure l Fabric l Pyspark l Greenfield l 6-Month Contract | £475-£500 per day | Outside IR35 l Hybrid 3 days in London We're partnering with a leading London-based organisation that's building a modern, enterprise-wide data platform … Microsoft Fabric and is seeking a Senior Data Engineer to support its delivery. This is a hands-on role within a greenfield Fabric environment, working across finance, operations, and strategic decision-making. You'll design and build scalable data solutions end to end, collaborating closely with ...

real world. You’ll work across: Flight and mission systems Operator interfaces and 3D environments Connectivity and distributed systems Simulation, testing, and data pipelines Your primary impact will be in: Defining architecture and technical strategy Driving engineering standards and system evolution Ensuring the platform scales ...

risks and dependencies. Contribute to opportunity shaping and ongoing client relationships through strong strategic and delivery‐led thinking. Required Experience & Profile Data Pipeline Development Proven experience in enterprise communications, engagement, or change communications within large, complex organisations. Strong ability to translate technical, digital, or process change into ...

real world. Work across flight and mission systems, operator interfaces and 3D environments, connectivity and distributed systems, and simulation, testing, and data pipelines. Define architecture and technical strategy, drive engineering standards and system evolution, and ensure the platform scales to support repeatable, reliable operations. Enable the team ...

teams in a delivery or assurance capacity. You may not have been necessarily a builder, but someone who has been close enough to data pipelines, model deployment, and API layers to understand what "done" looks like. A background in technology risk, ML engineering, or technical consulting with … single nginx config that nobody has reviewed. Specific things you would be able to do Read and interpret a data pipeline well enough to identify where lineage tracking, PII scanning, or quality checks are missing. Review model evaluation results and know whether HELM benchmarks have been ...

Engineer About the Role We are seeking a Azure Databricks Engineer to join a specialist consultancy focused on transforming enterprises through modern cloud data platforms, advanced analytics and next-generation engineering capabilities. This role requires strong experience working within the Lloyd's of London or wider London Market … insurance environment, with the ability to deliver data solutions that meet strict regulatory, audit and operational standards. You will take ownership of designing, building and optimising large-scale Azure data solutions, working closely with business and technical stakeholders to translate complex data challenges into ...

develop framework is essential Back-end: Expertise in C# .NET Core, REST APIs, and microservices-based development is essential Python (pyspark): Experience with data pipelines and analytics is a plus. Power BI: Familiarity with developing dashboards and data models. Architecture: Knowledge of microservices, API design ...

Role: Senior Azure DevOps Engineer (Kafka) Location: Remote (UK) Salary: £75k + 10% Bonus Key Skills: Azure Terraform Kubernetes Kafka Data platforms Overview We're partnering with a fast-growing SaaS organisation building a modern, data-driven platform that powers better insight into behaviour, performance … They're scaling their platform capability and are now looking for a Platform Engineer to help design, build, and evolve their cloud and data infrastructure. This is a hands-on role spanning cloud infrastructure, DevOps, and data platform engineering. The Role You'll work across Azure ...

/month onsite) Rate: £79 per hour (Inside IR35) Duration: 6 months Security Clearance: BPSS required The Role Join a large-scale, data-driven platform team focused on capturing and analysing customer interaction data. You'll work within an Insights & Reputation function, building services that improve data … enable smarter decision-making at scale. This is a hands-on full stack engineering role within a multidisciplinary Agile team, delivering scalable data products with real-world impact. What You'll Be Doing Designing and building scalable, secure software across frontend and backend systems Developing APIs, data ...

Integrate advanced AI capabilities including voice, reasoning, and context management ⚙️ Design and own scalable APIs connecting products and intelligence systems ⚙️ Architect data pipelines that power decision-making and agent context ⚙️ Build backend systems for knowledge extraction, enrichment, and automation ⚙️ Contribute to DevOps practices across CI/CD, infrastructure ...

skills: 8+ years’ experience in backend development, specifically in Python. Experience with DevOps tools and principles as well as IaaC. Experience in building data pipelines. Experience with NoSQL Databases. Able to lead and grow teams. Interview process: 1 st stage – video call with the Squad Lead (30 minutes ...

small, high‐impact team building AI systems that power decision‐making across a global investment platform. You’ll work alongside experienced AI engineers, data scientists, and technologists to deliver real products used by investment teams and portfolio companies. This role is ideal for: PhD graduates in a STEM … computational experience; or Bachelor’s/Master’s graduates with 1–2 years of industry experience or relevant internships in machine learning, data engineering, or software engineering. You’ll contribute to designing, implementing, and deploying production-grade ML systems—ranging from NLP pipelines to model‐driven workflow automation. ...

modern engineering best practices. Build and maintain microservices-based systems , with a strong focus on scalability, resilience, and performance. Develop and optimise scalable data pipelines , supporting both batch and streaming workloads, using technologies such as Apache Spark . Work extensively with data technologies , leveraging Python … deliver high-quality analytical and data-driven solutions. Lead the design and delivery of data-centric applications , translating complex business and analytical requirements into well-architected technical solutions. Implement and integrate large language models (LLMs) , including: Utilising both proprietary and open-source models Fine-tuning models ...

Role GenAI Data Engineer Your responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation … prompt management, evaluation, and GenAI operations. Collaborate with cross-functional teams to integrate GenAI capabilities into production systems and ensure high-quality data, governance, and operational reliability Your Profile Essential skills/knowledge/experience: Strong experience with PySpark, distributed data processing, and largescale ETL/ ...

growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This … hands-on engineering role at the intersection of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will ...

Health—we're building the future of population health management. As a Senior Machine Learning Engineer, you will sit at the intersection of data science, platform engineering, and production systems. Your mission is to design and operate the foundations that allow ML, analytics, and agentic AI systems … move safely and reliably from experimentation into regulated healthcare production environments on Google Cloud Platform. You will be the primary interface between Data Science and Platform Engineering, enabling rapid iteration while enforcing production and compliance standards. Responsibilities Design and implement Onsera's agentic AI platform – architect LLM/ ...

Denodo Data Engineer - SC Cleared Day Rate: £470 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically 1-2 days per month) in Telford or Hove Security Clearance: Active SC clearance required Role Overview … seeking an SC-cleared Denodo Data Engineer to join a central government data platform programme . This is a client-facing role requiring strong communication skills, commercial awareness, and a proactive approach. You will work within a delivery team to build and deliver base and integration ...