176 to 200 of 363 Data Pipeline Jobs in Central London

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing … consultancies in Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … models based on these results Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience working with entire ML systems and data pipelines in large-scale production systems Experience building automated data More ❯

Data Engineer | 3-month Contract | Outside IR35 | £500 p/d | Python, SQL, AWS, Snowflake, BigQuery | Hybrid (London) OB are partnered with a leading technology-driven business who are looking for a Data Engineer to join their Data team. This is a great opportunity to work in a high-impact, data-focused … environment where you’ll contribute to the design, build, and optimisation of modern data pipelines supporting analytics and machine learning initiatives. Key Skills: Strong experience with Python (Pandas or Spark) and SQL. Experience with AWS/GCP, BigQuery, Airflow, Snowflake, Redshift. Must have strong data warehousing experience. Key Info: Outside IR35 £500 p/d Hybrid … in Central London ASAP start 3-month contract Data Engineer | 3-month Contract | Outside IR35 | £500 p/d | Python, SQL, AWS, Snowflake, BigQuery | Hybrid (London More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

setup, including nodes, networks, and security frameworks. Deep understanding of cryptography, hashing algorithms, digital signatures, and encryption techniques. Knowledge of integration with enterprise systems, APIs, cloud services, and data pipelines. Hands-on experience with DevOps, containerization, CI/CD pipelines, and cloud platforms (AWS, Azure, GCP) for blockchain deployment. Strong experience in solution architecture, technical leadership, and mentoring More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … meet-up in London, building a network of ML specialists Essential skills 🙏 Experience leading and mentoring other ML engineers Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience taking complete ownership of entire ML systems and data pipelines in large-scale production systems Experience building automated More ❯

you will do 🚀 Build fundamental models for education - solving the ultimate learning task of predicting student knowledge and optimal ‘next task’ Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable to any context - right now it’s … the English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather … meet-up in London, building a network of ML specialists Essential skills 🙏 Experience leading and mentoring other ML engineers Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Experience taking complete ownership of entire ML systems and data pipelines in large-scale production systems Experience building automated More ❯

Data Engineer Must be London-based, able to work from site in London with occasional travel to Croydon SC Clearance required/or eligible for clearance Contract duration: 2 years + Up To £41,000 per annum, depending on experience Job Purpose/The Role: We are seeking 3 experienced Data Engineers to support a high … Public Sector client. These roles will be part of a large project, contributing to the ongoing development and live support of critical systems within a secure, agile, and data-driven environment. Your Key Responsibilities: Work collaboratively in a multi-disciplinary Agile & DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration, transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools and platforms. Contribute to automation and continuous integration/deployment (CI/CD) efforts. Engage directly with clients and stakeholders, demonstrating excellent problem More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

Microsoft Fabric Consultant | Data Engineering & DataOps 📍 Hybrid (2 days onsite in London) 💼 Permanent | Full-time 💰 £70,000 – £75,000 + 10% Bonus & 25 days holiday, pension & other benefits Are you a Fabric Consultant or Data Engineer looking to work with cutting-edge tech and make a real impact? We’re hiring for a hands-on role … where you’ll design and build scalable data pipelines using Microsoft Fabric and Databricks , drive DataOps best practices, and manage agile delivery through Jira . You’ll be part of a high-performing consultancy team delivering modern data platforms for enterprise clients. What You’ll Be Doing as a Fabric Consultant: Building end-to-end data pipelines with Microsoft Fabric & Databricks Driving DataOps workflows, CI/CD automation, and agile delivery via Jira Leading client workshops and collaborating with cross-functional teams Supporting data governance, compliance, and privacy initiatives Mentoring junior engineers and contributing to internal best practices What You’ll Bring: Strong experience in data engineering with Microsoft Fabric Solid More ❯

assistants Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or Node.js. Collaborate with architects to define scalable, secure, and cost-efficient AI service architectures. Implement AI/ML pipelines for training, validation, and deployment … model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … with cloud platforms (AWS, GCP, Azure) and AI/ML services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

assistants Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or Node.js. Collaborate with architects to define scalable, secure, and cost-efficient AI service architectures. Implement AI/ML pipelines for training, validation, and deployment … model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … with cloud platforms (AWS, GCP, Azure) and AI/ML services. -Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). -Strong understanding of data engineering, data pipelines, and ETL workflows. -Excellent problem-solving, communication, and stakeholder engagement skills. -Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

Overview : We are seeking a seasoned HR Data Solution Architect to design and build a scalable people data reporting and analytics platform. The ideal candidate will have strong experience in data architecture, integration, and reporting—preferably with Workday and Prism, though expertise in other People Data systems will also be considered. Key … Responsibilities : Architect and model data structures for HR analytics platforms, ensuring alignment with enterprise data lakes. Design and implement ETL pipelines and integrations across Workday, Prism, and external systems. Develop reporting datasets and dashboards using tools like Workday, Prism, Tableau, or Power BI. Establish data governance, privacy, and security controls. Monitor and optimize data pipelines and stay current with platform enhancements. Contribute to agile delivery practices and cross-functional collaboration. Preferred Skills : Deep understanding of Workday Objects and Prism Data Hub. Experience with cloud platforms, microservices, and modern data architectures. Strong analytical and stakeholder management skills. More ❯

Senior Engineer – Data/Software - London - £90,000 - £130,000 My client are expanding their Data Science & Technology, the team builds the systems and tools that enable trading teams to analyze markets, forecast price movements, and manage risk with speed and precision. If you’re passionate about engineering impactful solutions in a high-performance trading environment … this is an opportunity to drive innovation at the intersection of data, technology, and commerce. Salary and Benefits Competitive salary of up to £130,000 (DOE) Performance bonus of up to 30% Comprehensive medical, dental, retirement, and life insurance Wellness and employee assistance programs Parental and family leave policies Two paid days annually to volunteer with local charities … workflows and analytical models. Develop robust Python-based services and APIs using modern frameworks, microservice architectures, and best-practice design principles. Design and maintain tools that support market data ingestion, supply & demand modeling, and position management. Leverage AWS cloud technologies (including ECS, Lambda, S3, and CloudWatch) to deploy scalable, high-availability systems for data processing and More ❯

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and … reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive … advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance our service offerings. Qualifications: Bachelor's degree in Computer Science, Data Science, or a related field. Strong foundation in data engineering, including experience with ETL processes, data modeling, and database management, as well as SQL. Knowledge More ❯

Location: Central London (Hybrid options available) Daily Rate contract - Outside IR35 A leading FTSE 250 organisation is seeking a BI Fabric Developer/Engineer to help transition its data platforms into their Microsoft Fabric workspace. This is a unique opportunity to work on cutting-edge BI and analytics solutions that drive strategic decision-making across the business. Key … Responsibilities Lead the migration of data platforms into Microsoft Fabric for enhanced reporting and stakeholder access. Design and maintain data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS. Develop Power BI dashboards and paginated reports tailored to business needs. Model complex datasets into actionable insights using star schemas, snowflakes, and denormalised models. … teams to translate business requirements into technical solutions. Support CI/CD deployment processes using Azure DevOps. Required Skills & Experience Strong expertise in Power BI, DAX, SQL, and data architecture. Proven experience with Azure Data Factory, Fabric Lakehouse/Warehouse, and Synapse. Proficiency in PySpark, T-SQL, and data transformation using Notebooks. Familiarity with More ❯

Location: Central London (Hybrid options available) Daily Rate contract - Outside IR35 A leading FTSE 250 organisation is seeking a BI Fabric Developer/Engineer to help transition its data platforms into their Microsoft Fabric workspace. This is a unique opportunity to work on cutting-edge BI and analytics solutions that drive strategic decision-making across the business. Key … Responsibilities Lead the migration of data platforms into Microsoft Fabric for enhanced reporting and stakeholder access. Design and maintain data pipelines using Fabric Pipelines, Azure Data Factory, Notebooks and SSIS. Develop Power BI dashboards and paginated reports tailored to business needs. Model complex datasets into actionable insights using star schemas, snowflakes, and denormalised models. … teams to translate business requirements into technical solutions. Support CI/CD deployment processes using Azure DevOps. Required Skills & Experience Strong expertise in Power BI, DAX, SQL, and data architecture. Proven experience with Azure Data Factory, Fabric Lakehouse/Warehouse, and Synapse. Proficiency in PySpark, T-SQL, and data transformation using Notebooks. Familiarity with More ❯

A leading Financial Services client in London is undergoing a major data transformation and is hiring a Data Engineering Manager on a permanent basis. The role offers a base of £85,000, strong benefits, and flexible hybrid/remote working. Were looking for a hands-on leader from a forward-thinking, modern data environment … with a strong foundation in Data Engineering and experience managing a squad of 47 Data Engineers. Youll bring solid SQL skills, cloud expertise (preferably Azure), and familiarity with tools such as Snowflake, Databricks, ADF, Python, and GenAI. Youll manage a squad of engineers and play a key role in delivering scalable, modern data solutions … as part of a group-wide transformation. Requirements: Proven experience in fast-paced environments working with modern data architectures and tooling; Financial Services experience is a plus. Experience managing Data Engineering teams Strong SQL and cloud skills (Azure preferred) Familiar with modern data tools (e.g. Snowflake, Databricks, ADF, Python) Track record of building/ More ❯

machine learning, deep learning or AI engineering • Advanced proficiency in Python and ML frameworks like PyTorch • Experience deploying and maintaining scalable production-grade AI systems • Strong understanding of data pipelines, MLOps and cloud platforms (AWS and Azure) • Experience working in small or mid-sized tech/software development environments (rather than in corporate environments) would be advantageous The More ❯

machine learning, deep learning or AI engineering • Advanced proficiency in Python and ML frameworks like PyTorch • Experience deploying and maintaining scalable production-grade AI systems • Strong understanding of data pipelines, MLOps and cloud platforms (AWS and Azure) • Experience working in small or mid-sized tech/software development environments (rather than in corporate environments) would be advantageous The More ❯