426 to 450 of 512 Data Pipeline Jobs in London

Our client is looking to add a Palantir Data Engineer to its ranks following recent successes and an uplift in requirements. Holding current Developed Vetting/DV Clearance is a MUST for this role. This is a 12 month rolling contract, paying up to £700 per day, outside IR35. The role requires 5 days onsite in Central London. … locations. About you Proven experience in building and deploying applications using Palantir Foundry. Strong engineering background, preferred in fields such as Computer Science, Mathematics, Software Engineering, Physics, and Data Science. A highly analytical mindset and eagerness to solve technical problems with data structures, storage systems, cloud infrastructure, front-end frameworks, and other technical tools. Strong coder … senior stakeholders. Data Integration: Connect and harmonise data from multiple sources into Palantir Foundry, ensuring clean, reliable, and compliant data pipelines by utilising Pipeline Builder and Python within Code Repositories. Ontology Development: Design and manage ontologies within Foundry to create logical data structures that enhance accessibility and usability. The ability to More ❯

Location: London (Hybrid 3 days onsite per week) Duration: 5+ Months (until December 2025, with possibility for extension) We are seeking a Data Engineer or Software Engineer to join a cutting-edge project focused on Large Language Model (LLM) agents for research . Technical skills: Experience building and maintaining data pipelines, knowledge of data storage solutions. Data Management: Data … preprocessing and cleaning, transformation and formatting, data quality control and validation Software engineering skills: Python, data pipelines. Required skills: Data experience, Python pipelines, Data sets mitigation and filtering experience Good to have experience: Machine Learning experience, Pie torch More ❯

Job Title: Head of Data Engineering (Ad Tech) About My Client: My client is a fast-growing video marketing platform that empowers brands to extend their creative content beyond walled gardens and onto the open web. Founded just three years ago, the company has grown to a 14-person team and is now entering an exciting phase of … experienced Lead Data Engineer/Head of Data Engineering to join their engineering team and lead the development and optimisation of their data pipeline architecture. This is a greenfield opportunity with significant influence over product development and technology stack decisions. Key Responsibilities: Design and implement data pipeline integrations with SSPs … with exposure to machine learning. Prior experience in the ad tech industry (DSP or data company experience is highly desirable). Deep understanding of data pipeline architecture and implementation. We Are Aspire Ltd are a Disability Confident Commited employer More ❯

Data Engineer - Active SC + NPPV3 Clearance Up to £550 per day (Outside IR35) 3 months initially Primarily Remote (Must be UK-based) My client is a major International Consultancy who urgently require Senior Data Engineers with active (SC) Security and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior … Data Engineer, with an active SC + NPPV3 Clearance Experience with Azure Data Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC Clearance +NPPV3 Clearance Nice to have: Immediate availability Hays Specialist Recruitment Limited acts More ❯

Data Engineer - Active SC + NPPV3 Clearance Up to £550 per day (Outside IR35) 3 months initially Primarily Remote (Must be UK-based) My client is a major International Consultancy who urgently require Senior Data Engineers with active (SC) Security and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior … Data Engineer, with an active SC + NPPV3 Clearance Experience with Azure Data Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC Clearance +NPPV3 Clearance Nice to have: Immediate availability Hays Specialist Recruitment Limited acts More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

financial organisation you will be decommissioning a legacy commodities platform and then become part of new platform team! What you'll need to succeed Great experience as a Data Engineer in Financial Services or Insurance - Strong experience working in regulated environments. Vast expertise with Databricks - possess Databricks certifications (desirable) Strong experience with Python. Expertise with modern data More ❯

financial organisation you will be decommissioning a legacy commodities platform and then become part of new platform team! What you'll need to succeed Great experience as a Data Engineer in Financial Services or Insurance - Strong experience working in regulated environments. Vast expertise with Databricks - possess Databricks certification. Strong experience with Python. Expertise with modern data More ❯

financial organisation you will be decommissioning a legacy commodities platform and then become part of new platform team! What you'll need to succeed Great experience as a Data Engineer in Financial Services or Insurance - Strong experience working in regulated environments. Vast expertise with Databricks - possess Databricks certification. Strong experience with Python. Expertise with modern data More ❯

Vacancy for Research Data Engineers at NPL 6 July 2021 Locations: Glasgow & Teddington NPL is the UK's National Measurement Institute, providing measurement expertise that underpins UK prosperity and quality of life. We are a world-leading research facility, bringing together scientists and engineers from various fields to help save lives, protect the environment, and support global trade … and innovation. We are investing in Data Science to address scientific challenges in Advanced Manufacturing, Energy & Environment, and Life Sciences & Health, aligned with our organizational growth and transformation plans. The Data Science team at NPL is expanding, and we are seeking motivated candidates at all levels, from early career to experienced scientists, data engineers … partners in academia and industry, you will help advance research by creating optimal data infrastructures across various projects. You will work across the entire data pipeline, from configuring data sources to integrating analytical tools. Responsibilities include developing data architectures, protocols, and software tools to promote the FAIR principles (Findable, Accessible, Interoperable More ❯

Data Engineer Contract to Permanent Skills: Python, Pandas Hybrid London Rate: c400/day (outside) & 70k Transform Sustainability with Smart Data Simulations. Ready to code for a cleaner future? A cutting-edge sustainability start-up based in Central London is seeking an experienced Data Engineer to help transform how businesses reduce their carbon footprint. … If you're fluent in Python, a master of Pandas, and passionate about building analytical models with customer data, this role offers you purpose and impact. What you’ll be doing Designing and implementing robust data pipelines Building simulations to model complex real-world customer behaviours Working with large and intricate data sets to … uncover actionable insights Collaborating with analysts, scientists, and product teams to turn data into sustainable solutions What we’re looking for Proven experience with Python and Pandas, especially in data analysis and simulation building A keen eye for data accuracy and insight generation Passion for sustainability and applying data to drive environmental More ❯

Graduate Software Engineer (Data & Infrastructure) London, United Kingdom At Modo Energy, we're on a mission to build the information architecture for the energy transition - we want to be the only place to come to for information on the global journey to net zero. Take a look at our platform , where we provide open access to an array … us in shaping the culture of a rapidly growing team. The role As a software engineer you will be trusted with responsibility day one, adding value to our data and infrastructure team. You will be responsible for developing new features and ensuring they are scalable, reliable, and efficient to meet future demands. We're looking for engineers who … are hungry to learn quickly. This position requires a proactive approach and readiness to introduce modern practices to development, monitoring, maintaining, and improving our data pipelines and infrastructure. We offer multiple career progression paths based on your interests and experience, whether that be in data engineering or infrastructure. At Modo, there will be opportunities to deepen More ❯

Graduate Software Engineer (Data & Infrastructure) London, United Kingdom At Modo Energy, we're on a mission to build the information architecture for the energy transition - we want to be the only place to come to for information on the global journey to net zero. Take a look at our platform , where we provide open access to an array … us in shaping the culture of a rapidly growing team. The role As a software engineer you will be trusted with responsibility day one, adding value to our data and infrastructure team. You will be responsible for developing new features and ensuring they are scalable, reliable, and efficient to meet future demands. We're looking for engineers who … are hungry to learn quickly. This position requires a proactive approach and readiness to introduce modern practices to development, monitoring, maintaining, and improving our data pipelines and infrastructure. We offer multiple career progression paths based on your interests and experience, whether that be in data engineering or infrastructure. At Modo, there will be opportunities to deepen More ❯

Design and implement complex data pipelines and architectures. Utilising dbt and Prefect to automate and run your data pipelines. Collaborate with cross-functional teams to align data engineering efforts. Engaging with clients to identify available data and help them achieve business goals. Key Candidate Requirements Knowledge Advanced proficiency in programming languages and … frameworks used in data engineering. Expertise in optimising and scaling data infrastructure. Strong understanding of data modelling, schema design, and database optimisation. Skills Experience with data orchestration tools and workflow management. Excellent written and verbal communication skills and an ability to effectively communicate technical details with non-technical stakeholders. Experience Computer Science … product suite in direct partnership with customers, Cortex was launched in 2024 to better serve the digitally diverse sports industry as a quick-to-deploy SaaS platform for data and revenue driven sports marketing. Cortex products are used by multiple top tier sports organisations and clubs including; Arsenal FC, Formula 1, ECB, the Hundred, Euroleague Basketball, URC, Premiership More ❯

Data Analytics - Research Analyst - Government and Social Impact Duration: 12 months contract Rate: Market rate (PAYE) Location: London (on site) Sector: Big tech Minimum Qualifications • 5-10 years of experience in data operations, or other relevant space leading large scale global projects or programs.• Excellent communication skills, both written and verbal. Ability to understand and simplify … complex topics and explain to others in a way that is easy to digest.• Experience analyzing and using data in solving and providing practical business insights, including reviewing and validating dashboards and reports, ensuring they accurately reflect key insights and metrics.• Practical experience reading or querying SQL databases.• Ability to use data analysis tools (e.g., SQL … Python, Excel) to extract, manipulate, and interpret data for business insights and monitoring performance and integrity of data pipelines. Preferred Qualifications • Knowledge of the government and elections space, including international politics, political parties, world leaders and national legislators.• 2+ years in software engineering, systems engineering, or technical product/program management.• 2+ years with scripting languages More ❯

app by Apple. Our investors are well known for supporting some previous successful unicorns such as Airbnb, Pinterest, Skyscanner and Tesla. What will I be doing? As a Data Specialist (Directories) at Bridebook you will play a major role in the development & maintenance of our venue directories data pipeline. Working closely with your colleagues you'll … be responsible for ensuring our users get the most engaging & accurate information while they're using the Bridebook App. You'll be ensuring the data that we transform into our directories is of high quality & is integrated in an efficient manner. Specific responsibilities will include: Monitoring and reporting on the quality of venue directories & information across global markets. … Effective data quality management across both internal & external data sets. Analysing existing directories across regions, identifying gaps & enriching where appropriate. Using your analytical & coding abilities in conjunction with emerging technologies to improve Bridebooks data management processes. Collaborating with external 3rd parties on data acquisition projects. Effectively communicating findings & outcomes to internal stakeholders. More ❯

II Location: King Cross Onsite 3 days per week Length: ASAP - 31st December 2025 (Possibility of an extension) Rate: £44.23 Hours: 9am-6pm Job description: Looking for a data engineer/software engineer that would support data onboarding and filtering effort in a project on LLM agents for research. The engineer will onboard data … goal is to proactively mitigate potential risks associated with these datasets. Example tasks: Preprocessing: converting original datasets into a format that can be consumed by filtering pipelines. Filtering: Data cleaning, improvement and running filtering using Meta pipelines. Post-processing: consuming filtering results to filter videos/images in the original datasets, repackaging, and re-ingestion. Technical skills: Experience … effective communication skills to collaborate with stakeholders and team members Software engineering skills: Python, data pipelines. Top 3 must have hard skills: Data experience Python pipeline experience Data sets mitigation and filtering experience Typical day in the role: Software engineering doing data mitigation and filtering Low administration A lot of research More ❯

II Location: King Cross Onsite 3 days per week Length: ASAP - 31st December 2025 (Possibility of an extension) Rate: £44.23 Hours: 9am-6pm Job description: Looking for a data engineer/software engineer that would support data onboarding and filtering effort in a project on LLM agents for research. The engineer will onboard data … goal is to proactively mitigate potential risks associated with these datasets. Example tasks: Preprocessing: converting original datasets into a format that can be consumed by filtering pipelines. Filtering: Data cleaning, improvement and running filtering using Meta pipelines. Post-processing: consuming filtering results to filter videos/images in the original datasets, repackaging, and re-ingestion. Technical skills: Experience … effective communication skills to collaborate with stakeholders and team members Software engineering skills: Python, data pipelines. Top 3 must have hard skills: Data experience Python pipeline experience Data sets mitigation and filtering experience Typical day in the role: Software engineering doing data mitigation and filtering Low administration A lot of research More ❯

predictive modeling, and deploying training and inference pipelines on distributed systems such as Hadoop. The ideal candidate will design, implement, and optimize machine learning solutions for large-scale data processing and predictive analytics. London Long Term Contract Rate - 550-600 pd Hybrid - Max Three Days in the office Responsibilities: Develop and implement machine learning models using Spark ML … analytics. Design and optimize training and inference pipelines for distributed systems (e.g., Hadoop). Process and analyze large-scale datasets to extract meaningful insights and features. Collaborate with data engineers to ensure seamless integration of ML workflows with data pipelines. Evaluate model performance and fine-tune hyperparameters to improve accuracy and efficiency. Implement scalable solutions for … in Apache Spark and Spark MLlib for machine learning tasks. Strong understanding of predictive modeling techniques (e.g., regression, classification, clustering). Experience with distributed systems like Hadoop for data storage and processing. Proficiency in Python, Scala, or Java for ML development. Familiarity with data preprocessing techniques and feature engineering. Knowledge of model evaluation metrics and techniques. More ❯

predictive modeling, and deploying training and inference pipelines on distributed systems such as Hadoop. The ideal candidate will design, implement, and optimize machine learning solutions for large-scale data processing and predictive analytics. London Long Term Contract Rate - 550-600 pd Hybrid - Max Three Days in the office Responsibilities: Develop and implement machine learning models using Spark ML … analytics. Design and optimize training and inference pipelines for distributed systems (e.g., Hadoop). Process and analyze large-scale datasets to extract meaningful insights and features. Collaborate with data engineers to ensure seamless integration of ML workflows with data pipelines. Evaluate model performance and fine-tune hyperparameters to improve accuracy and efficiency. Implement scalable solutions for … in Apache Spark and Spark MLlib for machine learning tasks. Strong understanding of predictive modeling techniques (e.g., regression, classification, clustering). Experience with distributed systems like Hadoop for data storage and processing. Proficiency in Python, Scala, or Java for ML development. Familiarity with data preprocessing techniques and feature engineering. Knowledge of model evaluation metrics and techniques. More ❯

Prompt Engineer (AI & Data) – Junior to ExperiencedRemote work - United Kingdom Competitive day rate AI | LLMs | RAG | Healthcare Tech | Data Engineering Tech for Good | Real-World Impact | Ethical AI We're Hiring: Full Stack Developer for Generative AI ApplicationsAre you a seasoned developer excited about the future of AI? We're looking for a Full Stack Developer … ideas into intelligent, scalable solutions.?? What You’ll Be Doing Designing, testing, and refining prompts for LLMs (OpenAI, Claude, etc.) Building prompt libraries and evaluation frameworks Structuring unstructured data (PDFs, notes, forms) into usable formats Working with RAG pipelines and vector databases (FAISS, Pinecone, etc.) Embedding LLMs into user-facing healthcare tools (e.g., AI assistants, in-context help … and clinical teams to ship real features What You’ll Bring Experience with LLMs and prompt engineering (OpenAI, Anthropic, etc.) Familiarity with structured (SQL, JSON, CSV) and unstructured data Exposure to vector stores and retrieval-augmented generation (RAG) Strong Python skills and comfort working with APIs and data pipelines Bonus: experience in healthcare, accessibility, multilingual interfaces More ❯

Prompt Engineer (AI & Data) - Junior to Experienced Remote work - United Kingdom Competitive day rate AI | LLMs | RAG | Healthcare Tech | Data Engineering Tech for Good | Real-World Impact | Ethical AI We're Hiring: Full Stack Developer for Generative AI ApplicationsAre you a seasoned developer excited about the future of AI? We're looking for a Full Stack … ideas into intelligent, scalable solutions. What You'll Be Doing Designing, testing, and refining prompts for LLMs (OpenAI, Claude, etc.) Building prompt libraries and evaluation frameworks Structuring unstructured data (PDFs, notes, forms) into usable formats Working with RAG pipelines and vector databases (FAISS, Pinecone, etc.) Embedding LLMs into user-facing healthcare tools (eg, AI assistants, in-context help … and clinical teams to ship real features What You'll Bring Experience with LLMs and prompt engineering (OpenAI, Anthropic, etc.) Familiarity with structured (SQL, JSON, CSV) and unstructured data Exposure to vector stores and retrieval-augmented generation (RAG) Strong Python skills and comfort working with APIs and data pipelines Bonus: experience in healthcare, accessibility, multilingual interfaces More ❯

Role: Technical Product Owner Industry: Sports Data Salary: Up to £80,000 Location : London/Hybrid Are you a talented Product Owner with a good understanding of data engineering concepts? Are you interested in progressing to the role of Product Manager over time? Are you excited by Sports/Sports data and taking ownership … of a brand-new team? If so, this could be the perfect next role for you! This global leader in real-time sports data delivery is used by some of the worlds largest betting operators. Having recently hired a new Chief Product Officer, the Product team is only a few months old and this role will join a … newly formed data engineering/analytics team. What are they looking for: 2-3 years as a Product Owner/Product Manager Good understanding of data engineering concepts and data pipelines Familiarity with data analytics practices, modern BI tools, and reporting workflows Experience working in agile environments with cross functional teams Previous More ❯

Role: Technical Product Owner Industry: Sports Data Salary: Up to £80,000 Location : London/Hybrid Are you a talented Product Owner with a good understanding of data engineering concepts? Are you interested in progressing to the role of Product Manager over time? Are you excited by Sports/Sports data and taking ownership … of a brand-new team? If so, this could be the perfect next role for you! This global leader in real-time sports data delivery is used by some of the worlds largest betting operators. Having recently hired a new Chief Product Officer, the Product team is only a few months old and this role will join a … newly formed data engineering/analytics team. What are they looking for: 2-3 years as a Product Owner/Product Manager Good understanding of data engineering concepts and data pipelines Familiarity with data analytics practices, modern BI tools, and reporting workflows Experience working in agile environments with cross functional teams Previous More ❯