126 to 150 of 207 Data Ingestion Jobs in the UK

scale our fleet intelligence platform. We're a seed-stage company (raised $4.3M in August 2024) building the intelligence layer for commercial fleets. Fleet managers lose billions to fragmented data and manual work. We unify their data, quantify savings opportunities, and automate decisions with AI. This is a new leadership role created to accelerate product as we scale. … to-market. You'll establish product discipline as we grow the engineering team. What you'll do Own the product roadmap and prioritisation Translate vision into clear product requirements (data ingestion, harmonisation, simulation, AI recommendations) Define success metrics and quality bars Protect focus through evidence-based prioritisation Get in front of customers to understand their workflows and pain … for scale. Commercial instincts: You understand where value lies for customers and can accelerate revenue by bringing product clarity to sales conversations. Technical credibility: Comfortable debating engineers about feasibility, data architecture, and technical tradeoffs. You don't code but you're technical enough to earn respect and make smart decisions about a data platform. Strong product judgment: Opinionated More ❯

scale our fleet intelligence platform. We're a seed-stage company (raised $4.3M in August 2024) building the intelligence layer for commercial fleets. Fleet managers lose billions to fragmented data and manual work. We unify their data, quantify savings opportunities, and automate decisions with AI. This is a new leadership role created to accelerate product as we scale. … to-market. You'll establish product discipline as we grow the engineering team. What you'll do Own the product roadmap and prioritisation Translate vision into clear product requirements (data ingestion, harmonisation, simulation, AI recommendations) Define success metrics and quality bars Protect focus through evidence-based prioritisation Get in front of customers to understand their workflows and pain … for scale. Commercial instincts: You understand where value lies for customers and can accelerate revenue by bringing product clarity to sales conversations. Technical credibility: Comfortable debating engineers about feasibility, data architecture, and technical tradeoffs. You don't code but you're technical enough to earn respect and make smart decisions about a data platform. Strong product judgment: Opinionated More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Engineer/Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus on P&L reporting and operational decision-making. … As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven decision-making across the organization. Responsibilities Design & implement robust data pipelines and ETL processes, ensuring high standards in data modeling, documentation, and testing. Develop and optimize SQL queries for data extraction, aggregation, and reporting. Collaborate with key business teams (Risk, Portfolio Research, Compliance) to build efficient and scalable reporting solutions. Support critical production processes, including More ❯

Our client a high profile deep-tech organisation, urgently require an experienced AI/Data Developer to undertake a contract assignment. In order to be successful, you will have the following experience: Extensive AI & Data Development background Experiences with Python (including data libraries such as Pandas, NumPy, and PySpark) and Apache Spark (PySpark preferred) Strong experience with … data management and processing pipelines Algorithm development and knowledge of graphs will be beneficial SC Clearance is essential Within this role, you will be responsible for: Supporting the development and delivery of AI solution to a Government customer Design, develop, and maintain data processing pipelines using Apache Spark Implement ETL/ELT workflows to extract, transform and load … large-scale datasets efficiently Develop and optimize Python-based applications for data ingestion Collaborate on development of machine learning models Ensure data quality, integrity, and performance across distributed environments Contribute to the design of data architectures, storage strategies, and processing frameworks Work with cloud data platforms (e.g., AWS, Azure, or GCP) to deploy scalable solutions More ❯

Data Scientist - Finance/Investments London – 5 days in office Up to £120,000 + Strong Bonus Potential About the Role We are working with a leading hedge fund and alternative investment firm, specialising in global macro strategies with a particular emphasis on inflation modelling and the wider economic landscape. They are looking for a Data Scientist to … cutting edge of time-series forecasting within a fast-paced and intellectually rigorous environment. Key Responsibilities Building machine learning models, with a focus on time-series forecasting. Collaborating with data scientists and researchers to productionise models. Managing both cloud-based and on-premise infrastructure. Ensuring reliability and scalability of ML systems in production. What We’re Looking For 3+ … years of experience in Data Science. Strong proficiency in Python and experience with ML libraries/frameworks (Pandas, NumPy, Scikit-learn, TensorFlow, PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc. More ❯

Data Scientist - Finance/Investments London – 5 days in office Up to £120,000 + Strong Bonus Potential About the Role We are working with a leading hedge fund and alternative investment firm, specialising in global macro strategies with a particular emphasis on inflation modelling and the wider economic landscape. They are looking for a Data Scientist to … cutting edge of time-series forecasting within a fast-paced and intellectually rigorous environment. Key Responsibilities Building machine learning models, with a focus on time-series forecasting. Collaborating with data scientists and researchers to productionise models. Managing both cloud-based and on-premise infrastructure. Ensuring reliability and scalability of ML systems in production. What We’re Looking For 3+ … years of experience in Data Science. Strong proficiency in Python and experience with ML libraries/frameworks (Pandas, NumPy, Scikit-learn, TensorFlow, PyTorch). Hands-on experience implementing end-to-end ML pipelines (data ingestion, training, validation, serving). Familiarity with ML workflow orchestration tools (Airflow, Prefect, Kubeflow) and feature/data platforms (Databricks, Tecton, etc. More ❯

Python Engineer – Data Pipelines (UK Remote) We're looking for an experienced Python Engineer to join a newly formed team working alongside a client's Product Owner, Technical Lead, and development team. You'll design, build, and optimize scalable, cloud-based data pipelines and ensure top performance in production environments. Key Responsibilities: Develop and maintain data ingestion … pipelines using Python and tools like Airflow , Dagster , or Prefect Design asynchronous workflows and event-driven architectures with Kafka , RabbitMQ , or similar Optimize performance and reliability of large-scale data systems Automate and monitor data workflows for scalability and observability Collaborate with business and product teams to deliver robust, compliant data solutions Requirements: 6+ years of Python … development experience focused on data pipelines Expertise with SQL/NoSQL , Airflow/Dagster/Prefect , and message brokers Hands-on experience with Docker , Kubernetes , and AWS/GCP/Azure Strong knowledge of OOP and Agile practices Excellent communication and problem-solving skills Experience in real estate or mortgage data (preferred) Familiarity with ML integration and data More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will work … closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather requirements … and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will work … closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather requirements … and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will work … closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather requirements … and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will work … closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather requirements … and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will work … closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather requirements … and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

design, implement, and scale the infrastructure that supports high-performance machine learning and AI-driven research workflows . You will play a critical role in bridging the gap between data science, bioinformatics, and engineering — ensuring seamless, secure, and reproducible deployment of ML models in production and research environments. You’ll collaborate closely with AI Scientists, Data Engineers, and … Terraform, Kubernetes, Docker , and CI/CD toolchains (GitHub Actions, Jenkins, Argo, etc.). Manage scalable cloud-based compute environments (Oracle Cloud, AWS, or GCP) for AI workloads and data processing. Build and maintain feature stores, model registries, and versioning systems to ensure traceability and reproducibility. Implement data ingestion and pre-processing pipelines to support ML and … infrastructure optimization. Monitor model and system performance, implement drift detection, and refine automated retraining pipelines. Contribute to the development of a modular, reusable ML platform architecture supporting multi-modal data (genomic, clinical, imaging, etc.). Essential Skills and Experience Proven experience as an MLOps Engineer, Platform Engineer, or DevOps Engineer supporting ML or data science teams. Strong hands More ❯

design, implement, and scale the infrastructure that supports high-performance machine learning and AI-driven research workflows . You will play a critical role in bridging the gap between data science, bioinformatics, and engineering — ensuring seamless, secure, and reproducible deployment of ML models in production and research environments. You’ll collaborate closely with AI Scientists, Data Engineers, and … Terraform, Kubernetes, Docker , and CI/CD toolchains (GitHub Actions, Jenkins, Argo, etc.). Manage scalable cloud-based compute environments (Oracle Cloud, AWS, or GCP) for AI workloads and data processing. Build and maintain feature stores, model registries, and versioning systems to ensure traceability and reproducibility. Implement data ingestion and pre-processing pipelines to support ML and … infrastructure optimization. Monitor model and system performance, implement drift detection, and refine automated retraining pipelines. Contribute to the development of a modular, reusable ML platform architecture supporting multi-modal data (genomic, clinical, imaging, etc.). Essential Skills and Experience Proven experience as an MLOps Engineer, Platform Engineer, or DevOps Engineer supporting ML or data science teams. Strong hands More ❯

Remote) - United Kingdom ***This is a fully remote role, but candidates must be based in UK and have the right to work without sponsorship.*** Join Our Journey in Transforming Data into Insights At CluedIn, we're reshaping the future of data management with an Azure-native, graph-based Modern Master Data Management (MDM) platform that simplifies and … accelerates how businesses manage their data—making it faster, smarter, and more accessible. Trusted by global industry leaders, our technology enables organisations to unlock the full value of their data and drive meaningful transformation. As Microsoft's preferred MDM partner and the first solution integrated with Azure OpenAI, we're setting new standards for innovation in this space. … Backed by five-star reviews on Gartner Peer Insights and seamless integration with Microsoft's data services, CluedIn delivers powerful, scalable solutions built for the enterprise. Our team's expertise, passion, and bold ideas drive our innovation. Together, we're reimagining what's possible in data management. About CluedIn CluedIn is more than just a customer-focused organisation More ❯

Overview: Tasks: Lead software development initiatives, turning customer needs into innovative data products. Company: Join a leader in analytics for top financial institutions worldwide. Benefits: Enjoy flexible hybrid work, competitive salary, 25 days leave, and private medical cover. Why this job: Be part of a transformative team shaping the future of financial software with real impact. Qualifications: Experience in … B2B product management and data architecture is essential; tech-savvy candidates preferred. Other info: Collaborate with diverse teams and engage in exciting projects across technology and data science. Salary range: £60-90,000 base This firm builds analytics and business intelligence products that are integral to how the world's largest corporate and investment banks, asset managers and … that delights them. As a Product Manager you will be the owner of multiple software development initiatives. Working closely with the customer and the technology, business, relationship management, operations, data science and governance teams you will: Discover the underlying unmet needs from the customers; Define and agree the outcomes and acceptance criteria; Orchestrate the design of the prototype; Help More ❯

Customer Solutions Consultant – SaaS/Data/Onboarding – London (Hybrid, 3 days onsite) Are you the kind of person who gets a buzz from turning complexity into clarity – the one who joins a messy customer onboarding process and just makes it work ? This is a chance to join a small but fast-growing tech-for-good startup that’s … building smart, data-driven products making a real-world impact. They’ve scaled rapidly over the past year and are now looking for someone to take full ownership of customer onboarding and implementation - making sure new clients see value quickly and stay long term. They’re hiring a Customer Solutions Consultant - part technical problem-solver, part customer champion – to … this is worth a look. What you’ll be doing Owning the full customer onboarding and implementation process Working directly with client technical teams to integrate and activate their data Troubleshooting data ingestion, compatibility, and configuration issues Tracking progress and maintaining close communication through the first month’s post-sale Joining late-stage sales calls to clarify More ❯

Data Software Engineer/Developer (Python Databricks FastAPI) London to £90k Are you a data centric Software Engineer with strong Python and SQL skills? You could be progressing your career in a senior, hands-on role at a fast growing, global Insurance Underwriting technology provider that focusses on developing a complex SaaS calculation platform for rapidly growing Cybersecurity … insurance markets. As a Data Software Engineer you will design and develop data centric backend services for the core platform with a focus on Python coding and building FastAPIs within an Azure environment with Databricks. You'll participate in the design and implementation of advanced mechanisms for data ingestion, transformation, mass parallel orchestration of network IO … and will model data for a variety of purposes. You'll also collaborate with the Infrastructure team to maintain Infrastructure as Code and develop new features on the engineering platform. Location/WFH: There's a hybrid work from home model with three days a week in the high spec London, City office with rooftop bar. About you: You More ❯

Senior Data & ML Engineer? Cardiff/London? £90,000 - £100,000 DOE What You'll Do: Take the lead on building and scaling large-scale web scraping and data ingestion systems that form the core of an AI-driven product suite used by major enterprise clients. From crawling hundreds of dynamic sources to powering downstream LLM features … your work will be the foundation of everything the platform delivers. You'll own projects end-to-end - designing data pipelines, integrating with vector databases, and deploying intelligent features using Retrieval-Augmented Generation (RAG) and fine-tuned LLMs. What You'll Bring: Deep hands-on experience with web scraping tools and frameworks (Scrapy, Playwright, Puppeteer, etc.) 5+ years in … data engineering, ML engineering, or similar technical roles Strong Python skills and comfort working across complex ingestion workflows Experience managing NoSQL and vector databases at scale (MongoDB, Weaviate, Pinecone, etc.) Solid understanding of modern data pipeline tools (Airflow, Prefect, Dagster) Practical experience with LLM development, embeddings, and RAG architectures Familiarity with distributed systems and cloud platforms (AWS More ❯

Senior Data & ML Engineer ?? Cardiff/London ?? £90,000 - £100,000 DOE What You'll Do: Take the lead on building and scaling large-scale web scraping and data ingestion systems that form the core of an AI-driven product suite used by major enterprise clients. From crawling hundreds of dynamic sources to powering downstream LLM features … your work will be the foundation of everything the platform delivers. You'll own projects end-to-end - designing data pipelines, integrating with vector databases, and deploying intelligent features using Retrieval-Augmented Generation (RAG) and fine-tuned LLMs. What You'll Bring: Deep hands-on experience with web scraping tools and frameworks (Scrapy, Playwright, Puppeteer, etc.) 5+ years in … data engineering, ML engineering, or similar technical roles Strong Python skills and comfort working across complex ingestion workflows Experience managing NoSQL and vector databases at scale (MongoDB, Weaviate, Pinecone, etc.) Solid understanding of modern data pipeline tools (Airflow, Prefect, Dagster) Practical experience with LLM development, embeddings, and RAG architectures Familiarity with distributed systems and cloud platforms (AWS More ❯

Senior Analytics Manager, Commercial to help drive advertising revenue growth at The Telegraph. In this pivotal role, you'll lead the analysis and optimisation of our advertising inventory, using data to uncover opportunities, guide decision-making, and shape commercial strategy. You'll partner with stakeholders across Finance, Technology, and Sales to model revenue initiatives, improve data quality, and … deliver clear, actionable insights that fuel performance and growth. This is a fantastic opportunity to make a real impact within a fast-paced, data-driven media organisation. Key Responsibilities Responsible for modelling revenue initiatives & opportunities and measuring their impact Identify opportunities for revenue growth and work with stakeholders to share findings Build and development of the right suite of … exec reports, dashboards and tools to provide clear performance understanding and gap analysis Partner with engineering to develop and implement new data ingestion pipelines; Clean and apply business logic to transform the raw data into polished, presentable data tables Work with the rest of the team to share ideas, concerns and opportunities. Partnering with tech team More ❯