226 to 250 of 423 Data Ingestion Jobs in the UK

apply: Complete the online applications form using this link: https://forms.office.com/e/FxFGZgxmXy Role Summary The Football Department at Leeds United is working to leverage data to enhance decision making from analysis and recruitment to performance and medicine. We are looking for an individual to build robust pipelines to create a data infrastructure ready … for data science modelling and to support our football platform. Role Responsibilities Data Pipelines & Infrastructure: working with our Football Data Platform Lead, you will maintain and build data pipelines that serve our models, tools and central platform. Data Ingestion: Further develop our central data storage and integrate new data sources Data Standardisation: Leverage SQL to create a standardised layer across our various data types to allow for efficient and scalable data science and analysis. Data Synchronisation: you will enhance integrations between event and tracking datasets Metric Development: you will develop player and team metrics from our event-tracking models Other Responsibilities To take responsibilities for personal performance More ❯

Social network you want to login/join with: Data Software Engineer – London-based hedge fund, London col-narrow-left Client: Oxford Knight Location: London, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 883e105d196b Job Views: 4 Posted: 29.06.2025 Expiry Date: 13.08.2025 col-wide Job Description: Location: London, UK A top … tier global trading firm is seeking a skilled Data Software Engineer to join its London-based Global Data Engineering team. In this role, you’ll architect and implement a high-performance framework for modelling financial instruments, working with a complex ecosystem of financial and alternative datasets to drive strategic decision-making in low- to high-frequency trading. Role … Overview As a key contributor to the data engineering team, you’ll tackle some of the most challenging problems at the intersection of financial data and technology, including: Designing and deploying a scalable, high-throughput data model to unify financial instrument identifiers across vendors, markets, and timeframes. Building and optimizing data pipelines for global data More ❯

Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham Client: CGI Location: Birmingham, United Kingdom Job Category: Other EU work permit required: Yes Job Reference: 68452019cc93 Job Views: 4 Posted: 29.06.2025 Expiry Date: 13.08.2025 Job Description: Position Description: Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham We … re growing rapidly and are looking for a Solution Architect to join our team and help us develop and deploy enterprise-grade platforms that enable data-driven solutions. You will be responsible for designing, implementing, and overseeing data-driven solutions that support business objectives. This role bridges the gap between business needs and technical implementation, ensuring that solutions … inclusive place where you’re empowered to chart your own path, then we’d love to meet you. Your future duties and responsibilities: Develop end-to-end architecture for data science and AI/ML solutions. Ensure integration with existing enterprise systems and data pipelines. Define best practices for data ingestion, processing, storage, and model deployment. More ❯

Base c. £140-155 k + bonus and LTIP (flexible for the right hire) 35 days leave │ 14 % pension │ full family healthcare Purpose Establish and scale a single enterprise data backbone for a global retail-investing and pensions platform (~£400 bn AUA), enabling regulatory-grade lineage, real-time analytics, and API-driven product innovation. You will be tasked with … the front, middle and back-office solution, defining the interactions, integration and data model transformation. Candidate with no Investment or Asset Management experience are not being considered for this role! 12-Month Success Metrics Publish an enterprise-wide canonical data model covering custody, wrappers, trading, and digital touchpoints. Stand-up policy-as-code controls delivering automated Consumer Duty … CASS MI. Migrate 60 % of legacy ETL into an event-stream/Snowflake lakehouse pattern, cutting report latency to Embed data-product operating model across UK & India hubs; uplift data-literacy score by 25 %. Architecture & Design Authority : Define reference architectures, patterns, and guardrails for data ingestion, storage, lineage, and access. Governance & Quality : Chair Data More ❯

The BBC's digital products play a key role in our mission to inform, educate and entertain the audience. We are looking for an Engineering Manager to join the Data Engineering team. The BBC offers an inclusive workplace where the principles of fairness, respect, equality, dignity, and autonomy are promoted and are part of our everyday goals and behaviour. … based questions. Interviews expected to begin the week 7th July 2025. · 2nd stage - Technical Interview Job Description As the Engineering Manager for the Insights Tooling team within BBC's Data Platform, you will lead up to 50 engineers, including Software Engineering Team Leads and Principal Engineers, to transform siloed analytics solutions into a unified, API-driven platform on AWS. … Your work will empower teams across the BBC-from journalists to executives-to make data-informed decisions by delivering scalable, user-friendly data products. You will collaborate with Engineering, Architecture, Product, and UX leaders to drive technical excellence while fostering a culture of innovation, inclusivity, and best practices in data engineering. Main Responsibilities Platform Leadership: Architect and More ❯

Data Analyst, Data Engineer, SQL, Informatica, ETL, Data Ingestion, Data Integration, Data Analytics, Data Science There is a new role with an industry-leading Data Analytics and Data Science company based in London, looking for a Data Analyst/Data Engineer to join their business and build a career … within the business. Established six years ago, the company have grown rapidly and are now recognized as one of the industry leaders in the Data Analytics/Data Science space. They provide complex data solutions for blue chip and enterprise grade clients using cutting-edge data and cloud technology. They are looking for a Data Analyst/Data Engineer to work across all areas of the business, defining data requirements across business units, analysing the relationships of data and technical data feed requirements aswell as working in proximity to architects on the Data Warehouse design, build and deployment This is a junior role, and as such will have a More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across … the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across … the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). Implement data transformation logic using Spark, ensuring data is cleaned, transformed, and enriched according to business requirements. Leverage Databricks features such as Delta Lake to manage and track changes to data, enabling better versioning and performance for incremental data loads. Data Publishing & Integration: Publish clean, transformed data to Azure Data Lake or other cloud storage solutions for consumption by analytics and reporting More ❯

are known for being a pioneer in Cyber insurance are looking for a Python Developer to join their growing team. This is a unique role with exposure to the data space in a high-functioning team. This role sits at the heart of a cyber data innovation team, focused on building and evolving a proprietary platform that powers … risk intelligence and customer protection. You'll work across large-scale data ingestion, performance APIs, Real Time event handling, and quality-first design - all aimed at delivering actionable insights that matter. Responsibilities: Designing and developing robust data ingestion pipelines and high-performance APIs Working with large, fast-moving datasets to improve product capability and data quality Supporting infrastructure (IaC) and CI/CD processes in Azure and AWS Collaborating across teams to model data for both operational and analytical use cases Leading on data quality metrics, testing automation, and clean documentation Mentoring and contributing to a modern, pairing-friendly engineering culture Technology Stack: Python, SQL (Postgres, SQL Server), Linux/WSL Azure More ❯

Quantitative Developer - Risk Technology Millennium is a top tier global hedge fund with a strong commitment to technology and data science. We are looking for a Quantitative Developer to join our Risk Technology team in London. The developer will use Python, AWS and data manipulation libraries to provide risk managers with data-driven insights on our fund … Work closely with quants, risk managers and other technologists in New York, Tel Aviv and Singapore to develop risk analytics solutions for our Fixed-Income business. Develop micro-services, data ingestion pipelines and APIs to feed tools and dashboards that monitor Millennium’s market risks. Analyse data with pandas/polars to present data in the … understanding of financial instruments and services. Strong analytical skills & problem-solving capabilities. Ability to work independently in a fast-paced environment. Minimum 2 years’ experience working with Python, and data analysis libraries (Pandas/Polars/Numpy). Experience with REST APIs and cloud services. Relational SQL database development experience. Unix/Linux command-line experience. Detail oriented, organised More ❯

Machine Learning Engineer Location: York or Manchester This position is for an experienced Machine Learning Engineer to join a newly established data science team. The primary focus is on building and maintaining the infrastructure to support the full data science lifecycle from data ingestion to model deployment, monitoring, and upgrades within Azure and Databricks environments. The … engineer will work closely with data scientists in a collaborative, cross-functional setting, helping transition models from research into production. Key Responsibilities: Own and develop deployment frameworks for data science services. Ownership of the deployment framework for all data science services. You will have oversight of how data will flow into the data science life … cycle from the wider business data warehouse. Oversight of the automation of the data science life cycle (dataset build, training, evaluation, deployment, monitoring) when we move to production. Automate the data science pipeline (data prep to deployment). Collaborate with cross-functional teams to ensure smooth productionisation of models. Write clean, production-ready Python code. Apply More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building and developing the tooling … and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work from anywhere for … and their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own analyses More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building and developing the tooling … and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work from anywhere for … and their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own analyses More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building and developing the tooling … and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work from anywhere for … and their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own analyses More ❯

Developer to join a world-leading investment bank’s Front Office Quantitative Technology team in London . You will design, build, and optimise low-latency, high-performance time-series data systems used for real-time analytics , trading , and decision-making across global markets. This is a critical hire for an elite team driving alpha-generation tools and cutting-edge … data platforms using KDB+/q . 🧠 Key Responsibilities Develop and maintain scalable KDB+/q solutions for real-time market data ingestion, processing, and analytics. Collaborate directly with quant traders , quants , and front office technologists to build mission-critical trading systems. Optimise existing KDB+ databases for performance, latency, and storage efficiency . Design and implement solutions … for tick data capture , data normalisation , and time-series analysis . Contribute to architectural decisions around data pipelines , streaming platforms , and KX integration . Ensure high availability and reliability of market data infrastructure in high-pressure, low-latency environments . ✅ Required Skills & Experience 3+ years of hands-on commercial experience with KDB+/q in a More ❯

Developer to join a world-leading investment bank’s Front Office Quantitative Technology team in London . You will design, build, and optimise low-latency, high-performance time-series data systems used for real-time analytics , trading , and decision-making across global markets. This is a critical hire for an elite team driving alpha-generation tools and cutting-edge … data platforms using KDB+/q . 🧠 Key Responsibilities Develop and maintain scalable KDB+/q solutions for real-time market data ingestion, processing, and analytics. Collaborate directly with quant traders , quants , and front office technologists to build mission-critical trading systems. Optimise existing KDB+ databases for performance, latency, and storage efficiency . Design and implement solutions … for tick data capture , data normalisation , and time-series analysis . Contribute to architectural decisions around data pipelines , streaming platforms , and KX integration . Ensure high availability and reliability of market data infrastructure in high-pressure, low-latency environments . ✅ Required Skills & Experience 3+ years of hands-on commercial experience with KDB+/q in a More ❯

a dynamic self-starter to join their innovative team in the heart of London. If you thrive in a fast-paced environment and want to contribute to cutting-edge data science applications, this is the perfect opportunity for you! About Client: Our client is a leading global payments technology company that enables businesses of all sizes to accept payments … geographies. They handle billions of transactions annually, offering secure, scalable solutions that support innovation in the financial ecosystem. With deep industry expertise, they empower merchants to grow through advanced data insights and reliable infrastructure. What You'll Do : Design, develop, and deploy machine learning models that solve real-world problems. Collaborate with cross-functional teams to improve production systems … and ensure seamless integration of ML models. Drive the ML life cycle from data ingestion to model deployment and monitoring. Implement CI/CD pipelines and leverage DevOps practices to enhance operational efficiency. What You Need : A relevant BSc/MSc degree in a related field with strong industry experience. Proven expertise in ML engineering and MLOps, with More ❯

Hypercube Consulting is a rapidly growing data and AI consultancy dedicated to transforming the energy sector through cutting-edge technology. Specialising in advanced AI systems, including Agentic AI workflows and large language models (LLMs), we help clients unlock profound value from their data assets. Join our expert team in shaping the future of AI-driven energy solutions. To … blog here: We are looking for a Senior AI Engineer with experience in Agentic AI and LLM technologies to design and develop impactful AI solutions. You'll work alongside data engineers, data scientists, and cloud specialists, directly contributing to client success. In this role, you will: Engage with client challenges, developing practical and innovative Agentic AI and LLM … growing AI expertise. Key responsibilities Technical contribution Develop and deploy reliable AI and LLM solutions, collaborating with senior team members. Contribute to the implementation and maintenance of AI pipelines (data ingestion, model training, deployment, and monitoring). Work within multidisciplinary teams to deliver client-focused solutions. Effectively communicate AI concepts and methodologies to peers and clients. Continuous learning More ❯

investment adviser. Overview: We are looking for a Risk Analytics Manager to join our Risk team. This role is critical in ensuring the integrity of both input and output data across our in-house and third-party risk systems. The ideal candidate will have a strong background in risk management, combined with hands-on experience in software development and … data engineering. Responsibilities: Develop, validate, and maintain risk reporting tools and dashboards. Design and enhance risk metrics and reports to support trading decisions and risk oversight. Collaborate with stakeholders across trading, technology, and risk to understand evolving requirements and continuously improve the risk analytics and reporting framework. Oversee the quality and consistency of data used in internal and … external risk systems and processes. Troubleshoot and improve data ingestion, transformation, and analysis pipelines. Keep track of and communicate the key assumptions and methods used in the analytics. Requirements: 5+ years of experience in a risk analytics or similar role within a financial institution. Strong programming and scripting skills in Python and SQL. Experience in Django and JavaScript More ❯

Social network you want to login/join with: We’re seeking a proactive Trading Developer to architect and enhance the data and process backbone of our trading environment. You’ll design and implement backend APIs, real-time data pipelines, and monitoring frameworks—ensuring reliable, low-latency access to market and operational data. While your core focus is … tasks and responsibilities API & Service Development Design, develop, and maintain robust internal RESTful and event-driven APIs. Establish best practices for versioning, documentation, security, and monitoring. Build and manage data streaming pipelines using frameworks such as Spark, Kafka, or equivalents. Ensure high-availability and low-latency delivery of market and industry data. Deploy and operate services on Azure using … Functions, App Services, AKS (Kubernetes), and related services. Data Ingestion & Management Ingest diverse data sources (exchange feeds, third-party APIs, FIX/WebSocket interfaces). Implement ETL processes and data models to drive downstream analytics and trading strategies. Uptime & Monitoring Implement health checks, alerting, and observability (metrics, logs, tracing) to maintain 24/7 uptime. Rapidly More ❯

Bloomberg runs on data. Our products are fuelled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock - from around the world. In Data, we are responsible for delivering this data, news and analytics through innovative technology - quickly and accurately. We apply problem-solving skills to identify innovative … solutions to enhance our systems, products and processes - all while providing platinum customer support to our clients. The Role: The Content Acquisition team is an integral part of the Data department. We lead the governance, cost, and quality of the data we acquire and we collaborate with the wider company to develop our data acquisition strategies ensuring … that they trust us with their valuable content Establish, maintain and improve relationships with Content Partners to develop and implement technologies/workflows and facilitate efficient onboarding of new data sets Collaborate with our team of motivated account managers, technical specialists, relationship managers and product managers to better understand our clients' data needs and balance the best of More ❯

that refine content moderation processes, foster continuous improvement, and ensure our moderation efforts align with broader business objectives. What You Will Do: Conduct in-depth analysis of UGC moderation data to identify trends, patterns, and optimization opportunities, translating complex insights into actionable recommendations. Collaborate with cross-functional teams like product, engineering andvendor management as well as with external industry … partners to stay current on emerging moderation practices and implement data-driven solutions. Champion a data-driven culture by fostering collaboration, knowledge sharing, and best practices that elevate moderation quality, efficiency, and scalability. Develop and implement new methodologies to measure the impact of moderation decisions, using advanced analytics and big data techniques to inform strategic direction. Generate … and maintain reports, dashboards, and data pipelines by consolidating multiple data sources, programming algorithms, and automating processes to produce actionable insights. Work on diverse-scope problems where analysis requires evaluating numerous factors, demonstrating sound judgment in selecting analytical methods and techniques. Set and track strategic KPIs for the content moderation team, ensuring alignment with broader business objectives and More ❯

well as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … nurture engineering talent, and contribute to the growth of our business Responsibilities Guide a team of engineers in developing applications that empower our clients to optimize marketing campaigns through data-driven insights and automated actions, with a specific focus on leveraging LLMs and AI Own the technical roadmap for your team, aligning it with the overall product strategy and … LLMs and AI for various marketing applications, including: Automated content generation, optimization, and personalization Predictive analytics for campaign performance and optimization Customer journey orchestration and personalized messaging Real-time data analysis and actionable insights generation Drive the technical direction of the team, ensuring solutions are built with a focus on modularity, scalability, and maintainability, specifically in the context of More ❯

length of service Sick Pay – Increasing with length of service The Role: We are looking for an experienced SQL Database Administrator. Key Responsibilities: Support and maintain a large-scale data warehouse environment, handling high volumes of structured data. Manage and process incoming data streams from external sources (e.g. cameras and monitoring systems). Develop and support server-side … data processing workflows to ensure timely and accurate data ingestion. Collaborate with 2nd and 3rd line support teams, providing expertise on complex data-related issues. Maintain and optimise the central database infrastructure, ensuring performance, reliability, and scalability. Work closely with stakeholders to deliver custom reports and analytics. Ensure data integrity, transformation, and storage aligns with business … and regulatory requirements. Participate in long-standing, enterprise-level projects requiring consistent support and system knowledge. Troubleshoot data warehouse and integration issues and implement enhancements for improved performance and reliability. Contribute to the design, development, and maintenance of ETL pipelines and reporting systems. Requirements: Microsoft SQL Server Database deployed on-premise and in the cloud. Always On replication to More ❯

Social network you want to login/join with: Senior Manager - Data & AI Strategy - Data & AI Operating Model, Manchester col-narrow-left Client: Location: Manchester, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 4179404d0c43 Job Views: 5 Posted: 25.06.2025 Expiry Date: 09.08.2025 col-wide Job Description: At Capgemini Invent, we believe … tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role You will be joining our rapidly growing Data & AI Strategy team within Capgemini Invent, where we are at the forefront of designing and building winning strategies and operating models to transform the way in which organisations across … all industries and sectors leverage data & AI. We’re building a successful team of experts across the data & AI lifecycle, and we’re looking for talented people to strengthen our position as consulting leaders in data & AI strategy & operating model. Our Managers and Senior Managers marry best-in-class delivery with thought leadership to become trusted advisors More ❯