176 to 200 of 314 Data Ingestion Jobs in the UK

process, driving much of the testing at all stages. Experience in trading systems architecture: Familiarity with Order Management Systems (OMS), exchange gateway connectivity, market data ingestion and processing, as well as high-throughput, low-latency systems. You take a pragmatic approach to developing clean solutions to complex problems. … Basic understanding of algorithms, data structures, databases and distributed systems is must. Compensation & perks Full-time salary based on experience and meaningful equity in an industry-leading company Role based in our London office, with a mandatory in-office presence four days per week Work from Anywhere Policy ...

Contract Type: 5-Month Contract About the Role: We are looking for a skilled SIEM Security Engineer to design, develop, and maintain our SIEM data ingestion pipelines. In this role, you will leverage Elasticsearch and Kafka to boost our threat detection, incident response, and overall security posture. … Responsibilities: Data Ingestion & Enrichment: Build and manage Elasticsearch/Kafka pipelines; integrate threat intelligence feeds. SIEM Development: Partner with SecOps to design SIEM solutions; optimize rules, alerts, and dashboards for precise threat detection. Performance Tuning: Write highly efficient Elasticsearch queries and proactively monitor SIEM infrastructure health. Security Engineering ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Your role Capgemini Engineering is looking for OSS Data Architect who will be the senior technical authority responsible for designing the end-to-end data extraction, connectivity, and ingestion architecture. You will … Management & Technical Leadership Security & Compliance Your profile Required Skills & Experience: Overall 12-15+ years’ experience with 8-10+ years of experience in data architecture, with a significant focus on data integration, ETL/ELT, and data warehousing in large enterprise environments. Proven experience designing ...

develop connectors enabling access to the database across cloud and on-prem environments. You will architect, implement, and maintain connectors and streaming/data ingestion APIs to improve performance and usability for customers. The role requires 5+ years of production-grade software experience, proficiency in Kotlin/Java ...

Citi Tech. In this role, you will be directly responsible for leading the technical design, development, and optimization of our regulatory reporting framework and data pipelines, with a strong focus on onboarding new regulations. This is an active engineering leadership position where you will guide a team of developers … write clean, production-grade code, design system components, and troubleshoot complex data processing issues. You will work closely within an Agile team, collaborating with business analysts and other engineers to translate regulatory requirements into reliable, scalable software solutions. Lead and Mentor: Guide and support a team of software engineers ...

with strong Neo4j and Azure expertise to support the development of enterprise knowledge graphs and graph-powered AI solutions. You will focus on graph data modelling, Cypher query development, retrieval optimisation and integrating graph databases with modern AI and cloud technologies. Key Responsibilities Develop and maintain graph data models, including nodes, relationships, schemas and data-quality rules. Build and optimise Cypher queries, multi-hop traversals and graph-based retrieval solutions. Implement property, full-text and vector indexing to improve query performance and retrieval accuracy. Transform structured and unstructured data into entities, relationships and knowledge graphs. ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Senior Regulatory Data Developer, you'll modernise complex reporting pipelines and build scalable cloud architectures that process high-volume data with pinpoint accuracy. Our Data Engineering department powers high-volume data platforms that support 24/7 global operations. Within this function, the Regulatory Data team builds and maintains batch and near real-time pipelines that transform complex operational data into precise reporting outputs. In this hands-on technical role, youll ...

initial 13-week contract . This role will suit a hands-on engineer with deep expertise in KDB+/q development , real-time data platforms, and Prime Brokerage post-trade risk and margining environments. Working within a high-performing engineering team, you'll be responsible for the development, optimisation … support and enhancement of business-critical applications and data platforms supporting front-office and risk functions. Contract Details Contract Length: 13 weeks Start Date: ASAP Rate: £545 per day Umbrella Engagement: Inside IR35 Location: London (30 Fenchurch Street) Working Model: Hybrid The Role You will play a key role ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description As a Senior Regulatory Data Developer, you'll modernise complex reporting pipelines and build scalable cloud architectures that process high-volume data with pinpoint accuracy. Our Data Engineering department powers high-volume data platforms that support 24/7 global operations. Within this function, the Regulatory Data team builds and maintains batch and near real-time pipelines that transform complex operational data into precise reporting outputs. In this hands-on technical role ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up — where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane — a greenfield platform that connects the firm's data mesh ...

UBDS Group seeks an experienced Senior Data Engineer to design, build and deliver scalable data platforms within AWS. You’ll mentor engineers, guide patterns, and collaborate with architects and security professionals to ensure secure, resilient data solutions for clients in regulated environments. You’ll lead data ingestion, transformation and governance efforts, leveraging S3/Glue/Lambda/Redshift and related AWS services, while applying CI/CD and IaC practices to deployments. #J-18808-Ljbffr ...

support means today. The role: This is an exciting opportunity to join a fast-growing, Private Equity backed business at a time when our Data and Analytics function is central to the next phase of growth. The team sits across every division, acquisition and product at Focus Group … analytics products from start to finish, lead projects that cut across operations, finance and every part of the group, and turn data into decisions the business can act on. You'll be a key voice in giving our executive leadership team the tools they need to make fast, accurate ...

Trayport is seeking a highly technical Business Intelligence Engineer to join our BI team in London. You will architect a robust data warehouse, automate data ingestion, and deliver user-friendly dashboards that surface actionable insights for stakeholders. You will collaborate across Data Engineering and BI Analysts … mentor teammates, and translate complex data concepts for executives. The ideal candidate combines deep SQL, Python, data warehousing expertise, and a passion for data-driven #J-18808-Ljbffr ...

more. We're looking for... We're looking for a Sustainability Insights Solution Manager to join E15 Insights and help turn complex sustainability data into meaningful business insight. You'll build data-driven sustainability tools and solutions that help Levy measure impact, inform decision making and put climate … making the planet better for future generations. Sustainability Insights Solution Manager - The Role As part of E15 Insights, you'll champion the development of data and insight solutions for Levy, with a particular focus on sustainability. You'll work across sports stadia, arenas, theatres and other venues, partnering with ...

GlobalData Healthcare operates an intelligence platform that empowers leaders to act decisively in a world of complexity and change. By uniting proprietary data, human expertise, and purpose-built AI into a single, connected platform, we help organizations see what’s coming, move faster, and lead with confidence. Our solutions … pharmaceutical market. It supports our consulting teams in tracking competitor drugs, clinical trials, regulatory decisions and market news for pharma clients, combining GlobalData's data, continuous monitoring of external sources, AI-assisted analysis and the expertise of our consultants. The platform runs on AWS, with a Python and PostgreSQL ...

technically minded and analytically driven Exposure Platform Analyst to join Rokstone's growing Exposure Management team. This role combines exposure analytics, insurance technology, and data engineering, supporting underwriting and portfolio management across international business units. You will work closely with UK and US stakeholders to develop exposure platforms, integrate … third-party systems through APIs, and improve risk data quality. This is an excellent opportunity to gain exposure to multiple (Re)Insurance classes while helping build modern, data-driven solutions that support smarter underwriting decisions. Role Accountabilities Design and maintain exposure management platforms supporting underwriting and portfolio analytics. ...

Yapily in London is recruiting a Junior Software Engineer (Data Products) to help build and scale our modern, next-generation data platform. You’ll work on high-performance data pipelines and data APIs, with exposure to the Google Cloud Platform stack, while collaborating with … product teams to turn raw data into actionable value. You will learn to design scalable data ingestion, support billing infrastructure, and participate in testing, monitoring, and agile ceremonies to rapidly grow #J-18808-Ljbffr ...

cutting-edge ML systems that impact millions of customers daily. These are some of the key components to the position: Collaborate extensively with Data Scientists, Product Managers, and Backend Engineers to bridge the gap between model development and production systems Lead the architectural design … systems, from data ingestion and training pipelines to real-time inference and monitoring infrastructure Transform innovative data science prototypes into robust, scalable, and secure production software, taking ownership of the 'path to production' Drive the adoption of MLOps best practices (CI/CD for ML, model versioning ...

dashboards. They are slow, brittle, and disconnected from the real-world complexity that regulated businesses face today. Teams are left reconciling fragmented derivatives data, interpreting changing requirements, managing reporting exceptions, and hoping they have not missed a critical detail that could lead to rejected submissions, regulatory scrutiny, or reputational … help us design and build a modern derivatives-reporting solution for the UK and European markets. You will work closely with our product, engineering, data, and commercial teams to translate complex EMIR requirements into clear product logic, data models, validation rules, workflows, and user experiences. You should understand ...

Nottingham Building Society is building a new Data Platform on Microsoft Fabric and Azure. We are seeking a Data Engineer to help design, implement and operate scalable, secure data solutions that power regulatory reporting, analytics and AI initiatives. Join a collaborative team at our Head Office … Nottingham, with hybrid working (minimum 2 days on site). You will work across data ingestion, lakehouse architectures and data governance while delivering high-quality data assets for #J-18808-Ljbffr ...

client: Bank --------------------------------------- JOB DETAILS Role Title: Technology Architect Technology Architect – Databricks with over 12 years of experience in designing and leading large scale data engineering, analytics, and cloud transformation initiatives. The ideal candidate will have deep expertise in Databricks, big data architectures, cloud platforms (Azure), and modern data … will be responsible for defining end to end architectural solutions, driving best practices, and guiding engineering teams to deliver scalable, secure, and cost optimized data platforms. \* Design end to end data platforms leveraging Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and ML/AI workloads. \* Define data ...

quantitative investing, combining advanced machine learning, artificial intelligence, and fundamental research to support investment decision-making. The firm has built a sophisticated in‐house data and analytics platform that enables researchers and portfolio managers to leverage large‐scale datasets, alternative data sources, and cutting‐edge AI technologies … professionals. The successful candidate will operate at the intersection of machine learning research, quantitative analytics, and AI engineering, contributing to both model development and data infrastructure initiatives. Key Responsibilities Quantitative Machine Learning Research Design, develop, and deploy machine learning models for prediction problems across financial markets. Build and maintain ...

institutes all over the world. From creating experiments and prototyping implementations to designing new architectures, engineers work on real-world problems including artificial intelligence, data mining, natural language processing, hardware and software performance analysis, improving compilers for mobile platforms, as well as core search and much more. … impact on hardware, network, or service operations and quality.### Skills Required* Software Development* Programming Languages* Machine Learning Models* Model Training* Engineering Workflows* Data Analysis at Scale* Data Visualization* Data Ingestion Pipelines* Large Language Models (LLMs)* AI Agents* Tools* JAX* PyTorch #J-18808-Ljbffr ...

assessments on TM configurations and translate findings into actionable enhancements. Collaborate with cross‐functional teams to define best practices for scenario design and data quality management. Data Analysis & Tuning Leverage data analytics to assess TM model performance and deliver insight‐driven tuning recommendations. Identify challenges with cross … border, trade finance, and retail transaction data and propose effective solutions. Develop structured approaches to reduce operational inefficiencies while ensuring regulatory compliance. Stakeholder & Project Leadership Act as a senior point of contact between compliance, data teams, and technology functions. Present tuning strategies, configuration changes, and outcomes directly ...

applications and third-party tools. Work with message brokers (RabbitMQ) to design event-driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across all pipeline stages. Contribute to and lead discussions on system architecture, ensuring solutions are robust, scalable, and maintainable. Define technical standards and patterns for backend services across the engineering team. Evaluate and recommend ...