51 to 75 of 78 Data Ingestion Jobs in London

believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise … during the action. As a Principal Machine Learning Engineer , youll shape the technical strategy and delivery of production ML systems that transform raw sports data and live video into real-time insights and personalised experiences for millions of fans. For this role we offer the hybrid working approach with ...

believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise … during the action. As a Principal Machine Learning Engineer , youll shape the technical strategy and delivery of production ML systems that transform raw sports data and live video into real-time insights and personalised experiences for millions of fans. For this role we offer the hybrid working approach with ...

least-privilege access models for multiple teams. Support security and TDA assurance with architecture diagrams, control mappings, and risk mitigations. Define reference patterns for data ingestion, transformation, and data product creation. Support use cases across analytics, data engineering, and machine learning. Establish standards for data … NSGs, UDRs), ADLS Gen2 integration and access control, Entra ID/Azure AD integration. Experience supporting security assurance and architecture governance. Strong understanding of data platform operating models and data product concepts. Key Deliverables Secure Databricks platform implemented in Azure. Reference architecture and design documentation. Governance and RBAC ...

Senior Product Manager to take the lead on our Customer, Access and Identity roadmap, owning a portfolio of initiatives that bring together our customer data and modernise how customers access our products. This is a pivotal role in shaping how we identify, authenticate, and understand our customers across … central access management platform and driving the roll‐out of single sign‐on (SSO) and SAML across our estate. Working closely with Engineering Leads, Data teams, Commercial and Operations stakeholders, and third‐party vendors, you will translate a complex, cross‐system landscape into a clear, prioritised delivery plan ...

524.40 per day - Umbrella onlyDuration: 4 monthsLocation: London - 3 days a week in the officePlatform Architect to lead the evolution of our Enterprise Data Platform (EDP), driving platform engineering, FinOps, DevOps automation, and data engineering capabilities across the organization.This role is ideal for an architect who can combine … strategic architecture leadership with DevOps, FinOps, and Data Engineering expertise to deliver measurable business value, modernize the EDP landscape, and drive significant operational and cost efficiencies.Key ResponsibilitiesLead platform modernization initiatives aligned with enterprise technology and data strategies.Databricks Serverless EnablementLead the design and implementation of Databricks Serverless capabilities across ...

working with a London-based investment bank who are actively seeking a Senior Software Engineer to assist in the development of a business-critical data ingestion and search interface to simplify the onboarding of future applications. What you'll need to succeed : Proficiency in UI development with React. … Extensive Python and PowerShell scripting experience. Strong experience building data pipelines, architectures, and datasets. Strong experience building processes to support data transformation, data structures and metadata Extensive big-data experience. Good experience with at least one object-orientated programming language. What you'll get in return ...

people platforms Handle and partner with external vendors/configuration centres to deliver scalable, compliant solutions globally Act as a link between engineering, product, data science ensuring solutions move beyond prototypes into sustainable production AI & Engineering Leadership Design, develop and maintain production-grade AI applications and services using modern … practices (cloud-native design, CI/CD, testing, observability). Define and implement reusable AI platforms and capabilities (e.g. conversational assistants, AI search, unstructured data processing, GenAI solutions). Lead architectural decisions , ensuring responsible AI, explain ability, security, and operational robustness are embedded by design. Evaluate and integrate LLMs ...

Umbrella only Duration: 4 months Location: London - 3 days a week in the office Platform Architect to lead the evolution of our Enterprise Data Platform (EDP), driving platform engineering, FinOps, DevOps automation, and data engineering capabilities across the organization. This role is ideal for an architect … combine strategic architecture leadership with DevOps, FinOps, and Data Engineering expertise to deliver measurable business value, modernize the EDP landscape, and drive significant operational and cost efficiencies. Key Responsibilities Lead platform modernization initiatives aligned with enterprise technology and data strategies. Databricks Serverless Enablement Lead the design and implementation ...

choices while delivering high-quality work within deadlines Leading architecture and software design discussions Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Generating new potential solutions to challenges (technical and non-technical) in partnership with … particularly like to encourage applicants with experience in the following areas: MLOps: including tools like LangChain for application development and managing the ML lifecycle Data Engineering: including platforms like Databricks for data processing and analytics DevSecOps & DevOps Infrastructure as Code Data Engineering: including platforms like Databricks ...

architecture, technical leadership and hands-on delivery to ensure our Adobe Experience Cloud solutions enable personalised customer experiences at scale. Working closely with Marketing, Data, Engineering and Product teams, you'll define customer journeys, architect integrations and help drive adoption of Adobe's digital experience technologies. Key Responsibilities … personalised customer experiences throughout the customer life cycle. Manage customer profiles, identity stitching and Identity Graph capabilities to maintain accurate, unified customer views. Oversee data ingestion across Edge, Streaming and Batch pipelines, ensuring high-quality, timely and reliable customer data. Work closely with Engineering teams to optimise ...

Kaluza in the United Kingdom is seeking a Senior Engineering Manager (Data Platform & Analytics Engineering) to lead the Data Platform and Analytics Engineering teams across data ingestion, modeling, and governance. You will partner with Head of Data Science & Products to shape the data architecture ...

vision, strategy, and execution of Greyparrot’s dual-pronged product ecosystem. Your work will bridge the gap between sophisticated hardware deployment and deep, data-driven AI software platforms. This is a pivotal executive role for a platform thinker. Greyparrot operates across two distinct buyer markets - recycling facility operators … brands and regulators who depend on packaging performance data - served through a single underlying AI intelligence platform. The VP of Product owns the roadmap and architecture logic that connects these two surfaces, ensuring the right sequencing of investment so that growth in one directly compounds the value delivered ...

training of Machine Learning models. Experience in industry or a research lab working on machine learning problems and engineering workflows. Preferred Qualifications Experience with data analysis at scale, data visualization and data ingestion pipelines for training models. Experience with Large Language Models and notably Agents … institutes all over the world. From creating experiments and prototyping implementations to designing new architectures, engineers work on real-world problems including artificial intelligence, data mining, natural language processing, hardware and software performance analysis, improving compilers for mobile platforms, as well as core search and much more. ...

investigating anomalies, resolving technical issues, and helping ensure deployments continue to deliver measurable value. The role would suit someone who enjoys working across software, data, integrations, telemetry and customer-facing technical support. The Role You will work closely with Customer Success, Engineering and Data teams to monitor active … performance. Responsibilities will include: Monitoring live customer deployments, including uptime, system behaviour, performance and SLA compliance Investigating anomalies using logs, metrics, telemetry and operational data Diagnosing issues across data ingestion, integrations, connectivity, software deployments and system outputs Acting as a technical point of contact for deployment-related ...

architecture, scalability and platform evolution, connecting technical decisions to product and business outcomes Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Driving innovation by proactively surfacing new technical approaches and product solutions Leading or initiating … encourage applicants with experience in the following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such ...

architecture, scalability and platform evolution, connecting technical decisions to product and business outcomes Collaborating on systems that involve the full ML lifecycle from data ingestion and preprocessing, to model deployment, integration, and performance monitoring Driving innovation by proactively surfacing new technical approaches and product solutions Leading or initiating … encourage applicants with experience in the following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such ...

school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. ...

ground up. You'll design the infrastructure that turns model development from a bespoke, manual process into a scalable, standardised one - so our data and applied scientists can focus on improving detection rather than managing operations. This is a greenfield build with strong investment and direct engagement from Wise … Risk Modelling. You'll sit in Risk Modelling, building the platform layer that makes scaling our detection capabilities possible. You ll work closely with data scientists, feature platform engineers (upstream infrastructure), and Wise's central ML platform team (shared foundations). We value engineers who build for adoption - internal ...

will take deep ownership of one or more critical architecture domains - such as agentic application design, AI security and trust, AI operations and observability, data and knowledge engineering, or model platforms and inference - serving as the lead authority in your domain across client engagements. You will develop and maintain … critical dimension of this role is owning the design of a comprehensive AI context layer - drawing on enterprise knowledge bases, structured and unstructured data sources, and domain-specific content - to ground AI systems in the realities of each client's business and ensure outputs are accurate, trustworthy, and impactful. ...

Security Operations Centre to support the cyber defence of a major international defence programme. The environment will span Microsoft Cloud services and on-premises data centres across multiple regions and classification levels, creating a technically challenging and highly significant cyber security programme. The SIEM Engineer will support the design … role will work across technologies including Splunk, Microsoft Sentinel, SOAR, Microsoft XDR and wider security tooling, with a major focus on SIEM engineering, data onboarding, integrations, detection content and threat-led use cases. Whats on offer Salary: £72,000 £82,000 10% annual bonus Opportunity to help build ...

implementation. You will work hands‐on with software engineers, ML engineers, and product teams to ensure behavioural intelligence is embedded end‐to‐end from data pipelines and inference services through to live product decisioning and monitoring. Key Responsibilities Design, implement, and deploy AI models that predict, optimise, or automate … sequential modelling approaches (e.g. sequence prediction, intent modelling, imitation learning) into robust, production‐ready systems. Build and maintain end‐to‐end AI pipelines, including data ingestion, feature engineering, model training, inference, and monitoring. Apply causal inference techniques to evaluate the real‐world impact of AI‐driven decisions ...

Models (LLMs) and Vision-Language Models (VLMs), enabling agents to perceive, understand, and act within complex environments. We own the entire pipeline including synthetic data generation, environment design, mid-training, supervised fine-tuning, offline reinforcement learning, online reinforcement learning, reward modelling, transition modelling, etc. Our team also has dedicated … advanced LLMs and VLMs, including multimodal architectures Research and implement training methods for enhanced capabilities like instruction following and tool use Design and optimize data pipelines and training systems for large-scale distributed training Collaborate with cross-functional teams to integrate models into agentic AI systems Evaluate model performance ...

lawyers’ AI interactions Our tech stack and day-to-day tools include: TypeScript for the majority of our applications, frontends, and microservices Python for data ingestion and our AI services AWS for our cloud infrastructure Postgres for our data storage Terraform for defining infrastructure as code Head ...

report processing, and VAT reconciliations on royalty statements. Streamline financial operations by automating processes related to monthly accruals, costs, and transactional revenue tracking. Standardize data ingestion as digital partners and sales statements evolve over time. Partner directly with Finance and Royalty leaders to consult on systemic upgrades, infrastructure … improvements, and ad-hoc data projects. Write crystal-clear system documentation and Standard Operating Procedures (SOPs) for newly automated pipelines. What We're Looking For 1. Core Automation Expertise Real, hands-on experience automating end-to-end operational workflows and manipulating large datasets. Tool Agnostic: You must be highly ...

seeking a high-performance Rust Software Engineer to join a core technology team building highly available, distributed systems that underpin real‐time trading and data platforms. This is a greenfield, engineering‐led environment where system reliability, throughput, and latency are critical to trading performance. The firm operates a technology … handling extreme throughput and concurrency Implementing fault‐tolerant architectures to ensure system reliability in live trading environments Developing core infrastructure for real‐time data ingestion, processing, and distribution Working closely with traders, quantitative researchers, and infrastructure teams to deliver performance‐critical systems Requirements Strong commercial experience ...