26 to 44 of 44 Data Pipeline Jobs in the City of London

Data Scientist, London/Oxford hybrid working Are you excited by the opportunity to use machine learning, NLP, and generative AI to help researchers discover knowledge faster and make better decisions? Would you enjoy turning complex scientific and business challenges into practical, production-ready AI solutions that create … solutions that support scientific discovery, knowledge extraction, decision support, and intelligent content understanding. You will work with large-scale scientific content and data, applying the right techniques to solve complex problems and deliver reliable, production-ready systems. Working closely with cross-functional partners, you will help turn ambiguous ...

business is looking to appoint an experienced Digital Analyst to join its Group Digital team. This is a hands-on role for a data-driven analyst with strong expertise in digital analytics, ecommerce measurement, reporting, and data visualisation. Reporting to the Group Digital Analytics Manager … will transform digital, ecommerce, and customer data into meaningful insights that support commercial performance and business decision-making. You will work closely with Ecommerce, Marketing, Product, Technology, and external agency partners to improve digital tracking, reporting, and analytics capabilities. The role will also support the development and application ...

Lead Data Engineer (Permanent, London on-site 4 Days) - Sponsorship is not available for this role A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used … property teams. This is a hands-on, high-ownership role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. Start-up or Scale-up experience required coupled with a computing degree from a Russell Group university. ...

Exposure Data Analyst/Quantitative Exposure Analyst London 80,000 - 90,000 + Benefits Are you a data-driven insurance professional with strong Python and SQL skills looking to work at the forefront of exposure analytics, catastrophe risk, and process automation? I'm working with … highly regarded London Market insurer seeking an experienced Exposure Data Analyst/Quantitative Exposure Analyst to join a growing Exposure Management function. This is an excellent opportunity to combine technical expertise, data engineering, analytics and catastrophe risk management within a business where exposure analytics plays ...

Senior Databricks Technical Engineer Up to £111,500 + 10% Bonus | UK Wide Hybrid | SC Clearance Ready to build data platforms that actually make an impact? We're looking for an experienced Senior Databricks Technical Engineer to join a growing enterprise data team where … play a key role in designing, building and evolving modern data platforms. This isn't a role for someone looking to learn Databricks-you'll be the technical expert from day one, helping shape the platform while mentoring other engineers. What you'll be doing Building enterprise-scale ...

take them from prototype to something running reliably at scale - post-training and distilling the models that power them, building the data pipelines that feed them, owning inference at scale, and simplifying aggressively so only what actually delivers performance makes it to production. You'd work directly with ...

looking for a hands-on Data Product Manager to own and personally lead the development of our predictive market modelling solutions for the Animal Health division. This is a player-coach role: you will set the product direction for our sales and market models and roll up your … yourself. You’ll be the technical and product owner for forecasting solutions that directly shape commercial decision-making – turning messy internal and external data into models the business trusts and acts on. The role suits someone equally comfortable in a stakeholder workshop and in a notebook, who wants ...

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

join our clients technology team. You will play a key role in building, and maintaining software solutions that support our clients business systems, data pipelines, and automation initiatives. This is an excellent opportunity for a developer who enjoys writing clean, efficient code and wants to contribute to projects … production issues in a timely manner Contribute to the design and optimisation of data pipelines and database interactions Support CI/CD pipeline development and deployment automation Write and maintain unit, integration, and regression tests Stay current with emerging technologies and recommend improvements where relevant Assist ...

Senior Data Analytics Consultant 6 month Fixed Term Contract London – Hybrid (On client site 2/3 days per week) Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual … identify opportunities for growth and scale the engagement Communicate with the clients and understand their business needs Technical: Work with large, complex data sets to solve difficult, non-routine analysis problems, applying advanced analytical methods as needed Candidate must be well experienced with internal Google tools and publicly ...

Founder Location: London (hybrid) Type: Full-time THE ROLE Navigator is building the definitive travel commerce media network - aggregating first-party travel intent data from airline, OTA, and metasearch partners, and activating it programmatically across a growing publisher and advertiser ecosystem. We are Series A-backed, scaling aggressively … partners are structured, unified, and ready for activation at scale (3bn+ signals and growing). Define engineering standards for data quality, pipeline monitoring, and system reliability across the stack. WHAT WE'RE LOOKING FOR Deep hands-on experience building data infrastructure, identity resolution ...

looking for an experienced Senior Test Engineer (AI) to play a key role in delivering high-quality, reliable artificial intelligence and data-driven solutions within a complex, enterprise-scale environment. This is an exciting opportunity to lead testing strategy across cutting-edge AI systems, ensuring robust validation, strong … across digital platforms. The Role As a Senior Test Engineer, you will operate at a strategic level, shaping testing approaches for AI and data services while remaining hands-on across automation, validation, and delivery pipelines. You will: Lead the design and execution of end-to-end test strategies ...

Oriented Programming (OOP) to build intelligent, scalable automation solutions, while actively driving the adoption of AI-powered testing tools, autonomous test agents, and data-driven quality insights to modernise the testing lifecycle for our clients. Key Responsibilities Embeds Shift Left & AI-Assisted Quality Practice by engaging in quality … Python. Leverages Cloud & AI-Integrated Test Infrastructure. Operates within AWS/GCP environments to execute cloud-native and distributed test execution, manage test data pipelines and monitor logs and quality signals within CI/CD pipelines. Drives Agentic AI in Testing. Designs, implements and experiments with Agentic ...

Purpose: Responsible for the development and delivery of pipelines (collect, validate and prepare high quality data) to automate and streamline processes required by different departments across the bank. Support existing SSIS ETLs (overnight and intraday), proactively fine-tune and enhance existing codes to increase robustness and error monitoring. … able to apply to the fully development life-cycle. Keep abreast and apply software development’s best practice. Database Support To build data pipelines within the SQL environment in SSIS packages, where required, introduce new field and data types for new information to be collated ...

Role outline Based in London and reporting to the Director of Data & Research Technology, this role sits within Opinium’s CODE (Centre of Data Excellence) team. This is a hands-on role focused on the delivery of quantitative research programmes, including large-scale global trackers … high-profile multi-market studies. The role sits at the intersection of research technology, survey scripting, data processing, automation, workflow engineering, and operational delivery. You will combine strong technical capability with operational judgement. You understand how complex research programmes are built, where delivery risk sits ...

communications * Build solutions using OpenAI APIs, large language models, RAG, embeddings, vector search and tool calling * Implement permissions, monitoring, escalation processes and data-privacy controls * Integrate third-party systems using APIs, webhooks and data pipelines * Automate repetitive commercial and operational processes * Create dashboards and reporting tools … Practical experience with OpenAI APIs, LLMs, RAG and agentic workflows * Experience integrating CRM platforms, WhatsApp Business, webhooks and third-party APIs * Strong SQL, data-integration and dashboard-development skills * Knowledge of technical SEO, GA4, Google Tag Manager, Google Ads tracking and conversion optimisation * Experience with Opera Cloud ...

communications * Build solutions using OpenAI APIs, large language models, RAG, embeddings, vector search and tool calling * Implement permissions, monitoring, escalation processes and data-privacy controls * Integrate third-party systems using APIs, webhooks and data pipelines * Automate repetitive commercial and operational processes * Create dashboards and reporting tools … Practical experience with OpenAI APIs, LLMs, RAG and agentic workflows * Experience integrating CRM platforms, WhatsApp Business, webhooks and third-party APIs * Strong SQL, data-integration and dashboard-development skills * Knowledge of technical SEO, GA4, Google Tag Manager, Google Ads tracking and conversion optimisation * Experience with Opera Cloud ...

execution of client engagements: scoping, system design, build and rollout. Forward-deployed means exactly that: inside the client's environment, on their real data, within their security model. A working prototype exists within the first days of an engagement; feedback lands every couple of days; a proven … templates and playbooks that make every engagement faster than the last. What You'll Be Doing Building working AI proofs on real client data during Assess engagements, the prototype is the discovery tool, built while the value case is made Delivering client POCs and MVPs: RAG pipelines, agent ...

governance, ethical AI guidance and regulatory compliance requirements. Lead end-to-end delivery of AI-enabled services, coordinating cross-functional teams of data/knowledge analysts, engineers and product specialists. Manage delivery of AI solutions leveraging automation capabilities, machine learning, natural language processing, generative and agentic AI, from … into sprints and milestones, managing delivery cadence and tracking velocity, quality and technical debt with the engineering team. Manage cross-team dependencies across data pipelines, APIs and cloud infrastructure, working closely with ML engineers and platform teams. Experience At least 12 years IT industry experience across project ...