51 to 71 of 71 Data Pipeline Jobs in the City of London

deep technical engine behind their internal AI deployment team. Where the AI Deployment Strategist scopes and builds agents, you own the infrastructure underneath data pipelines, system integrations, and everything that ensures deployed AI solutions work reliably at scale. You will take prototypes to production, ensure all business systems … storage supporting current and future AI deployments Troubleshoot integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft ...

Product Data Scientist (AI-Native Products) – Senior/Staff Level Location: London (Hybrid – 2–3 days onsite) Level: Senior/Tech Lead or Staff Salary: £110,000-£145,000 + strong shares The Opportunity We’re partnering with a fast-growing, AI-native SaaS organisation building next-generation … shaping how the business understands and improves AI-driven conversations at scale. What You’ll Be Doing Analyse high-volume text and conversation data to uncover meaningful patterns and user behaviours Apply semantic analysis and NLP techniques to improve product performance and user experience Partner closely with product ...

Senior Data Engineer/GCP/Looker/Big Query £500 - 550 per day (Outside IR35) London/Hybrid (1 day a week) This is an opportunity for you to join a rapidly growing ecommerce business who are looking for a Senior Data Engineer. This role … ideal for someone who has built and operated modern data platforms natively within GCP and can take ownership of the full data engineering lifecycle, from ingestion and transformation through to semantic modelling and reporting enablement. You must have experience in designing, building and optimising scalable data ...

patterns. Contribute to technical strategy and architecture decisions, working closely with the Head of Engineering. Maintain secure, performant, and maintainable systems, ensuring reliable data pipelines as we scale. Engage closely with product workflows to ensure systems built solve the right problems. Job Requirements: Experience in software engineering, ideally ...

looking for an experienced Senior Test Engineer (AI) to play a key role in delivering high-quality, reliable artificial intelligence and data-driven solutions within a complex, enterprise-scale environment. This is an exciting opportunity to lead testing strategy across cutting-edge AI systems, ensuring robust validation, strong … across digital platforms. The Role As a Senior Test Engineer, you will operate at a strategic level, shaping testing approaches for AI and data services while remaining hands-on across automation, validation, and delivery pipelines. You will: Lead the design and execution of end-to-end test strategies ...

least 5 years in technical leadership roles. Strong experience in Azure cloud architecture and enterprise application delivery. Experience working with Dataiku for analytics, data pipelines, or AI/ML-driven applications. Strong knowledge of .NET/ASP.NET Core architecture and enterprise integrations. Experience with financial services, treasury, derivatives … risk management platforms. Understanding of derivative valuation concepts, yield curves, curve validation, or market data processing. Experience with APIs, microservices, DevOps, and CI/CD pipelines. Strong stakeholder management and client-facing communication skills. Experience managing distributed/global teams. Preferred Skills Exposure to market risk or quantitative ...

solutions, working closely with internal teams to improve the organisation's overall security posture. This position focuses on onboarding new log sources, optimising data pipelines, developing advanced detection use cases, and strengthening overall security monitoring and response. It's an excellent opportunity for a security professional who enjoys … improve effectiveness SOC & Incident Response Support Partner with SOC analysts to validate and improve detection logic Support investigations through advanced SIEM queries and data analysis Act as a subject matter expert on complex security incidents Documentation & Governance Maintain clear documentation of data models, integrations, and detection ...

Build and own a GCP data platform in a high-impact, early-stage business £100K plus equity in a well-funded Series A start-up. Own and shape a GCP data platform (BigQuery, Airflow, dbt). Real progression into a future leadership role. We’re working … with an early-stage, well-funded tech-led start-up. They’re looking for a Senior Data Platform Engineer to take ownership of their growing platform and help scale it as the business expands globally. What you’ll be doing This is a key hire for the business ...

discovery conversations with prospects and customers, uncovering KPIs, strategic initiatives, technical pain points, and integration requirements. Answer technical questions on implementation, security architecture, data delivery, API integrations, and compliance standards with authority. Act as the core technical liaison between customers, Sales, Product, and Engineering - translating business requirements into … security questionnaires, and architecture discussions. Lead proof-of-concept scoping and technical evaluations. Build deep expertise across the Vixio platform, API integrations, webhooks, data pipelines, and the Regulatory Knowledge Graph. Maintain clear understanding of global compliance frameworks, GRC workflows, and how regulations vary across jurisdictions and verticals (Payments ...

discovery conversations with prospects and customers, uncovering KPIs, strategic initiatives, technical pain points, and integration requirements. Answer technical questions on implementation, security architecture, data delivery, API integrations, and compliance standards with authority. Act as the core technical liaison between customers, Sales, Product, and Engineering - translating business requirements into … security questionnaires, and architecture discussions. Lead proof-of-concept scoping and technical evaluations. Build deep expertise across the Vixio platform, API integrations, webhooks, data pipelines, and the Regulatory Knowledge Graph. Maintain clear understanding of global compliance frameworks, GRC workflows, and how regulations vary across jurisdictions and verticals (Payments ...

Lead end-to-end delivery of CAT products (e.g., Concierge an agentic AI workflow tool, Prism a Mercer knowledge fabric for scheme data, and similar initiatives), from problem framing and design through build, release, and support. Translate risk advisory/consulting needs into clear technical requirements, user stories … solution designs; partner with stakeholders through UAT and rollout. Own the backend and integration approach (APIs, data flows, security, RBAC), and ensure solutions are scalable, maintainable, and well documented Provide technical leadership for a distributed team (London + India): sprint planning input, code reviews, mentoring, and raising engineering ...

Gemini, Nvidia, and Writer . Work Across the Commerce Ecosystem: Support the integration of AI/ML capabilities with enterprise platforms, helping connect data and services across Commerce, PXM, CDP, DAM, CMS, and CRM systems. Develop and Maintain Data Solutions: Design and implement database components using … NoSQL technologies , supporting data pipelines and stored procedures that handle large‐scale commerce and customer data. Contribute to Delivery & Engineering Excellence: Collaborate within agile delivery teams, contributing to solution design, development best practices, and DevSecOps processes, while learning from senior engineers and architects across the Accenture Data ...

across the globe design and build innovative products, platforms, and digital experiences for the modern world. By integrating experience design, complex engineering, and data expertise - we help our clients imagine what’s possible and accelerate their transition into tomorrow’s digital businesses. At GlobalLogic, we have a strong … track record of successfully delivering ground-breaking Cloud, Data & Digital Transformation programmes and we have an international reach working with a wide variety of projects and customers. Our approach enables companies to “build the exceptional” and be fit for purpose in the 21st century. We are seeking ...

focus areas: Building scalable data pipelines using Apache Spark & Airflow Working within a cloud-based, containerised environment (Kubernetes) Contributing to a wider data platform modernisation programme Supporting both batch and streaming workloads Tech: Python, Java, Spark, Airflow, SQL, Cloud (AWS/Azure), Kubernetes (Kafka/streaming … month contract 3 days onsite - City of London They're looking for a strong, hands-on engineer (5+ years) with experience in big data/distributed systems and modern data platforms. Please click here to find out more about our Key Information Documents. Please note that ...

Prism Analytics. Key Responsibilities Lead the design and delivery of Workday Financials, Accounting Centre, and Prism Analytics solutions. Build end-to-end Prism data pipelines, including data mapping, transformation, and reporting. Develop advanced financial and operational reporting, including composite reports and analytics dashboards. Manage project scope … transformation projects. Required Experience Proven experience delivering Workday Financials implementations, including Accounting Centre and Prism Analytics. Strong knowledge of ERP, EPM, cloud platforms, data integration, reporting, and analytics. Experience leading stakeholders, managing delivery teams, and driving successful project outcomes. Excellent communication skills with the ability to engage both ...

Prism Analytics. Key Responsibilities Lead the design and delivery of Workday Financials, Accounting Centre, and Prism Analytics solutions. Build end-to-end Prism data pipelines, including data mapping, transformation, and reporting. Develop advanced financial and operational reporting, including composite reports and analytics dashboards. Manage project scope … transformation projects. Required Experience Proven experience delivering Workday Financials implementations, including Accounting Centre and Prism Analytics. Strong knowledge of ERP, EPM, cloud platforms, data integration, reporting, and analytics. Experience leading stakeholders, managing delivery teams, and driving successful project outcomes. Excellent communication skills with the ability to engage both ...

broad optimisation strategies into effective personalisation programs, foster a culture of delivering relevant, tailored experiences, and drive measurable business impact through a systematic, data-driven approach focused on personalisation. This role will work at a high level of detail, implementing and optimising the personalisation framework defined … comprehensive performance reporting on personalisation outcomes and insights. Cultivate and maintain robust relationships with client stakeholders, specifically around personalisation planning, content requirements, and data activation across global regions. Personalisation Strategy & Execution: Champion Personalisation-Led Growth (PLG) across the organisation, fostering a mindset of delivering highly relevant, tailored user ...

broad optimisation strategies into effective personalisation programs, foster a culture of delivering relevant, tailored experiences, and drive measurable business impact through a systematic, data-driven approach focused on personalisation. This role will work at a high level of detail, implementing and optimising the personalisation framework defined … comprehensive performance reporting on personalisation outcomes and insights. Cultivate and maintain robust relationships with client stakeholders, specifically around personalisation planning, content requirements, and data activation across global regions. Personalisation Strategy & Execution: Champion Personalisation-Led Growth (PLG) across the organisation, fostering a mindset of delivering highly relevant, tailored user ...

activate and scale partnerships. Measure activation rate, moves per partner, integration velocity, and partner NPS. Integration quality. Own the reliability, speed, and data quality of partner data flowing into our platform. When a partner sends us a move, the experience should be seamless. B2B metrics. Partner … measurably increases moves from at least one partner. Build relationships with key partner stakeholders. Understand their pain points, not just ours. Map the integration pipeline and develop a prioritisation framework for new partner types (deposit schemes, mortgage software, conveyancing platforms). Establish your operating rhythm with Engineering ...

capabilities, models, and LLM‐powered solutions that power our products and customer experiences. You will lead a squad of AI engineers and data scientists, ensuring high‐quality delivery while fostering a culture of accountability, innovation, and continuous improvement. Working closely with product managers and engineering leadership, you will … Enable team autonomy through guidance and governance rather than top‐down control Resolve Issues & Handle Production Incidents Investigate and resolve issues across models, data pipelines, and AI systems Lead incident response for production outages, ensuring rapid mitigation and resolution Implement improvements to prevent recurrence and enhance system reliability ...

high-performing platform engineering environment, working across the full software delivery lifecycle. You'll act as the connective tissue between Product, Engineering and Data, translating complex platform requirements into clear, actionable specifications that teams can build against with confidence The role You'll be working deep … engine room of a large-scale software platform getting hands-on with APIs, platform architecture, data pipelines and system integrations. You'll own requirements end-to-end, from discovery through to delivery, and be comfortable challenging assumptions from both a technical and product perspective What ...

high-performing platform engineering environment, working across the full software delivery lifecycle. You'll act as the connective tissue between Product, Engineering and Data, translating complex platform requirements into clear, actionable specifications that teams can build against with confidence The role You'll be working deep … engine room of a large-scale software platform getting hands-on with APIs, platform architecture, data pipelines and system integrations. You'll own requirements end-to-end, from discovery through to delivery, and be comfortable challenging assumptions from both a technical and product perspective What ...

systems . WHAT YOU'LL DO Design and maintain LLM gateway, MCP connector layer, observability, and privacy proxy Develop MCP connectors across data sources (M365, Salesforce, Kensho, Moody's, internal systems) Build AI-powered tools and workflows for business teams Integrate Databricks/Unity Catalog as data … house AI capability WHO YOU ARE Essential: Hands-on production experience with Claude, OpenAI, or similar LLM APIs Strong Python engineering (API design, data pipelines, cloud-native development) Azure experience preferred Security and governance awareness (prompt injection, data boundaries, RBAC) End-to-end ownership mindset Desirable ...

client Build guardrails for prompt injection, PII, and output safety Drive prompt engineering practice - versioning, A/B testing, platform overlays 3. Cloud & Data Infrastructure Own the cloud substrate that runs the AI workloads. You will: Architect and maintain AWS infrastructure (ECS Fargate, Lambda, Step Functions, EventBridge … Athena, DynamoDB, Bedrock) Build and operate data pipelines that move LLM outputs from generation to analytics Manage containerized deployments, CI/CD, and infrastructure as code Ensure reliability, observability, and cost efficiency across the platform 4. Security, Compliance & AI Safety Implement IAM, encryption, and network security best practices ...

work directly with the founders to take a product from concept to reality, owning everything from architecture and infrastructure through to AI workflows, data pipelines, and customer facing applications. Think large scale signal ingestion, entity resolution, AI powered synthesis layers, real time data processing, and turning … alongside the founders Designing and developing full stack applications using modern JavaScript and Python/Node.js ecosystems Building AI powered workflows and intelligent data processing systems Working directly with customers to understand problems and shape solutions Making key architectural decisions that will influence the long term direction ...