201 to 225 of 296 Data Pipeline Jobs in London

Senior Software Engineer (Python - FastAPI) This fast-growing consultancy is pushing the boundaries of AI and data science, helping clients turn complex challenges into scalable, production-ready solutions. They’re now hiring a Senior Software Engineer who can blend deep technical expertise with a practical, delivery-focused mindset. … Role Overview: Location: London (hybrid) Package: Competitive salary + bonus + benefits Industry: AI, Data Science & Technology Consulting Security Clearance: Applicants Must have Active SC Clearance or above What You’ll Be Doing: Leading the end-to-end design and build of applications that utilise advanced ...

Enterprise Architect - Outside IR35 - Hybrid Role Purpose Provide enterprise-wide architectural leadership across business, digital, data, integration, and AI domains. Define target architecture, guide transformation, and ensure technology investments deliver measurable business outcomes while remaining secure, scalable, and compliant. Key Responsibilities Enterprise Architecture Define and maintain enterprise architecture … vision, principles, target state, and roadmaps aligned to business, digital, and data strategy. Ensure initiatives align to target architecture with clear traceability to business outcomes (speed, cost, risk, customer experience). Balance strategic architecture with pragmatic delivery. Integration, iPaaS & Platforms Own the enterprise integration strategy and reference architecture. ...

Enterprise Architect - Outside IR35 - Hybrid Role Purpose Provide enterprise-wide architectural leadership across business, digital, data, integration, and AI domains. Define target architecture, guide transformation, and ensure technology investments deliver measurable business outcomes while remaining secure, scalable, and compliant. Key Responsibilities Enterprise Architecture Define and maintain enterprise architecture … vision, principles, target state, and roadmaps aligned to business, digital, and data strategy. Ensure initiatives align to target architecture with clear traceability to business outcomes (speed, cost, risk, customer experience). Balance strategic architecture with pragmatic delivery. Integration, iPaaS & Platforms Own the enterprise integration strategy and reference architecture. ...

About Decho Group Decho Group is a fast-growing Tech and AI consultancy, founded to solve complex data challenges for governments and enterprises. We specialise in Palantir technologies, advanced analytics, and AI-driven solutions that transform how organisations make decisions. In October 2025, Accenture acquired Decho Group, recognising … thrives on curiosity, collaboration, and bold thinking, working on projects that genuinely change lives and industries. The Role We’re seeking Full stack Data Engineers , across all levels from Junior to Senior Manager, who want to apply their technical skills in AI consultancy and Palantir engineering. ...

time Salary: Flexible - Depending on Experience About Us We’re a fast-growing AI and technology consultancy on a mission to solve complex data challenges for governments and enterprises. Our work combines deep engineering expertise with bold thinking to deliver solutions that transform decision-making and operations across … projects that genuinely change lives and industries, in a culture that values curiosity, collaboration, and innovation. The Role We’re seeking Full Stack Data Engineers across all levels—from Junior to Senior Manager—who want to apply their technical skills in AI consultancy and Palantir engineering. In this ...

investment lifecycle, including internal builds, pilots, and vendor integrations. Define product roadmaps, assess feasibility, and drive accountability in close partnership with investment, data, and technology stakeholders. Operate an agile delivery model that rapidly experiments, iterates, and scales successful outcomes. Partner with Senior Investment Leadership Provide regular updates … impact AI use cases. Translate complex investment processes into intelligent, scalable agentic solutions. Help modernize the investment platform through close collaboration across investment, data science, and technology teams. Lead Development of Agentic Systems Manage teams building agentic architectures that integrate LLMs, quantitative models, enterprise data pipelines ...

secure product delivery across all our global engineering and AI teams. You will be in the central seat across all our deliveries including data, ML, LLM, agentic AI, and applications. Responsibilities Own GCP infrastructure – Operate and evolve production and non-production environments; manage cost visibility, quotas, and alerts … HIPAA, SOC 2, ISO 27001); configure IAM, service accounts, workload identity, network security, and audit logging; support audits and remediation activities Enable product, data, and ML teams – Translate product and data requirements into secure, scalable platform designs; provision tooling and environments for ML experimentation, data ...

solving complex integration challenges. Build and own core backend features and critical API integrations (Python, FastAPI, SQL). Design and implement complex data pipelines and workflows using tools like Dagster and Temporal. Validate and harden accelerated workflows, ensuring generated code meets production standards. Implement resilient connectors for APIs … perfect checklist, but they are specifically looking for strength in backend fundamentals. Strong backend/API experience (Python or TypeScript); SQL and data modelling skills. Familiarity with (or keen interest in) agentic AI coding tools (e.g., Cursor/Codex/Claude Code) to plan, scaffold, refactor, and test. ...

have the opportunity to work on strategy. You’ll be: Designing and building internal and client-facing tools used across marketing teams Developing data-driven applications on top of cloud data platforms Working closely with analytics teams and senior stakeholders to prioritise what to build next … Creating automation and AI-powered workflows to support campaign management and optimisation Improving data pipelines, models, and performance monitoring used by PPC, SEO, and content teams You’ll be part of a small, highly impactful tech group where your work directly shapes how the business operates. Tech Environment ...

have the opportunity to work on strategy. You'll be: Designing and building internal and client-facing tools used across marketing teams Developing data-driven applications on top of cloud data platforms Working closely with analytics teams and senior stakeholders to prioritise what to build next … Creating automation and AI-powered workflows to support campaign management and optimisation Improving data pipelines, models, and performance monitoring used by PPC, SEO, and content teams You'll be part of a small, highly impactful tech group where your work directly shapes how the business operates. Tech Environment ...

Umbrella. Working in a Hybrid Model of 2 days a week on site. What You'll Do Contribute to the development of data pipelines, APIs, and services that power the AI Control Tower. Implement components supporting AI observability, guardrails, performance monitoring, and lifecycle controls. Develop integrations with model … registries, feature stores, lineage tools, and governance systems. Write clean, well-tested, scalable code in Python, Java, SQL, and modern data/stream processing frameworks. Build high-throughput pipelines to capture metrics such as: Model performance, drift, and degradation Operational and service health Security posture and policy adherence ...

platform. Work closely with product managers to prioritise features, shape the roadmap, and ensure delivery against ambitious timeline Develop scalable, high-throughput data pipelines and monitoring systems to track: AI model performance and drift Operational resilience and service health Security posture and policy adherence Guardrail compliance … secure-by-design principles, strong IAM practices, and regulatory compliance into the platform architecture. Ensure all AI systems are Partner with SMEs across data engineering, model risk, security, IMM (Independent Model Monitoring), and platform engineering. Partner with SMEs across data engineering, platform engineering, security, risk ...

Senior Data Engineer Location: London (2 Days in Office) Salary: £80,000 Join a growing, people-first organisation where you'll shape a modern Databricks Lakehouse platform, lead impactful data initiatives across the business, and enjoy true flexibility, autonomy and career growth. The Opportunity This … with clear purpose, strong leadership and a genuinely collaborative culture. The Role and Responsibility The role focuses on designing, building and maintaining scalable data pipelines and products on a modern Databricks Lakehouse environment, using Delta Lake, Spark, Python (PySpark) and SQL to deliver high-quality, well-governed data ...

change retail forever through hyper-personalised shopping experiences that are both simple and beautiful. About the Job We are looking for a Senior Data Scientist with experience in bringing advanced machine learning and data science systems to production to work with our team of industry leading … domain experts and engineers. You'll be working across our entire data science stack, from advanced recommender systems to comprehensive performance analytics. Key Responsibilities: Design and implement scalable machine learning for complex data analysis, optimised recommendations, and predictive modelling. Translate the latest advances in machine learning ...

Python Engineer Contract | £400£458 per day (Inside IR35) Active SC Clearance is essential Remote We are seeking a highly capable Python-focused Data Engineer to join a delivery-driven team building and supporting complex data platforms in Azure. This role is heavily weighted towards Python … traditional ETL-only work. The successful candidate will be someone who writes clean, maintainable, and well-tested Python code, and is comfortable treating data pipelines as production-grade software. A significant portion of the work involves designing and maintaining complex, test-driven Python data flows, with ...

this role, you will work closely with front-office quants and traders and will be responsible for designing and developing latency-sensitive data solutions. THE ROLE: Build and improve analytics capabilities that give the front office and management clearer visibility across both new and existing areas … business. Develop scalable data pipelines to capture, clean, and store high-volume datasets from internal trading platforms and external market data feeds. Create and refine efficient data-access frameworks to support live dashboards, execution performance analysis, and market microstructure research. Design and implement complex ...

Forward Deployed Data Engineer (Enterprise/AI Platform) £45,000 - £75,000 DOE Location: London (hybrid 3 days in office) Type: Full-time The Opportunity We’re partnering with a high-growth B2B SaaS company building an advanced enterprise data and AI platform and are looking … Forward Deployed Data Engineer to sit at the intersection of cutting-edge technology and real-world business impact . In this role, you’ll work directly with senior stakeholders at large enterprises to embed the platform deep into their operations — transforming strategic intent into live, production systems that ...

Location: Remote Reports to: CTO A fast-growing technology company is seeking a Head of Engineering with deep experience building and scaling complex, data-driven platforms. This role requires someone who can lead multi-disciplinary teams, improve engineering execution, and drive technical excellence across high-scale distributed systems … machine-learning environments. Required Experience Leadership of engineering organisations of 20 or more across multiple disciplines, including backend, web, data, ML, QA, and DevOps. Proven track record designing, scaling, and maintaining distributed systems and high-volume data pipelines. Strong background in cloud-native architectures and modern ...

more sustainable, more inclusive world. YOUR ROLE We are seeking a highly experienced and innovative Microsoft Fabric Architect to lead enterprise-scale data modernization and AI initiatives. This role requires deep technical expertise in Microsoft Fabric and related services, with the ability to translate business needs into scalable … Microsoft platform. The ideal candidate will be a thought leader, trusted advisor, and hands-on architect capable of shaping next-generation data platforms and driving adoption across stakeholder groups. YOUR PROFILE Lead end-to-end architecture design and implementation for Microsoft Fabric across enterprise data programs. ...

Product Engineer (Data/Platform/Applied AI) Location: London (hybrid 3 days onsite) The Opportunity We’re partnering with a rapidly scaling, venture-backed technology startup building a next-generation enterprise data and AI platform . They’re looking for a Product Engineer who thrives … intersection of product thinking, data engineering, and applied AI . This role is ideal for someone excited about turning real-world complexity into reusable, configurable platform capabilities — enabling enterprise customers to deploy powerful solutions without bespoke engineering every time. In a world where competitive advantage is driven ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

role: Own and manage the cloud infrastructure, ensuring scalability, resilience, and security. Implement and maintain high-availability architectures across critical services and data layers. Design and optimise … infrastructure to support AI-powered workloads and data pipelines. Lead cost optimisation initiatives across the platform. Manage the end-to-end deployment pipeline to ensure fast, reliable, and low-friction releases. Maintain, optimise, and automate CI/CD processes. Ensure zero-downtime deployment strategies and effective rollback ...

High-Level) Design, implement, and maintain scalable ML model deployment pipelines (CI/CD for ML). Build infrastructure to monitor model performance, data drift, and other key metrics in production. Develop and maintain tools for model versioning, reproducibility, and experiment tracking. The Role As an MLOps Engineer … will support these products from inception. This requires working across the full data ecosystem: developing application-specific data pipelines (features), building CICD pipelines that automate the training and deployment of machine learning models, publishing the model results for downstream consumption, and/or building ...

between application monitoring and infrastructure, leveraging different tools like tools. Your Profile Essential Skills/Knowledge/Experience Design, implement, and maintain data pipelines to ingest and process OpenShift telemetry (metrics, logs, traces) at scale. Stream OpenShift telemetry via Kafka (producers, topics, schemas) and build resilient consumer services … transformation and enrichment. Engineer data models and routing for multi-tenant observability; ensure lineage, quality, and SLAs across the stream layer. Integrate processed telemetry into Splunk for visualization, dashboards, alerting, and analytics to achieve Observability Level 4 (proactive insights). Implement schema management (Avro/Protobuf), governance ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...