51 to 75 of 85 Data Pipeline Jobs in Central London

Enterprise Architect - Outside IR35 - Hybrid Role Purpose Provide enterprise-wide architectural leadership across business, digital, data, integration, and AI domains. Define target architecture, guide transformation, and ensure technology investments deliver measurable business outcomes while remaining secure, scalable, and compliant. Key Responsibilities Enterprise Architecture Define and maintain enterprise architecture … vision, principles, target state, and roadmaps aligned to business, digital, and data strategy. Ensure initiatives align to target architecture with clear traceability to business outcomes (speed, cost, risk, customer experience). Balance strategic architecture with pragmatic delivery. Integration, iPaaS & Platforms Own the enterprise integration strategy and reference architecture. ...

About Decho Group Decho Group is a fast-growing Tech and AI consultancy, founded to solve complex data challenges for governments and enterprises. We specialise in Palantir technologies, advanced analytics, and AI-driven solutions that transform how organisations make decisions. In October 2025, Accenture acquired Decho Group, recognising … thrives on curiosity, collaboration, and bold thinking, working on projects that genuinely change lives and industries. The Role We’re seeking Full stack Data Engineers , across all levels from Junior to Senior Manager, who want to apply their technical skills in AI consultancy and Palantir engineering. ...

time Salary: Flexible - Depending on Experience About Us We’re a fast-growing AI and technology consultancy on a mission to solve complex data challenges for governments and enterprises. Our work combines deep engineering expertise with bold thinking to deliver solutions that transform decision-making and operations across … projects that genuinely change lives and industries, in a culture that values curiosity, collaboration, and innovation. The Role We’re seeking Full Stack Data Engineers across all levels—from Junior to Senior Manager—who want to apply their technical skills in AI consultancy and Palantir engineering. In this ...

solving complex integration challenges. Build and own core backend features and critical API integrations (Python, FastAPI, SQL). Design and implement complex data pipelines and workflows using tools like Dagster and Temporal. Validate and harden accelerated workflows, ensuring generated code meets production standards. Implement resilient connectors for APIs … perfect checklist, but they are specifically looking for strength in backend fundamentals. Strong backend/API experience (Python or TypeScript); SQL and data modelling skills. Familiarity with (or keen interest in) agentic AI coding tools (e.g., Cursor/Codex/Claude Code) to plan, scaffold, refactor, and test. ...

have the opportunity to work on strategy. You’ll be: Designing and building internal and client-facing tools used across marketing teams Developing data-driven applications on top of cloud data platforms Working closely with analytics teams and senior stakeholders to prioritise what to build next … Creating automation and AI-powered workflows to support campaign management and optimisation Improving data pipelines, models, and performance monitoring used by PPC, SEO, and content teams You’ll be part of a small, highly impactful tech group where your work directly shapes how the business operates. Tech Environment ...

change retail forever through hyper-personalised shopping experiences that are both simple and beautiful. About the Job We are looking for a Senior Data Scientist with experience in bringing advanced machine learning and data science systems to production to work with our team of industry leading … domain experts and engineers. You'll be working across our entire data science stack, from advanced recommender systems to comprehensive performance analytics. Key Responsibilities: Design and implement scalable machine learning for complex data analysis, optimised recommendations, and predictive modelling. Translate the latest advances in machine learning ...

this role, you will work closely with front-office quants and traders and will be responsible for designing and developing latency-sensitive data solutions. THE ROLE: Build and improve analytics capabilities that give the front office and management clearer visibility across both new and existing areas … business. Develop scalable data pipelines to capture, clean, and store high-volume datasets from internal trading platforms and external market data feeds. Create and refine efficient data-access frameworks to support live dashboards, execution performance analysis, and market microstructure research. Design and implement complex ...

Forward Deployed Data Engineer (Enterprise/AI Platform) £45,000 - £75,000 DOE Location: London (hybrid 3 days in office) Type: Full-time The Opportunity We’re partnering with a high-growth B2B SaaS company building an advanced enterprise data and AI platform and are looking … Forward Deployed Data Engineer to sit at the intersection of cutting-edge technology and real-world business impact . In this role, you’ll work directly with senior stakeholders at large enterprises to embed the platform deep into their operations — transforming strategic intent into live, production systems that ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

role: Own and manage the cloud infrastructure, ensuring scalability, resilience, and security. Implement and maintain high-availability architectures across critical services and data layers. Design and optimise … infrastructure to support AI-powered workloads and data pipelines. Lead cost optimisation initiatives across the platform. Manage the end-to-end deployment pipeline to ensure fast, reliable, and low-friction releases. Maintain, optimise, and automate CI/CD processes. Ensure zero-downtime deployment strategies and effective rollback ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

Inside IR35 Duration: 6 months Role Overview As an MLOps Engineer, you will support machine learning products from inception, working across the full data ecosystem. This includes developing application-specific data pipelines, building CI/CD pipelines that automate ML model training and deployment, publishing model … results for downstream consumption, and building APIs to serve model outputs on-demand. The role requires close collaboration with data scientists and other stakeholders to ensure ML models are production-ready, performant, secure, and compliant. Key Responsibilities Design, implement, and maintain scalable ML model deployment pipelines (CI/ ...

processes and testing pipelines to support quick iterative development and system stability. Work on ML model development with our team to build robust data pipelines and deploy ML models. Analyse large corpora of data and build real-time recommendation systems. Work with large amounts of data ...

central government space that is looking for an experienced Security Architect to support the design and assurance of secure digital, data, and cloud platforms. The role has a strong focus on modern cloud architecture and emerging AI-enabled services. This is a hands-on architecture role, working closely … with engineering, data, and programme teams to ensure security is embedded by design. Key Responsibilities Lead the design and assurance of secure cloud and hybrid architectures Define and maintain security and cloud architecture patterns, principles, and standards Provide security and cloud input into solution designs, technical reviews ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

Manchester - Salary up to £120k We’re hiring a Hands-On Engineering Manager with deep technical leadership experience across Python, large-scale data systems, and modern AWS infrastructure. You’ll lead a squad of 4 engineers, guiding them through complex technical decisions and helping them deliver high-performance … data-intensive systems operating over hundreds of millions to billions of rows. The product itself is an AI/ML-driven SaaS platform, and your contributions will train new models, enabling new features and having large greenfield elements to it. This role blends hands-on technical context with ...

maintain high-performance software used in quantitative research and trading Collaborate with quantitative researchers to productionise models and research tools Build and maintain data pipelines for large-scale market and reference data Develop backtesting, simulation, and analytics frameworks Contribute to trading, execution, and risk management systems … practices in software development, testing, and documentation Required Qualifications Strong programming skills in Python , C++ , or C# Solid foundations in computer science, including data structures and algorithms Experience working with large datasets and time-series data Familiarity with Linux/Unix environments and version control tools ...

Timeline Month 1: Onboard to existing ML codebase and infrastructure; identify technical debt and reliability gaps; ship incremental improvements to model serving latency or pipeline robustness. Month 3: Own and deliver a major infrastructure component (e.g., feature store, training orchestration, or model registry); improve system observability with logging, metrics … fundamentals (model training, evaluation, common architectures) Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model ...

firms and systematic hedge funds. These organizations operate at the absolute bleeding edge of technology, treating the global financial markets as a complex data science problem. They are deploying massive compute clusters and proprietary machine learning models to trade billions of dollars daily. If you're an engineer … compute layers, squeezing maximum efficiency out of hardware. Build World-Class Observability: Create robust monitoring and telemetry systems to provide real-time insights into pipeline health, trading activity, and model behavior. Work with the Best: Work side-by-side with world-class researchers and mathematicians to translate theoretical strategies ...

knowledge of current approaches and industry trends. and • Experience in Metaheuristic optimisation (essential) • Experience with AI/ML Techniques • Exposure to cloud-based data pipelines for large-scale test data processing for Data Centres. The successful candidate could be straight ...

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

models and trading logic into robust production-ready software Develop internal tools and interfaces used directly by front-office trading teams Improve market data ingestion, exchange connectivity, and real-time data flows Contribute to distributed systems, low-latency communication, and performance tuning initiatives Take part … Physics, Engineering, or a related discipline (graduating between December 2025 and June 2026) Strong programming capability in C++ and Python Solid foundations in data structures, algorithms, and operating systems Comfortable working in Linux/Unix environments A strong focus on writing clean, efficient, and maintainable code Excellent analytical ...

it. Use frontend frameworks such as shadcn and tailwind-ui to build features without the need for high-fidelity designs. Working with our data team to surface insights in usable interfaces. Improving deployment pipelines and infrastructure (AWS, Terraform). Shipping iteratively and responding to customer feedback quickly. Collaborating … directly with the platform and data teams to ensure seamless integration. Building a comprehensive understanding of our existing products and identifying areas for enhancement. Where required, helping with DevOps tasks and infrastructure automation. Documenting implementation processes clearly and concisely. Contributing to product discussions, bringing innovative solutions to complex ...

week) A leading global sports and entertainment brand is seeking an Product Manager to drive the roadmap for their AdTech platforms, ensuring innovative, data-driven solutions that connect brands with millions of fans worldwide. This is an exciting opportunity for a Product Manager to shape how advertising technology … ownership, with at least 2–3 years in AdTech or digital media. Strong knowledge of programmatic advertising, ad servers, DMPs, DSPs, and customer data platforms. Experience working with APIs, data pipelines, and integrations across AdTech/martech ecosystems. Understanding of data privacy and compliance ...

Senior Full Stack Engineer/Developer (TypeScript React Data) Remote UK to £90k Are you a data savvy Full Stack Engineer? You could be progressing your career in a senior, hands-on Senior Full Stack Engineer at a scaling Fintech who have built an energy trading … have React and Redux front end skills combined with backend JavaScript, TypeScript, Node.js and API experience You're comfortable working with complex, data rich environments, have a good appreciation of ETL data pipelines and LLMs (Large Language Models) You have previous experience within Fintech, Payments, eCommerce ...