51 to 74 of 74 Data Pipeline Jobs in the City of London

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

Inside IR35 Duration: 6 months Role Overview As an MLOps Engineer, you will support machine learning products from inception, working across the full data ecosystem. This includes developing application-specific data pipelines, building CI/CD pipelines that automate ML model training and deployment, publishing model … results for downstream consumption, and building APIs to serve model outputs on-demand. The role requires close collaboration with data scientists and other stakeholders to ensure ML models are production-ready, performant, secure, and compliant. Key Responsibilities Design, implement, and maintain scalable ML model deployment pipelines (CI/ ...

processes and testing pipelines to support quick iterative development and system stability. Work on ML model development with our team to build robust data pipelines and deploy ML models. Analyse large corpora of data and build real-time recommendation systems. Work with large amounts of data ...

central government space that is looking for an experienced Security Architect to support the design and assurance of secure digital, data, and cloud platforms. The role has a strong focus on modern cloud architecture and emerging AI-enabled services. This is a hands-on architecture role, working closely … with engineering, data, and programme teams to ensure security is embedded by design. Key Responsibilities Lead the design and assurance of secure cloud and hybrid architectures Define and maintain security and cloud architecture patterns, principles, and standards Provide security and cloud input into solution designs, technical reviews ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

Manchester - Salary up to £120k We’re hiring a Hands-On Engineering Manager with deep technical leadership experience across Python, large-scale data systems, and modern AWS infrastructure. You’ll lead a squad of 4 engineers, guiding them through complex technical decisions and helping them deliver high-performance … data-intensive systems operating over hundreds of millions to billions of rows. The product itself is an AI/ML-driven SaaS platform, and your contributions will train new models, enabling new features and having large greenfield elements to it. This role blends hands-on technical context with ...

maintain high-performance software used in quantitative research and trading Collaborate with quantitative researchers to productionise models and research tools Build and maintain data pipelines for large-scale market and reference data Develop backtesting, simulation, and analytics frameworks Contribute to trading, execution, and risk management systems … practices in software development, testing, and documentation Required Qualifications Strong programming skills in Python , C++ , or C# Solid foundations in computer science, including data structures and algorithms Experience working with large datasets and time-series data Familiarity with Linux/Unix environments and version control tools ...

Timeline Month 1: Onboard to existing ML codebase and infrastructure; identify technical debt and reliability gaps; ship incremental improvements to model serving latency or pipeline robustness. Month 3: Own and deliver a major infrastructure component (e.g., feature store, training orchestration, or model registry); improve system observability with logging, metrics … fundamentals (model training, evaluation, common architectures) Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model ...

firms and systematic hedge funds. These organizations operate at the absolute bleeding edge of technology, treating the global financial markets as a complex data science problem. They are deploying massive compute clusters and proprietary machine learning models to trade billions of dollars daily. If you're an engineer … compute layers, squeezing maximum efficiency out of hardware. Build World-Class Observability: Create robust monitoring and telemetry systems to provide real-time insights into pipeline health, trading activity, and model behavior. Work with the Best: Work side-by-side with world-class researchers and mathematicians to translate theoretical strategies ...

knowledge of current approaches and industry trends. and • Experience in Metaheuristic optimisation (essential) • Experience with AI/ML Techniques • Exposure to cloud-based data pipelines for large-scale test data processing for Data Centres. The successful candidate could be straight ...

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

models and trading logic into robust production-ready software Develop internal tools and interfaces used directly by front-office trading teams Improve market data ingestion, exchange connectivity, and real-time data flows Contribute to distributed systems, low-latency communication, and performance tuning initiatives Take part … Physics, Engineering, or a related discipline (graduating between December 2025 and June 2026) Strong programming capability in C++ and Python Solid foundations in data structures, algorithms, and operating systems Comfortable working in Linux/Unix environments A strong focus on writing clean, efficient, and maintainable code Excellent analytical ...

it. Use frontend frameworks such as shadcn and tailwind-ui to build features without the need for high-fidelity designs. Working with our data team to surface insights in usable interfaces. Improving deployment pipelines and infrastructure (AWS, Terraform). Shipping iteratively and responding to customer feedback quickly. Collaborating … directly with the platform and data teams to ensure seamless integration. Building a comprehensive understanding of our existing products and identifying areas for enhancement. Where required, helping with DevOps tasks and infrastructure automation. Documenting implementation processes clearly and concisely. Contributing to product discussions, bringing innovative solutions to complex ...

week) A leading global sports and entertainment brand is seeking an Product Manager to drive the roadmap for their AdTech platforms, ensuring innovative, data-driven solutions that connect brands with millions of fans worldwide. This is an exciting opportunity for a Product Manager to shape how advertising technology … ownership, with at least 2–3 years in AdTech or digital media. Strong knowledge of programmatic advertising, ad servers, DMPs, DSPs, and customer data platforms. Experience working with APIs, data pipelines, and integrations across AdTech/martech ecosystems. Understanding of data privacy and compliance ...

Senior Full Stack Engineer/Developer (TypeScript React Data) Remote UK to £90k Are you a data savvy Full Stack Engineer? You could be progressing your career in a senior, hands-on Senior Full Stack Engineer at a scaling Fintech who have built an energy trading … have React and Redux front end skills combined with backend JavaScript, TypeScript, Node.js and API experience You're comfortable working with complex, data rich environments, have a good appreciation of ETL data pipelines and LLMs (Large Language Models) You have previous experience within Fintech, Payments, eCommerce ...

large enterprises manage large-scale, complex workflows with high accuracy and speed. Its modular multi‐agent AI architecture powers configurable workflow, automation, and data platform used by a broad range of enterprise customers, without being limited to a single vertical. The platform focuses on data validation … role In this role you will own a core enterprise B2B platform built on a modular framework for configuring AI workers, workflows, and data pipelines. You will combine strategic product ownership with hands‐on work on product development of the platform. You will partner closely with engineering ...

world. We are now looking for a CTO and co-founder to own the engineering vision and architecture, translate complex product and data requirements into scalable systems, and help build a world-class team in Dubai. Role You will be responsible for building the technical foundation … platform from the ground up. This includes system architecture, back-end design, data pipelines, AI integration, and infrastructure decisions across multiple regions. You will work directly with the founding team to transform a validated product and design into a robust, intelligent application ready for scale. What ...

impactful, mission-driven technology. The role offers the chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You’ll become part of a tight-knit, highly capable engineering group that … through to delivery Analytical thinker who can decompose challenges and deliver iterative value Preferred Background Experience using Java, C++, or Python Understanding of data-intensive systems, backend services, or cloud-based platforms Familiarity with regulated, high-security, or mission-critical development contexts Confidence working in research ...

Dayforce Consultant to join on an interim basis. The key distinction is that this role is about constructing, stabilising and delivering the HR data ecosystem. XML schemas, fields, secure FTP pipelines, batch jobs, module configuration, rather than analysing data that already exists. It’s hands … Dayforce engineering and implementation. This is a technical delivery-focused role with immediate impact, stabilising key workstreams, resolving data and integration issues, as well as configuration, and helping the team push through a critical phase. The role blends two core responsibilities: taking full ownership of Dayforce ...

Principal Product Manager | AI & Data Orchestration | High-Growth Scale-Up 🚀🤖 Role: Principal Product Manager – AI & Data Orchestration Location: London - hybrid 3 days p/w in the office Salary: up to £150,000 + bonus + equity We’re partnered with a fast-growing tech scale … building platforms that let software, AI, and machines collaborate intelligently at scale. They automate complex workflows and orchestrate data and AI systems, creating capabilities that push the boundaries of what autonomous software can do. This is a high-impact role at the center of technical product innovation. ...

client, a well-established energy business in London, is hiring a Senior Data Engineer to support the next phase of their growth. The role is based in Mayfair and operates on a hybrid basis, with three office days and two remote days per week. Senior Data Engineer Role Purpose: We are looking for an engineer who is responsible for building, maintaining, and evolving the data pipelines and models click apply for full job details ...

clarity into code. What You'll Build Own the revenue engine. Build systems that parse usage-based contracts, automatically generate invoices from consumption data, and manage collections. Design APIs integrating with billing platforms, create LLM-powered contract interpretation, and build data pipelines handling complex signals. Shape ...

custom RTL designs to advanced compute and acceleration platforms . You’ll be involved in architecting and implementing complex systems in SystemVerilog , optimising data pipelines, and exploring new hardware technologies. The role is technical, hands-on, and focused on performance, efficiency, and robustness rather than domain knowledge … Design and develop FPGA and/or ASIC solutions as part of a cross-functional engineering team Implement and optimise RTL for complex data structures and processing pipelines Explore and evaluate new tools, technologies, and architectures Contribute to a fast-moving, modern hardware development environment Key requirements: 2+ ...

access and leverage property data. Our platform empowers property developers, land agents, architects, and planners with real-time insights, helping them make smarter, data-driven decisions when acquiring and developing land. In just five years, we’ve built one of the UK’s most advanced property data pipelines, integrating thousands of data sources and processing terabytes of information with less than 24-hour latency. Our cutting-edge platform is shaping the future of property intelligence 👩🏽 About the Role We’re looking for a skilled Senior Full-Stack Engine er to join our lean ...