76 to 100 of 107 Data Pipeline Jobs in the City of London

zero and own the entire technical build. You'll work across the stack — frontend, backend, infrastructure — while embedding clinical-grade reliability, data privacy, and AI capabilities from the ground up. What you'll own: Build end-to-end product features across the full stack (frontend, backend, infra) Integrate … shipped and scaled full stack products Strong backend (Node.js, Python/Flask, FastAPI) and frontend (React, Next.js, Vue) fundamentals ML/data science proficiency: Python, SQL, pandas, scikit-learn, PyTorch/TensorFlow Experience with cloud platforms (AWS, GCP, Azure) and containerisation (Docker, Kubernetes) Proven ability to build data ...

work on cutting-edge AI technologies and contribute to transformative projects across multiple domains. In this role, youll help design and build modern data pipelines that bring together information from a variety of systemsmaking data accessible, trustworthy, and ready for intelligent analytics and AI solutions. … closely with teammates across disciplines and have the opportunity to learn from experienced engineers and leaders. Key responsibilities include: Supporting and contributing to data engineering projects, helping ensure delivery within scope and timelines. Working alongside supportive team members to develop and maintain data pipelines and infrastructure. ...

week in our Waterloo office Experience level: At least five years in commercial software engineering 🚀 About Orchestra Orchestra is an AI-native data pipelining platform building the future of data orchestration and observability . We have built a declarative framework allowing data engineers … explicitly declare how their data pipelines behave. Think CI/CD but for data teams! Backed by VCs from San Francisco, New York and London with angels from across the data space and beyond. 👷 Engineering at Orchestra We care deeply about our users—their ...

Data Engineer | London (Hybrid) | Financial Services | £80,000-£100,000 💸 I’m currently partnering with a well-established UK Financial Services provider that supports hundreds of thousands of customers with accessible credit products and has an excellent reputation in the market. They’re looking for an experienced Data … Role You’ll design, modernise and optimise scalable database solutions, with a focus on: AWS RDS (SQL Server & Aurora PostgreSQL) Building and operating data pipelines (incl. Snowflake integration) Leading SQL Server migrations to AWS Performance tuning, monitoring & optimisation You’ll work closely with cloud, engineering and application teams ...

deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions … modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global ...

accessible financial markets for all types of investors, this is a high-impact opportunity to be part of a company redefining financial data infrastructure from the ground up. Responsibilities Design and implement scalable, high-performance data pipelines Develop backend services and APIs to support data processing and analytics Build integrations with external vendors and market data providers Tech Stack Python AWS (Lambda, ECS, CloudFormation, S3) GitHub Actions (CI/CD) Vue.js (optional frontend involvement) Requirements 2+ years’ experience as a Data Engineer or Backend Engineer Proficiency in Python Experience ...

processes and testing pipelines to support quick iterative development and system stability. Work on ML model development with our team to build robust data pipelines and deploy ML models. Analyse large corpora of data and build real-time recommendation systems. Work with large amounts of data ...

Python Software Engineer – Data & Research Platforms Client: Scientific Quant Fund Compensation: Up to £250,000 Base + Bonus Location: London (Hybrid) Overview A scientific quant fund is seeking an experienced Python Software Engineer to join a growing engineering team focused on building large-scale data … engineering quality, scalability, and reproducibility in research. The Role As a Python Software Engineer, you will design and build distributed systems and data tooling that support quantitative research at scale. Key responsibilities include: Designing and developing Python-based data and research platforms for large-scale analysis ...

experience in Python, AWS cloud services, and modern API development. This role offers the chance to work on impactful projects including business automation, data processing systems, and modern web applications. In this role you will collaborate closely with engineering teams and business stakeholders to design and build backend … will work with technologies such as Python, AWS services including Lambda, EC2, S3, RDS, and API Gateway, as well as SQL databases and data processing libraries. You will also contribute to front end development using React where required and support integrations with Microsoft Office workflows and reporting systems. ...

architecture discussions Develop new features and maintain functionality on an existing enterprise software product Coordinate workflows with analysts, developers, and DevOps engineers Implement data audit trails, archiving processes, batch workflows and system recovery Integrate external APIs and manage secure data flow with SQL Server and related … Microsoft Dynamics CRM or similar systems Exposure to Azure services: Service Bus, Key Vault, Storage, App Services Experience with ETL, batch processing, or data pipelines We welcome all qualified persons to apply regardless of race, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability ...

deliver technical security work packages in support of wider organisational security strategies. Advise on secure adoption of emerging technologies including AI models, data pipelines, automation, and cloud‐native architectures. Translate complex cyber risks into clear, actionable insights for non‐technical audiences. Identify and mitigate AI‐specific threats such … model abuse, data leakage, prompt injection, bias, and automation risks. Act as the organisation’s technical security subject‐matter expert. Provide escalation support during cyber incidents Lead and oversee technical assurance activities, including IT Health Checks and security reviews. Champion shift‐left security and secure‐by‐design principles ...

phases, resource plans, timelines, and risk frameworks 🏗 Design AI Architectures Translate requirements into scalable AI/ML solutions Design architectures covering: Model development Data pipelines MLOps and monitoring Cloud integration (Azure, AWS, or GCP) Validate feasibility with engineering and delivery teams ✍️ Lead Tender & Bid Responses Own technical sections … models) Exceptional writing, storytelling, and stakeholder engagement skills Experience in consultancy, systems integration, or AI solution environments is highly desirable Strong understanding of data governance, security, and ethical AI 🌍 Why Join? Be at the forefront of AI transformation across sectors Influence high-value strategic deals Work with senior ...

prominent organisation in the technology sector, is currently seeking an AWS Site Reliability Engineer (SRE) to support and scale a cloud-native data platform built on AWS, Snowflake, and Databricks. This role focuses on enhancing reliability through automation, disaster recovery testing, resiliency engineering, observability, and proactive SLO/…/CD. Lead resiliency and disaster recovery planning, including regular DR drills, failure testing, and recovery validation across AWS and data platform components. Define, implement, and manage SLIs, SLOs, and SLAs for critical data pipelines and platform services; utilise error budgets to guide reliability improvements. Build ...

Salary : up to £200k base + equity We are partnered with a high-growth AI-driven platform that helps large enterprises automate complex, data-heavy workflows. The company is well-funded with. over $90M from top VC's, scaling rapidly, and already working with globally recognised organisations … Engineer , you’ll help design and scale the backend systems behind a sophisticated AI platform. You’ll work on high-performance services, complex data pipelines, and secure infrastructure, collaborating closely with ML, product, and platform teams. This is a hands-on senior role with real influence over architecture ...

week on site Existing SC or DV Clearance is required National Security Sector Tech: JAVA/C++/Python - or Devops/Data Background An exciting opportunity has arisen for a Software Engineer to join a cutting-edge team developing impactful, mission-driven technology. The role offers … chance to contribute to projects such as AI-powered tools for analysts and operators, secure data pipelines, and innovative prototypes that explore new frontiers in software capability. You’ll become part of a tight-knit, highly capable engineering group that values independence, precision, and tangible outcomes. This ...

organisation continues to scale its AI capabilities, they are looking for someone to lead and shape the technical direction of their data and NLP initiatives. The Role As a Staff Applied Scientist, you will act as the technical lead for data and NLP initiatives , driving improvements … recall) • Optimising search algorithms to deliver fast and accurate results • Designing and implementing agentic AI workflows powered by LLMs • Building and maintaining scalable data pipelines • Leading technical decision-making across ML and NLP projects Requirements • 8+ years of commercial engineering and/or data science experience ...

industry-leading, AI-first technology platform in the intellectual property space is hiring a Staff-Level ML Engineer to lead all Data and NLP initiatives. This company was an early adopter of Large Language Models and is building advanced, agentic AI workflows that autonomously answer complex research questions. … models with cutting-edge NLP techniques to deliver high-precision search and insights at scale. The Role As the technical lead for Data & NLP, you will: Own and improve search performance (precision & recall) Optimise large-scale search algorithms for speed and relevance Design and implement agentic LLM workflows ...

Develop or apply cutting-edge techniques across: LLM prompt engineering & optimisation Graph-based and personalised information retrieval Contextual search and recommendation systems Synthetic data pipelines & LLM evaluation frameworks Build scalable methods and prototypes that can transition into real product environments. Analyse and document methodologies with the potential … publication in respected AI research venues. Support dataset creation, feature exploration and data preparation workflows. Deep-dive into your research area and share knowledge with the immediate team. Required Qualifications PhD/Doctorate or Currently Pursuing in Computer Science, Machine Learning, Artificial Intelligence, or a related field. Strong ...

pipelines for large, complex datasets • Infrastructure for distributed training and high-performance compute workloads • Model deployment systems, including inference services and batch pipelines • Data pipelines for ingestion, transformation, and versioning of large datasets • Monitoring, observability, and evaluation systems for ML performance in production This is a deeply technical … strong Python skills and experience building backend or distributed systems • Has worked with ML frameworks such as PyTorch, TensorFlow, or JAX • Understands training pipelines, data workflows, and model deployment • Has experience with cloud infrastructure (AWS/GCP) and containerization (Docker/Kubernetes) • Thinks in terms of systems, scalability ...

thrive in a high-performance startup environment. Key Responsibilities Design and build full-stack integrations connecting AI agents to customer systems Develop data pipelines and “glue code” for production deployments Run technical architecture sessions with customer stakeholders Act as the product feedback loop — surfacing bugs, bottlenecks, and feature … opportunities Manage technical relationships with IT, security, and data teams Write clean, maintainable, well-documented code Support continuous platform improvement and occasional core platform work What We’re Looking For 3+ years’ experience in Forward Deployed, Solutions, or Full-Stack Engineering Experience within a highly regulated Industry such ...

Technical Product Manager (Indices & Market Data) £110,000 - £125,000 + package London - Hybrid working model My leading FinTech client are looking for a talented and motivated individual with gravitas to own technical product areas across the platform (data pipelines, index calculation engines, internal tooling … complex data/platform products Strong technical background; comfortable discussing and reviewing: APIs and service boundaries, Data schemas and contracts, Pipeline architecture and failure modes, System design trade-offs. Domain experience in indices, capital markets, equities, derivatives, or other quantitative products with a track record ...

Python Engineer Sports Trading What you’ll tackle Translate data-flow headaches into buildable tech projects, managing data pipelines Python engineering to stand-up analytics services, REST APIs and lightweight front-ends. Data ingestion (SQL, files, feeds), business logic, web/UI, CI pipelines … with quants, ask clarifying questions, iterate live and keep comms flowing. What you need 1 + years building production-grade Python systems for data-heavy businesses; comfortable with tests, version control and optimisation. Confident SQL , exposure to REST and messaging (Rabbit, Kafka, etc.), and enough Linux to troubleshoot ...

multi-award-winning research agency in mid-transformation. Were rebuilding our processes from the inside out, including using Displayr to streamline our data pipeline. The Role Weve moved to Displayr, and need someone who can use it with confidence, curiosity and creativity. You will be the connection between … teams: part Displayr specialist, part problem-solver, part data scientist. This is a role at the coal-face of our work. Youll manage an ever-shifting workload, keeping projects on track amid changing priorities and pipelines. Key Responsibilities Consistently delivering clean, accurate tables & reports Help us to maximise ...

standards, and regulatory requirements. Key Responsibilities: Enterprise AI Architecture & Roadmap: Define and maintain the AI reference architecture and implementation roadmap, covering LLM platforms, data pipelines, knowledge graphs, APIs, microservices, and event-driven architectures across hybrid cloud environments. Governance & Standards: Establish AI governance frameworks, policies, and playbooks for model … development, data usage, security, ethical AI, and compliance. Strategic Leadership: Provide architectural leadership and direction across delivery teams, ensuring consistent adoption of AI standards and patterns. Platform Integration: Guide the integration of AI capabilities into core enterprise platforms and processes, enabling reusable AI services and accelerators. Security & Risk ...

Senior/Lead Go Engineer – 📍 London | Full-Time | Fintech/Crypto I'm partnered with a leading global media and data platform in the digital asset space, who are looking for a Senior or Lead Go Engineer to join their London-based engineering team. This is a hands … opportunity to work with high-throughput systems delivering real-time market data that powers the next generation of finance and investing. You’ll play a key role in designing, building and optimising systems that aggregate, process and deliver real-time cryptocurrency and financial market data. The position will ...