226 to 250 of 275 Data Pipeline Jobs in London

with the dev team to guide the provision of Software Development for an exciting new AI product. Key Responsibilities:- Architect and build scalable data pipelines and infrastructure Design and maintain data ingestion, transformation, and storage architectures for operational and AI workloads. Develop and manage batch … Real Time data pipelines. Build and optimize systems for vector search, retrieval, and ML data pipelines. Ensure data reliability, security, and governance across the platform. Collaborate with AI and Back End engineering teams to support training, inference, and product features. Implement monitoring, observability ...

opportunity to work at the heart of a fast-paced trading environment, partnering directly with traders, analysts, and business stakeholders to deliver critical data and technology solutions that drive commercial decision-making. You'll join a high-calibre engineering team building and enhancing the systems, data … solutions supporting Front Office trading activities Work closely with traders and business users to understand requirements and deliver scalable solutions Design and enhance data pipelines, reporting solutions, and operational tooling Support and improve critical business applications and databases Contribute to performance tuning, automation, and continuous improvement initiatives Collaborate ...

systems using modern cloud-native and streaming technologies. Key Responsibilities Develop event-driven integrations and backend services Build connectors, event-processing services, and data pipelines Design scalable integration patterns, schemas, and event flows Develop CDC pipelines and resilient messaging solutions Improve observability through logging, metrics, and tracing Deploy … streaming technologies Enterprise system integrations and API design Agile development experience Strong communication and collaboration skills Desirable Skills Go and/or Python CDC pipeline development Azure cloud experience Observability tooling (Prometheus, Grafana, OpenTelemetry) Experience within regulated environments What's on Offer Hybrid working - 2 days per week ...

directly by Product Owners, Business Analysts, and Scrum Masters. Specifically, our core engineering focus sits at the intersection of trade booking architectures, static data management, and real-time connectivity workflows. This team is responsible for managing the continuous, asynchronous transaction data pipelines that ingest live trade ...

real-time production environments. You'll design and build scalable systems using Node.js and TypeScript, working across REST APIs, event-driven architecture, data pipelines, and distributed systems, ensuring performance, reliability, and scalability as the platform grows. This is a hands-on leadership role where you'll set technical … direction, mentor/manage engineers, and contribute to engineering culture, while collaborating closely with AI engineers, data teams, and product stakeholders to translate complex workflows into robust, production-grade systems. You'll be responsible for building and maintaining scalable backend services, APIs, and integrations, designing microservices and event ...

will facilitate research and development within the healthcare sector! This company's diagnostics visualisation platform allows medical researchers to visualise and analyse clinical data in order to develop new treatments that will massively improve the lives of patients. Key to this is the creation of secure multi-tenant … multi-region storage solution that allows swift and secure access to various types of data. Data security and integrity is of paramount importance, and the solution needs to be compliant with healthcare industry software standards. This role calls for strong AWS skills, rapid application development, and software development ...

incidents and investigations Implement platform-level changes to support incident response and remediation Support detection engineering including rule deployment, tuning, and validation Resolve data quality, alerting, and detection gaps impacting operational effectiveness Support automation and SOAR initiatives (e.g. Sentinel, Logic Apps) Collaborate with SOC providers to maintain SIEM … understanding of SIEM, XDR, and security platform integrations Experience in hybrid (on-prem and cloud) environments Strong troubleshooting skills across platforms, integrations, and data pipelines Experience with scripting/automation (PowerShell, Python or similar) Strong understanding of networking, cloud, and infrastructure fundamentals Experience in regulated environments (e.g. financial ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. What do you need … growth mindset and focus on delivering user and business value. Nice to Have: Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. What do we offer: Starting salary ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. What do you need … growth mindset and focus on delivering user and business value. Nice to Have Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. What do we offer Starting salary ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently. What do you need … growth mindset and focus on delivering user and business value. Nice to Have: Understanding of basic machine learning concepts and experience building data pipelines. Mentorship experience, helping team members grow and contributing to a culture of continuous learning. Qualifications Additional Information Interested? Find out more: How we work ...

will have significant autonomy to shape how we build, what technologies we adopt, and how we scale our systems to handle the data volumes and performance demands of a world‐class trading operation. You'll lead a team of talented engineers while staying deeply hands‐on with … best practices. Drive technical strategy and roadmap alongside product leadership, translating business requirements into robust, scalable technical solutions. Architect systems that handle high data volumes, real‐time streaming, and low‐latency interactions — the kind of challenges you’d find on a trading platform processing millions of events ...

complex multi-platform environment. Reporting directly to the CEO, you will act as the organisation's trusted technical voice, connecting systems, improving data integrity, strengthening vendor accountability, and helping create a scalable technology foundation for future growth. This is a hands-on role suited to someone who enjoys … build, test, and support integrations across Microsoft Dynamics CRM, Business Central, SaaS platforms, and other business systems. Develop and maintain API-based integrations, data pipelines, webhooks, and automated workflows. Troubleshoot integration issues, data discrepancies, and system connectivity challenges. Support platform upgrades, system enhancements, and data ...

London. This is a hands-on platform engineering role, focused on owning the software, tooling, web UI, and infrastructure layer used by data operators, ML engineers, and robotics engineers. You will be responsible for building and improving the internal applications and orchestration tooling that support robot data … collection, dataset workflows, model training infrastructure, and on-robot deployment. The Role You will: * Own and extend internal web applications used for robot data collection, review, QA, and dataset publishing* Build and maintain FastAPI backends, vanilla JavaScript frontends, CLI tooling, and supporting services* Improve recording workflows, state machines ...

Experis - ManpowerGroup is seeking an experienced Finance Data Design Lead for a critical insurance transformation programme in London. The role bridges architecture and engineering to implement finance and actuarial data solutions. The ideal candidate will design finance data models, define data pipelines ...

Slack updates to quarterly planning presentations. Identify and implement opportunities to unblock and accelerate delivery across your teams. Drive the build of automated data pipelines and BI tooling to minimise repetitive work and enable data self-serve across Send. Lead and coordinate cross-team analytics projects … shaping how we build and scale the function. WHAT YOU'LL BRING Technical Skills: 7+ years of experience in analytical roles with strong data analysis skills (SQL & Python). Experience delivering high-quality data products and self-serve analytics using tools like Airflow, dbt and Looker. ...

+ benefits Are you a Senior Backend Engineer who thrives on designing and scaling complex systems? Do you enjoy working on data-intensive platforms involving real-time pipelines, streaming architectures, and graph-based services? This is a hands-on role within a small, research-driven engineering team working … components from architecture through to production, while contributing to the overall technical direction. Key Responsibilities Design, build, and own backend services and data pipelines in Python Develop and operate streaming systems using Kafka or similar technologies Work with graph-based data structures and algorithms to support ...

Data Engineering Lead Certain Advantage are hiring for a Data Engineering Lead based in London. This role is on an initial contract till the end of the year and is required to be onsite 3 days a week. The successful candidate will lead the data acquisition function by defining ingestion strategy and building Azure-based data pipelines click apply for full job details ...

Develop and enhance algorithmic trading and automated bidding solutions Build scalable back testing frameworks and validation pipelines Integrate new datasets, products, and external data sources Take operational ownership of deployed systems (monitoring, reliability, improvements) Collaborate with engineering, data, and trading teams to deliver robust solutions Drive … Infrastructure: AWS, Docker, Docker Compose, AWS Fargate DevOps & CI/CD: Azure DevOps, CI/CD pipelines, Entra ID Monitoring: Datadog Optimisation: CPLEX Data & APIs: EATT API, AIDA What You'll Be Delivering AWS Fargate-based backtesting infrastructure Rust-based orchestration UI Integration of optimisation models (CPLEX) External ...

embed directly with Fortune 500 customers to ship deeply integrated AI agents—owning everything from agent design and evaluation to the backend services, data systems, and cloud infrastructure that make them production‐ready. You'll partner closely with our Forward Deployed and Product teams to make sure … losing intensity. Provide holistic technical oversight. Maintain a deep working understanding of every layer of what we ship—agents, models, evaluations, backend services, data pipelines, and cloud infrastructure—so you can review architectures, debug production issues, and raise the quality bar across every engagement. Partner with Product ...

performing global team is looking for an experienced Python Engineer to help build and enhance critical backend platforms supporting complex trading, risk and data workflows. This is a hands‐on role focused on scalable engineering, large datasets and delivering robust solutions within a fast‐paced financial environment. What … doing Building and enhancing Python-based backend services and data pipelines Working with complex financial and trading datasets to support reporting and analytics Developing APIs, automation tools and scalable processing solutions Collaborating with technical and business stakeholders across front‐office and risk functions What we’re looking ...

that will help us ship new products and features quickly while keeping risk and cost low. This will involve working closely with Product, Data Science, Fraud Prevention Analysts and our Fraud agents to strike the right balance between scaling quickly and mitigating risk efficiently.Key Responsibilities:- Build a fraud … engine for new products and features.- Collaborate with Product, Data Science, Fraud Prevention Analysts, and Fraud agents.- Strike the right balance between scaling quickly and mitigating risk efficiently.Requirements:- Hands-on experience with distributed systems, including microservices architecture and backend services supporting large-scale traffic.- Proven ability to deliver ...

taxonomies feed into AI and RAG systems Strong documentation discipline and ability to record modelling rationale clearly Experience collaborating with technical teams including data engineers and AI developers Highly Desirable: Experience with Protege, TopBraid or equivalent ontology tooling Familiarity with SHACL for constraint validation Background in financial services … private equity or similarly structured enterprise environments Understanding of knowledge grounding principles for large language models Experience with linked data architectures and triple store platforms The Context: Thebes Group is an optimisation company specialising in AI-enabled transformation. We help organisations improve workflow, reporting, information management, and operational ...

join their high-performing global team. You will be responsible for building and enhancing critical backend platforms that support complex trading, risk, and data workflows. The ideal candidate will have strong Python development skills and be familiar with SQL, working on financial datasets. This role offers an exciting ...

iterative "Observe, Think, Act" loops for AI agents. Define guardrails: Establish data requirements, exceptions, and human-in-the-loop checkpoints. 2. Pipeline & Value Management Qualify use cases: Evaluate enterprise bottlenecks to qualify agentic automation opportunities. Manage pipelines: Prioritize the high-value agentic AI transformation roadmap. Design validation … CrewAI. LLM Foundations: Strong grasp of Large Language Models, prompt engineering, and semantic memory patterns. Tool-Use Integration: Clear understanding of function calling, data pipelines, and external API connectors. Business Analysis Expertise Agile Frameworks: Proven success working inside Agile or Scrum software development lifecycles. Process Mapping: Mastery ...

feature depth, specifically tailored to meet the sophisticated needs of larger business entities WHAT YOU’LL BE DOING Derive actionable insights from data to drive the team's strategy and inform product decisions. Establish clear goals, define measurable KPIs, and develop compelling narratives to help your team understand … fast decision making with high quality analysis, raising the bar for a/b testing and helping us to iterate faster. Build automated data pipelines and dashboards to minimise repetitive tasks and allow data self-serve. Take ownership of complex cross-team projects to help unblock ...