201 to 225 of 300 Data Pipeline Jobs in London

scratch. The Role You will work directly with the technical co-founders to bring structure, scalability, and best practices across their ML and data setup, ensuring it is ready to support multiple enterprise deployments. Key responsibilities: * Audit current ML architecture, pipelines, and MLOps practices * Identify gaps in documentation … clear structure across model development, versioning, and deployment * Improve training and retraining workflows * Strengthen model monitoring, evaluation, and performance tracking * Support productionisation and inference pipeline improvements * Ensure systems are maintainable for future hires * Provide a clear, pragmatic path from pilot to production You will also contribute to ongoing analytical ...

technical roadmap and improving the Software Development Life Cycle (SDLC). Key Responsibilities: Design, develop, and maintain high-performance backend services for complex data processing systems Architect scalable solutions for high-volume calculations and data pipelines Optimize database schemas, write efficient SQL queries, and improve database …/CD pipelines and version control systems Experience with Python is a plus Qualifications & Experience: Bachelors or Masters degree in Computer Science, Data Science, Information Technology, Electrical Engineering, or a related field (or equivalent practical experience) Experience in a regulated industry, preferably within banking or financial services Proactive ...

technical roadmap and improving the Software Development Life Cycle (SDLC). Key Responsibilities: Design, develop, and maintain high-performance backend services for complex data processing systems Architect scalable solutions for high-volume calculations and data pipelines Optimize database schemas, write efficient SQL queries, and improve database … pipelines and version control systems Experience with Python is a plus Qualifications & Experience: Bachelor’s or Master’s degree in Computer Science, Data Science, Information Technology, Electrical Engineering, or a related field (must have) Experience in a regulated industry, preferably within banking or financial services Proactive mindset with ...

totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion … Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills ...

implement scalable, reliable, and performant backend systems. Develop and maintain microservices, containerized applications, and supporting infrastructure. Solve complex problems with practical solutions and data-driven approaches. Contribute to architecture discussions, code reviews, and testing strategies. Identify performance or reliability bottlenecks and propose improvements. Required Qualifications & Experience Strong experience … system design and desire to build elegant, maintainable solutions. General understanding of supporting infrastructure: git, microservices, containers, etc. Comfortable working with numbers and data, with or without prior trading/finance experience. Experience with writing unit and integration tests and maintaining CI/CD pipelines. Preferred Qualifications & Experience ...

ensure solutions work in real-world environments. Key Responsibilities: Deploy and configure software solutions in client environments Integrate systems across cloud, APIs, and data pipelines Troubleshoot and resolve technical issues on-site or remotely Collaborate with product and engineering teams to improve deployments Support rollout projects and large … system integration, and microservices Client-facing experience or delivery-focused roles Strong problem-solving and communication skills Desirable: Exposure to AI, ML, or data platforms DevOps, CI/CD, or infrastructure as code experience Consulting or technical delivery background Location: UK Hybrid, with occasional client visits ...

systems (LangGraph or similar) Defining best practices across DevOps, CI/CD, and engineering standards Integrating Power Platform tools with enterprise systems and data sources Shaping technical roadmaps, architecture patterns, and reusable frameworks Driving observability, performance, and continuous improvement Collaborating with cross-functional teams including product … experience with GenAI/LLMs and machine learning Experience building AI agents/multi-agent systems Knowledge of APIs, event-driven systems, data pipelines, and security best practices Exposure to Power Platform (Power Apps, Power Automate, Power BI) is a plus Strong stakeholder management and ability to work ...

Your Responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation, and storage. Develop, finetune, benchmark … prompt management, evaluation, and GenAI operations. Collaborate with cross-functional teams to integrate GenAI capabilities into production systems and ensure high-quality data, governance, and operational reliability Your Profile: Strong experience with PySpark, distributed data processing, and largescale ETL/ELT pipelines. Strong SQL expertise including ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

actual business impact. This one sits right in the middle. We’re hiring a Forward Deployed Engineer for a fast-growing B2B data SaaS company transforming how sales teams define and target their markets. TL;DR Location: London (hybrid) Setup: 2-3 days in office Language: English Focus … Data modelling, integrations, customer delivery Stack: CRM (Salesforce/HubSpot), APIs, JSON, data warehouse Comp: ~£65-75k base + bonus Growth: 315% YoY The role You’ll work directly with customers and commercial teams to build and deliver custom datasets that drive real revenue outcomes. ...

models, and scalable API platforms. Key Responsibilities Own the technical strategy and execution across the company’s core products, including real-time APIs, data pipelines, and LLM-powered analytics. Collaborate closely with Product and Data Science to deliver a forward-thinking technology roadmap. Lead, mentor … high-performing engineering team (currently ~10), nurturing a culture of ownership, speed, and technical excellence. Make key architectural decisions, ensuring system scalability and data infrastructure performance. Maintain high engineering standards while remaining close to critical technical choices. Recruit top talent and build a strong, inclusive team culture. Oversee ...

Database Data Engineer | London (3 days a week onsite) | up to £100,000 Peaple Talent have partnered with a forward-thinking financial services organisation transforming access to credit across the UK. With a strong reputation for customer trust and innovation, they’re now looking for a Data Engineer with deep database expertise to play a critical role in modernising and scaling their data platforms. 💻 The Role This is a database-heavy Data Engineer position where you’ll take ownership of designing, optimising and evolving production-critical systems across AWS. Particularly using ...

reconciliation. Designing and implementing API integrations across internal and third‐party systems. Developing in‐house solutions to replace outsourced or legacy technology. Creating data pipelines that improve reporting and analytics for portfolio managers. Owning projects end‐to‐end — from gathering requirements through to deployment. What you’ll need … Front‐end experience with Vue.js , React , or Angular . Experience with databases such as SQL Server, Databricks, or Azure SQL. Strong understanding of data structures, automation, and workflow optimisation . Familiarity with Git/CI/CD pipelines . Ability to operate independently in a fast‐moving, high ...

Role In this role, you will define the architectural blueprint and technology foundations for AI driven solutions that transform how customers in dynamic, data intensive industries operate, scale, and innovate. You will design robust, future ready AI architectures that enable automation, advanced analytics, and intelligent decision making across … complex digital transformation programmes. With access to cutting edge AI frameworks, high performance computing environments, and modern data platforms, you will guide engineering and data science teams in building secure, scalable, and ethical AI systems. This role empowers you to shape end to end AI ecosystems ...

NATO. Key skills Dynamics 365 Finance & Operations (F&O) - customisation, configuration, and support X and C# development for extensions and integrations Data Entities and Data Management Framework (DMF) Power Platform - Power Automate, Power Apps, Dataverse Integration design - RESTful APIs, virtual tables, external systems Finance and procurement … build integrations between F&O and external systems Develop automated workflows and approval processes to support compliance and efficiency Manage and optimise data entities and data pipelines for reporting and synchronisation Extend system functionality using X and C# following best practices Support full life cycle implementations ...

scalability, and security best practices Collaborate cross-functionally with Product, Design, and Frontend teams Contribute to architectural decisions and mentor other engineers Develop data-driven backend services and pipelines Support production systems and deployments within a small, high-performing team Qualifications 5+ years of professional software engineering experience … Experience with LLM APIs (e.g., OpenAI, Anthropic, Gemini) and LangChain Background in AI/ML (e.g., generative models, GANs, diffusion, regression) Experience building data pipelines and data-driven systems Familiarity with workflow orchestration tools (e.g., Temporal, Prefect) Why Join Be part of a fast-growing company ...

Role We are partnering with a global tech and media giant to hire a Senior Data Engineer. You will build and scale the massive data pipelines that track how millions of users interact with the platform across smart TVs, gaming consoles, and major social media apps. … What You'll Do Architect, build, and maintain complex, high-volume data pipelines. Act as a technical leader to set engineering standards and best practices. Partner with Product Managers and Data Scientists to turn business requests into reliable data models. Mentor junior engineers ...

they work, with an open culture that values pragmatism, trust, and delivery over hierarchy. The Role You will sit within the Data Science function, reporting directly to the Head of Data Science and working closely with senior stakeholders across the business. Responsibilities include: Owning … delivery of an automated LAV and NAV calculation platform Automating the ingestion of structured and unstructured data from multiple sources including reports, internal systems, APIs, Excel files, and PDFs Designing and implementing robust data pipelines and workflows Building and maintaining SQL based data models ...

join a growing advanced analytics and AI capability. This is a hands-on engineering role building and deploying ML solutions in highly secure, data-rich environments , where work directly contributes to national-level outcomes. Why this role? This is an opportunity to work on real-world, high-impact … environments Working with large, complex datasets in secure infrastructures Supporting the development of AI-driven capabilities for mission-critical systems Collaborating with engineers, data scientists, and security specialists Contributing to the full ML lifecycle from data prep to deployment What you'll be doing Develop ...

Principal AI/Data Engineer (Contract): Length: 3 months initally (extension is likely) Start Date: ASAP Location: London, Hybrid (1 day per week) Pay Rate/Determination: £525-575 p/d | Outside IR35 About: Opus is supporting a UK-based digital consultancy partnering with organisations to design … scale high-impact digital and AI-driven products, with a strong people-first culture. The role: A hands-on Principal AI/Data Engineer contract to assess, shape and deliver improvements to a live AI platform across two critical workstreams.You'll be responsible for: Assessing the current ...

quality, security, testing, and deployment. Lead key technical initiatives, contributing code and architecture reviews. Drive integration of software with hardware systems, sensors, and data pipelines. Management & Team Leadership Build, lead, and mentor a multidisciplinary engineering team. Establish effective workflows for development, QA, deployment, and iteration. Foster a collaborative … Docker, Cloudformation, Pulumi, CI/CD with GitHub Actions ML/AI: PyTorch, TensorFlow, scikit‐learn, MLflow for experiment tracking, Zenml for ML pipelines Data: PostgreSQL, DynamoDB, data pipelines with Zenml (We’re open to evolving the stack and expect you to influence technical decisions ...

optimisation of transaction monitoring systems. The successful candidate will play a key role in delivering strategic change across financial crime systems, supporting data analysis, system enhancements, and regulatory-driven initiatives. You will work closely with Compliance, Operations, and Technology teams to ensure systems are robust, scalable, and aligned … with evolving regulatory expectations. Key Responsibilities Support delivery of Financial Crime transaction monitoring transformation initiatives Perform advanced data analysis across payment, client, and screening data sets Support audit requests, regulatory reviews, and remediation activities Assist with system upgrades, regression testing, and new technology evaluations (RFPs/ ...

across architecture, infrastructure, integrations, and backend systems. ABOUT THE ROLE Your Impact Architect and implement core systems: cloud infrastructure, backend services, APIs, and data pipelines Build secure, scalable, and reliable components ready for real-world operational environments Lead integrations with external systems and support early data … tooling, documentation, and technical processes from the start Set up observability, monitoring, and performance systems Jump in wherever needed, from quick scripts and data cleaning to debugging production issues What You Bring 5+ years of engineering experience with strong architecture/complex backend systems experience Deep hands ...

Designing, building, and scaling full stack applications Owning system architecture, deployment, and engineering standards Integrating AI features into products using modern APIs and data-driven approaches Improving CI/CD, environments, and overall delivery capability Tech environment - Not set in Stone Frontend: React, Next.js, TypeScript (or similar) Backend … Node.js (Express, NestJS) or Python (FastAPI, Django) (or similar) APIs: REST, GraphQL (or similar) Databases: PostgreSQL, MongoDB (or similar) AI/Data: Experience integrating AI/ML features via APIs (e.g. OpenAI, Anthropic or similar) Exposure to data pipelines, inference workflows, or retrieval-based systems ...

Title: Data Scientist (Generative AI & LLMs) Location: London(Hybrid role) Employment Type: 12 months contract Role Overview We are seeking a versatile Data Scientist to lead the end-to-end development of AI solutions, with a heavy focus on Generative AI and Large Language Models (LLMs … . You will bridge the gap between business requirements and technical execution, overseeing the entire lifecycle from initial scoping and data engineering to model deployment and prompt optimization. Key Responsibilities Business Alignment: Partner with stakeholders to define project scope, translate business problems into technical specs, and establish clear ...