276 to 292 of 292 Data Pipeline Jobs in London

the offices in central London Responsibilities Support the analytics needs of the business by building automated scalable reporting solutions focused on customer retention. Create holistic dashboards by combining data from both internal and external data sources Identify gaps in the data capture strategy related to customer behaviour and collaboratively implement enhancements. Go one step … further and provide actionable insights and recommendations related to key customer retention measures. Qualifications Previous experience working in data in a BI analyst role or similar, with a focus on customer retention or lifecycle analysis. Strong ability analysing and combining large SQL datasets. Nice to have: Business reporting tools such as Tableau and Qlik. Python/R. Experience … of working with and building data pipelines. Benefits Long contract Global company Free breakfast on site More ❯

My client within Venture capital is looking for a data engineer to join their team.The role will be working maintaining & modernising data pipelines. Requirements Python Azure, CI/CD Airflow, DBT Docker GitHub, Azure DevOps LLM Experience desirable Contract: 12 Months Rate: £500-600 Via Umbrella Location: London - 3 days per week in the office. If More ❯

My client within Venture capital is looking for a data engineer to join their team. The role will be working maintaining & modernising data pipelines. Requirements Python Azure, CI/CD Airflow, DBT Docker GitHub, Azure DevOps LLM Experience desirable Contract: 12 Months Rate: £(Apply online only) Via Umbrella Location: London - 3 days per week in the More ❯

and maintain scalable microservices that power our compliance platforms. Develop tools and systems for sanctions screening, transaction monitoring, and regulatory reporting. Optimize backend processes for performance, reliability, and data integrity. Enhance tooling, analytics, and reporting used by internal compliance stakeholders. Collaborate with cross-functional teams to understand regulatory processes and deliver technical solutions. Participate in on-call rotations … development with at least 2 server-side languages - Java being must have. Experience working in Kubernetes environment. Proven experience with microservices architecture and scalable, distributed systems. Proficient in data technologies like MySQL . Experience with batch processing , data pipelines , and data integrity practices. Familiarity with AWS services (e.g., RDS, Step Functions, EC2, Kinesis) is More ❯

foot traffic and vehicle flow to energy consumption and city-wide systems performance. We’re looking for a Software Engineer with strong Python skills and experience working alongside data scientists to optimise and productionise ML models . The core simulation engine is built in C++ , so any experience with C++ in high-performance environments is a major plus. … Key Responsibilities: Work with data science teams to optimise predictive models and deploy them at scale Build robust, scalable services in Python , with performance-critical elements in C++ Contribute to the development of a digital twin platform to simulate and forecast city infrastructure outcomes Collaborate across simulation, data, and software teams to turn prototypes into production … ready solutions (Bonus) Integrate streaming data pipelines using Kafka to support real-time modelling Experience: Strong commercial experience in Python engineering Exposure to C++ , especially in simulation, modelling, or high-performance systems Proven track record working closely with data scientists to bring models into production Background in simulation-heavy domains (e.g. finance, oil & gas, energy, transport More ❯

foot traffic and vehicle flow to energy consumption and city-wide systems performance. We’re looking for a Software Engineer with strong Python skills and experience working alongside data scientists to optimise and productionise ML models . The core simulation engine is built in C++ , so any experience with C++ in high-performance environments is a major plus. … Key Responsibilities: Work with data science teams to optimise predictive models and deploy them at scale Build robust, scalable services in Python , with performance-critical elements in C++ Contribute to the development of a digital twin platform to simulate and forecast city infrastructure outcomes Collaborate across simulation, data, and software teams to turn prototypes into production … ready solutions (Bonus) Integrate streaming data pipelines using Kafka to support real-time modelling Experience: Strong commercial experience in Python engineering Exposure to C++ , especially in simulation, modelling, or high-performance systems Proven track record working closely with data scientists to bring models into production Background in simulation-heavy domains (e.g. finance, oil & gas, energy, transport More ❯

backend development. The company works exclusively with modern cloud technologies and has a strong culture of collaboration, mentorship, and continuous improvement. You’ll also gain valuable exposure to data ingestion pipelines and Microsoft Fabric, with training provided on the job. The Role Build and enhance product features across the full stack Work with technologies such as .NET … practices and write clean, maintainable code Take part in daily stand-ups, code reviews, and technical discussions Support improvements based on client and team feedback Gain exposure to data ingestion processes and Microsoft Fabric as part of your growth journey What We’re Looking For Exposure to C#/.NET and a frontend framework like Vue.js or React … Familiarity with SQL and Git version control Strong communication skills and a collaborative mindset Willingness to learn modern cloud tools, DevOps practices, and data technologies A curious, problem-solving attitude Nice to Have Experience with AG Grid, GitHub Actions, or Entity Framework Interest in cloud data pipelines or Microsoft Fabric Side projects, internships, or demonstrable interest More ❯

role at the intersection of AI, digital transformation, and public service. You'll be responsible for technical design and strategic direction of complex AI systems, spanning real-time data pipelines, automation, machine learning models, and legacy system integration. This role is mapped to the Government Digital and Data Profession: Lead Technical Architect and will help us … communities, helping stakeholders understand and engage with complex AI systems. Make architectural decisions and assure technical quality across design, build and operate phases. Collaborate with policy, digital delivery, data science and engineering teams to align AI solutions with user needs and departmental goals. Embed robust security, ethical and governance practices into AI systems by design. Mentor other architects … technologies. 🧠 Essential Skills and Experience You’ll be expected to operate at or above practitioner or expert level across the following skill areas, as defined by the Digital, Data and Technology (DDaT) Profession Capability Framework: Architecture throughout the technical lifecycle – Expert Design and assure solutions from prototype through to production. Strategy design – Practitioner Align architecture with digital and More ❯

role at the intersection of AI, digital transformation, and public service. You'll be responsible for technical design and strategic direction of complex AI systems, spanning real-time data pipelines, automation, machine learning models, and legacy system integration. This role is mapped to the Government Digital and Data Profession: Lead Technical Architect and will help us … communities, helping stakeholders understand and engage with complex AI systems. Make architectural decisions and assure technical quality across design, build and operate phases. Collaborate with policy, digital delivery, data science and engineering teams to align AI solutions with user needs and departmental goals. Embed robust security, ethical and governance practices into AI systems by design. Mentor other architects … technologies. 🧠 Essential Skills and Experience You’ll be expected to operate at or above practitioner or expert level across the following skill areas, as defined by the Digital, Data and Technology (DDaT) Profession Capability Framework: Architecture throughout the technical lifecycle – Expert Design and assure solutions from prototype through to production. Strategy design – Practitioner Align architecture with digital and More ❯

both new and existing secure transformation projects. You’ll play a key role in architecting and maintaining scalable, security-first cloud infrastructure using AWS, Kubernetes, and real-time data streaming pipelines. This is a hands-on role for engineers who thrive in high-assurance environments and enjoy driving automation and DevSecOps best practices. What’s on Offer Highly … impact on secure solutions shaping UK defence programmes What You’ll Be Doing Designing and supporting secure AWS multi-account environments Driving automation, container orchestration, and real-time data pipelines Leading initiatives in infrastructure-as-code, CI/CD, and platform monitoring Enabling robust security practices across DevOps delivery teams Core Skills & Experience Strong experience with AWS MSK More ❯

both new and existing secure transformation projects. You’ll play a key role in architecting and maintaining scalable, security-first cloud infrastructure using AWS, Kubernetes, and real-time data streaming pipelines. This is a hands-on role for engineers who thrive in high-assurance environments and enjoy driving automation and DevSecOps best practices. What’s on Offer Highly … impact on secure solutions shaping UK defence programmes What You’ll Be Doing Designing and supporting secure AWS multi-account environments Driving automation, container orchestration, and real-time data pipelines Leading initiatives in infrastructure-as-code, CI/CD, and platform monitoring Enabling robust security practices across DevOps delivery teams Core Skills & Experience Strong experience with AWS MSK More ❯

both new and existing secure transformation projects. You’ll play a key role in architecting and maintaining scalable, security-first cloud infrastructure using AWS, Kubernetes, and real-time data streaming pipelines. This is a hands-on role for engineers who thrive in high-assurance environments and enjoy driving automation and DevSecOps best practices. What’s on Offer Highly … impact on secure solutions shaping UK defence programmes What You’ll Be Doing Designing and supporting secure AWS multi-account environments Driving automation, container orchestration, and real-time data pipelines Leading initiatives in infrastructure-as-code, CI/CD, and platform monitoring Enabling robust security practices across DevOps delivery teams Core Skills & Experience Strong experience with AWS MSK More ❯

both new and existing secure transformation projects. You’ll play a key role in architecting and maintaining scalable, security-first cloud infrastructure using AWS, Kubernetes, and real-time data streaming pipelines. This is a hands-on role for engineers who thrive in high-assurance environments and enjoy driving automation and DevSecOps best practices. What’s on Offer Highly … impact on secure solutions shaping UK defence programmes What You’ll Be Doing Designing and supporting secure AWS multi-account environments Driving automation, container orchestration, and real-time data pipelines Leading initiatives in infrastructure-as-code, CI/CD, and platform monitoring Enabling robust security practices across DevOps delivery teams Core Skills & Experience Strong experience with AWS MSK More ❯

and manufacturing teams. A familiarity with production test time optimisation in semiconductor or optical device environments, is also required to succeed in this role. Exposure to cloud-based data pipelines for large-scale test data processing. As the successful Systems Optimisation Engineer, you should have achieved a Degree in Computer Science, Electrical/Electronic Engineering, Applied More ❯

product strategy underpins everything we do and that leaders are empowered to guide decisions in collaboration with cross-functional teams. As we scale, we aim to foster strong, data-driven product thinking to tackle both customer-facing and internal challenges. About the role As Zego's first dedicated Lead AI Product Manager, you'll drive the strategy and … execution of our ambitious AI roadmap. This role reports to the Head of Product and partners closely with technical leads across Data, Engineering, and business stakeholders to deliver impactful AI solutions. What you'll be doing Shape and prioritise AI strategy - Identify high-value ML/AI opportunities across Zego, rank them by impact and feasibility, and build … business problems rigorously, confirm suitability for AI solutions, establish clear success metrics, and outline high-level solution approaches. Drive execution and iteration - Run tight feedback loops with Engineering, Data Science, and Ops teams to deliver quickly and iterate based on continuous learning and feedback. Own internal launches and communications - Manage rollouts, drive adoption, proactively communicate AI capabilities and More ❯

with stakeholders across business units to translate integration needs into technical solutions. Technical Delivery Design, develop, and maintain workflows using Informatica iPaaS (IICS). Implement and manage Master Data Management (MDM) solutions. Oversee development and deployment of APIs, data pipelines, and real-time integrations. Ensure robust error handling, logging, and monitoring. Governance & Compliance Establish and enforce … data integration standards, security, and compliance requirements. Innovation & Optimisation Evaluate emerging technologies to strengthen integration capabilities. Optimise performance and resolve bottlenecks proactively. Qualifications Bachelor's or Master's degree in Computer Science, Information Systems, or related field. 7+ years of integration development experience, with 2+ years in a leadership role. Proven expertise in Informatica IICS and Informatica MDM. … Strong knowledge of data modelling, API management, and cloud integration. Experience with ERP, CRM, and data warehouse systems. Why Join Us? You will be part of a forward-thinking team driving digital transformation through data. Expect a dynamic work environment, professional growth opportunities, and the chance to make a real impact on global-scale integration projects. More ❯

scope includes KYC/KYB/AML vendor integrations, funnel efficiency, and cost optimization , as well as leading broader compliance projects such as PCI DSS certification, GDPR/data protection, FATF Travel Rule, and other regulatory requirements . You will be responsible for building scalable, automated solutions that support compliance operations worldwide, ensuring Transak remains audit-ready, globally … or payments. Direct experience integrating with KYC/KYB vendors and AML systems. Strong technical product management skills ; able to collaborate with engineers on backend workflows, APIs, and data pipelines. Proven success in automating compliance/risk operations and delivering compliance projects globally. Strong knowledge of global regulatory frameworks (PCI DSS, GDPR, FATF Travel Rule, AMLD, sanctions). More ❯