801 to 825 of 1,061 Data Pipeline Jobs in England

Senior Python Engineer – Data & Technology London | £120,000 – £160,000 + bonus + benefits Please note, this role requires four days on-site per week, with one day remote. Are you a Senior Python Engineer who thrives on solving complex, high-impact problems and designing systems that directly influence critical business decisions? I’m working with a leading … global trading firm in London that’s rapidly expanding its Data & Technology team. This is a rare opportunity to contribute to high-stakes trading infrastructure, working closely with a highly skilled, collaborative team of engineers and quantitative analysts from top-tier academic and technical backgrounds. You’ll be tackling challenging, real-time problems at scale and helping to … perfect fit! What you’ll do Partner with trading and analytics teams to design and optimise analytical models and processes. Build and maintain Python-based services, APIs, and data pipelines using modern frameworks and best practices. Develop solutions to support market data analysis, position management, and predictive modeling. Create cloud-native tools and visualization interfaces to More ❯

UK (Remote) Duration: 7 Months Inside IR35 Clearance Requirement: Must be eligible for BPSS and SC Clearance We are seeking an experienced DataStage Developer with strong expertise in data transformation, mapping, and migration methodologies. The successful candidate will work within an Agile delivery environment, collaborating closely with cross-functional teams to design, build, and optimise data … business and technical requirements. This role demands hands-on proficiency with IBM DataStage, familiarity with structured migration methodologies, and the ability to deliver high-quality, efficient, and reliable data solutions. Key Responsibilities Design, develop, and implement DataStage mappings aligned with project specifications and industry best practices. Apply MOSAIC or IBM 10-Step Data Migration Methodologies to … support structured and efficient data transformation processes. Collaborate with technical and non-technical stakeholders to understand business requirements and translate them into scalable data solutions. Implement and work with XML, XSLT, and other related technologies for data manipulation and transformation. Use Jira to support Agile delivery processes, task planning, progress tracking, and workflow management. More ❯

UK (Remote) Duration: 7 Months Inside IR35 Clearance Requirement: Must be eligible for BPSS and SC Clearance We are seeking an experienced DataStage Developer with strong expertise in data transformation, mapping, and migration methodologies. The successful candidate will work within an Agile delivery environment, collaborating closely with cross-functional teams to design, build, and optimise data … business and technical requirements. This role demands hands-on proficiency with IBM DataStage, familiarity with structured migration methodologies, and the ability to deliver high-quality, efficient, and reliable data solutions. Key Responsibilities Design, develop, and implement DataStage mappings aligned with project specifications and industry best practices. Apply MOSAIC or IBM 10-Step Data Migration Methodologies to … support structured and efficient data transformation processes. Collaborate with technical and non-technical stakeholders to understand business requirements and translate them into scalable data solutions. Implement and work with XML, XSLT, and other related technologies for data manipulation and transformation. Use Jira to support Agile delivery processes, task planning, progress tracking, and workflow management. More ❯

multiple teams and contribute on key decisions. Provide solutions to problems for their immediate team and across multiple teams. Collaborate with cross-functional teams to develop and deploy data-driven insights. As an Infrastructure Automation Engineer you will be: Required to work independently and be self-motivated, leading a team of other Automation Infrastructure Engineers and Analysts Experienced … in the following: Infrastructure Development and Automation: Building use cases and creating infrastructure applications using programming languages such as C#, C++, and Python to process data locally Containerization and Orchestration: Using tools like Docker and Kubernetes to package and manage applications for scalable and efficient deployment. Packaged Application and industry standard APIs such as Revitt, MEF and TMFORUM. … and Resource Management: Managing resources efficiently via deployment of scalable infrastructure. Includes knowledge of containerization, virtualization, and orchestration tools to dynamically allocate resources based on demand. Develop innovative data solutions to optimize data generation, collection, and processing. Collaborate with cross-functional teams to ensure data quality and integrity. We are looking for experience in More ❯

multiple teams and contribute on key decisions. Provide solutions to problems for their immediate team and across multiple teams. Collaborate with cross-functional teams to develop and deploy data-driven insights. As an Infrastructure Automation Engineer you will be: Required to work independently and be self-motivated, leading a team of other Automation Infrastructure Engineers and Analysts Experienced … in the following: Infrastructure Development and Automation: Building use cases and creating infrastructure applications using programming languages such as C#, C++, and Python to process data locally Containerization and Orchestration: Using tools like Docker and Kubernetes to package and manage applications for scalable and efficient deployment. Packaged Application and industry standard APIs such as Revitt, MEF and TMFORUM. … and Resource Management: Managing resources efficiently via deployment of scalable infrastructure. Includes knowledge of containerization, virtualization, and orchestration tools to dynamically allocate resources based on demand. Develop innovative data solutions to optimize data generation, collection, and processing. Collaborate with cross-functional teams to ensure data quality and integrity. We are looking for experience in More ❯

AI Engineer Specialist | London | Hybrid Working Are you an experienced AI Engineer ready to take ownership of advanced AI delivery within a fast-growing data and analytics environment? Do you want to help shape how AI is designed, deployed, and scaled across real-world, mission-critical products? We are looking for a highly skilled AI Engineer Specialist with … What You’ll Be Doing Lead the development, optimisation, and deployment of machine learning, deep learning, generative AI, and agentic AI models Design and maintain robust AI and data pipelines , including model monitoring, automation, scalability, and performance improvements Collaborate with cross-functional teams to translate business goals into production-ready AI solutions Experiment with and integrate LLMs, agent … model quality, and best-practice delivery Champion responsible AI , ensuring transparency, versioning, documentation, and evaluation at every stage 🌟 What We’re Looking For Degree in Computer Science, AI, Data Science, Mathematics or a related field (Master’s desirable) 3–5 years’ hands-on experience delivering AI or ML solutions in production environments Proven expertise with Generative AI + More ❯

AI Engineer Specialist | London | Hybrid Working Are you an experienced AI Engineer ready to take ownership of advanced AI delivery within a fast-growing data and analytics environment? Do you want to help shape how AI is designed, deployed, and scaled across real-world, mission-critical products? We are looking for a highly skilled AI Engineer Specialist with … What You’ll Be Doing Lead the development, optimisation, and deployment of machine learning, deep learning, generative AI, and agentic AI models Design and maintain robust AI and data pipelines , including model monitoring, automation, scalability, and performance improvements Collaborate with cross-functional teams to translate business goals into production-ready AI solutions Experiment with and integrate LLMs, agent … model quality, and best-practice delivery Champion responsible AI , ensuring transparency, versioning, documentation, and evaluation at every stage 🌟 What We’re Looking For Degree in Computer Science, AI, Data Science, Mathematics or a related field (Master’s desirable) 3–5 years’ hands-on experience delivering AI or ML solutions in production environments Proven expertise with Generative AI + More ❯

Leading the development of scalable backend systems and modern frontend applications Setting engineering standards, architecture, and best practices across teams Collaborating cross-functionally with product, design, QA, and data Mentoring and growing a strong team of engineers Ensuring performance, security, and maintainability across platforms Driving CI/CD, automated testing, and modern workflows Making strategic technical decisions and … tools/technologies 🎯 What We’re Looking For Strong backend skills: Python, FastAPI Frontend expertise: Next.js, React, TypeScript Solid understanding of MySQL/Postgres, REST/GraphQL APIs, data pipelines Leadership or senior engineering experience (mentoring, code review, ownership) Cloud experience (AWS preferred) and building scalable systems Excellent communication and architectural decision-making skills ⭐ Bonus Points QA/ More ❯

Senior Marketing Data Analyst – Fast-Growing Global FinTech Love finding patterns in data that drive smarter marketing? We’re partnering with a global FinTech that’s transforming how people trade and invest. With hundreds of thousands of active users worldwide, they’re scaling fast — and they’re looking for a Senior Marketing Data Analyst … to help fuel that growth. The Opportunity You’ll be the marketing team’s data powerhouse — connecting insights to strategy, spotting opportunities, and helping shape decisions that directly impact acquisition, retention, and revenue. Working cross-functionally with product, engineering, and growth teams, you’ll ensure marketing decisions are grounded in data, not guesswork. What You’ll … Analyse campaign performance across multiple digital channels Create insights on customer journeys, lifetime value, attribution, and engagement Support segmentation, targeting, and experimentation strategies Build and automate dashboards and data pipelines to enable self-serve analytics Own the marketing analytics function — becoming the trusted expert for performance data What You’ll Need 5+ years’ experience in data More ❯

Senior Marketing Data Analyst – Fast-Growing Global FinTech Love finding patterns in data that drive smarter marketing? We’re partnering with a global FinTech that’s transforming how people trade and invest. With hundreds of thousands of active users worldwide, they’re scaling fast — and they’re looking for a Senior Marketing Data Analyst … to help fuel that growth. The Opportunity You’ll be the marketing team’s data powerhouse — connecting insights to strategy, spotting opportunities, and helping shape decisions that directly impact acquisition, retention, and revenue. Working cross-functionally with product, engineering, and growth teams, you’ll ensure marketing decisions are grounded in data, not guesswork. What You’ll … Analyse campaign performance across multiple digital channels Create insights on customer journeys, lifetime value, attribution, and engagement Support segmentation, targeting, and experimentation strategies Build and automate dashboards and data pipelines to enable self-serve analytics Own the marketing analytics function — becoming the trusted expert for performance data What You’ll Need 5+ years’ experience in data More ❯

A leading global energy trading organization is expanding its Front Office Engineering & Analytics function in London. This team develops the technology powering front-office analytics, risk systems, and data-driven trading strategies across Power & Gas, Oil, and Market Risk domains. You’ll be joining an ambitious and technically strong group responsible for building the firm’s next-generation … a cloud-native ecosystem on AWS, used globally by trading, risk, and analytics teams. These are hands-on engineering roles, focused on designing and scaling high-performance systems, data pipelines, and analytical applications. Key Responsibilities Build robust data pipelines and orchestration engines in AWS Integrate diverse datasets, including market, fundamental, and weather data Develop … operationalization of workloads in AWS (S3, ECS, Postgres) Promote engineering best practices including Git-based version control and CI/CD Requirements 3–7 years of experience in data or software engineering Strong Python programming skills (Java or C# a plus) Hands-on experience with AWS (S3, ECS, Postgres) Understanding of Kafka, orchestration, and distributed data More ❯

A leading global energy trading organization is expanding its Front Office Engineering & Analytics function in London. This team develops the technology powering front-office analytics, risk systems, and data-driven trading strategies across Power & Gas, Oil, and Market Risk domains. You’ll be joining an ambitious and technically strong group responsible for building the firm’s next-generation … a cloud-native ecosystem on AWS, used globally by trading, risk, and analytics teams. These are hands-on engineering roles, focused on designing and scaling high-performance systems, data pipelines, and analytical applications. Key Responsibilities Build robust data pipelines and orchestration engines in AWS Integrate diverse datasets, including market, fundamental, and weather data Develop … operationalization of workloads in AWS (S3, ECS, Postgres) Promote engineering best practices including Git-based version control and CI/CD Requirements 3–7 years of experience in data or software engineering Strong Python programming skills (Java or C# a plus) Hands-on experience with AWS (S3, ECS, Postgres) Understanding of Kafka, orchestration, and distributed data More ❯

Consultant/Architect with solid experience in the AdTech & MarTech Domain. Strong privacy and consent expertise to lead the design and integration of privacy-centric digital marketing and data activation platforms. You will bridge marketing technology, data governance, privacy compliance, ensuring regulatory requirements and consent principles are embedded in platform design, data flows, audience … of AdTech and MarTech solutions, including CDPs, consent platforms, identity & tagging stacks and activation pipelines. Assess architectures covering tagging, event tracking, attribution, experimentation, audience management and media integrations. Data flows, system interactions and integration patterns across first-party, third-party and cloud-based platforms. Establish guardrails for data use, identity, cookies, measurement, tracking and consent enforcement. … Privacy & Consent Ensure privacy principles (GDPR, PECR, ePrivacy, ICO guidance) and consent controls into architecture and data pipelines. Ensure compliant audience segmentation, targeting, data enrichment, and cross-channel tracking strategies. Guide the implementation of CMPs (Consent Management Platforms), consent signals (TCF), and privacy-centric tagging frameworks. Validate solutions post-deployment to ensure privacy, data More ❯

help shape the future of our engineering function. Who We’re Seeking We’re searching for an experienced technical leader to own and drive our back-end and data strategy. You’ll lead teams responsible for designing, developing, and optimising cloud-based systems, data pipelines, and APIs — ensuring our solutions are robust, secure, and aligned with … scalable solutions, fostering a high-performance culture within the engineering team. What You’ll Be Doing Lead the design, development, and implementation of .NET back-end systems and data workflows using Databricks . Oversee the build and optimisation of data pipelines within AWS . Drive engineering excellence , establishing and maintaining standards, metrics, and best practices. Mentor … What You’ll Bring Proven expertise in back-end development using .NET/C# . Strong technical leadership and experience managing engineering teams. Hands-on experience with AWS data services and cloud-native architectures. Proficiency in Python and SQL Excellent stakeholder management skills, able to bridge technical and business perspectives. Knowledge of Azure and experience with Databricks or More ❯

this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. For further information More ❯

this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. For further information More ❯

process large datasets and support complex pricing and risk analytics across asset classes. Key Responsibilities Design, develop, and maintain Java-based risk platform components that support pricing, market data integration, and risk analytics. Collaborate with quantitative analysts and model developers to integrate risk models into production systems. Build robust data pipelines and interfaces for market data, trade data, and risk sensitivities. Ensure low-latency and high-throughput performance across the platform. Participate in architectural decisions for the evolution of the risk platform, including microservices, cloud migration, or messaging integration. Support daily operations and participate in the on-call rotation for production risk systems. Write clean, testable, and well-documented code; contribute to … software development, ideally within financial services or a trading environment. Proven experience building or supporting risk platforms, pricing systems, or valuation engines. Strong knowledge of object-oriented programming, data structures, and design patterns. Familiarity with market risk, credit risk, or counterparty risk concepts. Experience with messaging systems (e.g., Solace, Kafka, or RabbitMQ) and distributed architecture. Solid understanding of More ❯

Back-End/Full Stack Engineer This is a unique opportunity to join a mission-driven startup applying cutting-edge data engineering, satellite science, and backend development to help farmers grow more sustainably and profitably. You’ll work at the intersection of satellite imagery, backend systems, and machine-learning infrastructure, helping to build and scale a groundbreaking agricultural … Supporting atmospheric correction testing pipelines and contributing to visualisation tools used to validate results Integrating with new satellite imagery feeds and partnering APIs (including tractor/precision agriculture data) Developing and maintaining data pipelines for ML workflows and crop-growth modelling Enhancing geo-rectification workflows and improving performance of atmospheric correction systems Collaborating closely with engineering … data science, and product teams to turn insights into production-ready features Contributing to both R&D-heavy and commercially driven engineering initiatives What you can bring Strong Python skills, including experience with data processing libraries (e.g. Numpy, Pandas). Bonus: RasterIO or other geospatial tooling experience. Experience with AWS and containerised environments (Docker). Familiarity More ❯

Back-End/Full Stack Engineer This is a unique opportunity to join a mission-driven startup applying cutting-edge data engineering, satellite science, and backend development to help farmers grow more sustainably and profitably. You’ll work at the intersection of satellite imagery, backend systems, and machine-learning infrastructure, helping to build and scale a groundbreaking agricultural … Supporting atmospheric correction testing pipelines and contributing to visualisation tools used to validate results Integrating with new satellite imagery feeds and partnering APIs (including tractor/precision agriculture data) Developing and maintaining data pipelines for ML workflows and crop-growth modelling Enhancing geo-rectification workflows and improving performance of atmospheric correction systems Collaborating closely with engineering … data science, and product teams to turn insights into production-ready features Contributing to both R&D-heavy and commercially driven engineering initiatives What you can bring Strong Python skills, including experience with data processing libraries (e.g. Numpy, Pandas). Bonus: RasterIO or other geospatial tooling experience. Experience with AWS and containerised environments (Docker). Familiarity More ❯

week) Experience in KDB is the main criteria for qualification. Overview: We are seeking a KDB+/q Developer to design, build, and optimize high-performance time-series data systems for Real Time analytics and trading applications. Responsibilities: Develop and maintain kdb+/q applications, including tickerplants, RDBs, and HDBs. Build Real Time and historical market data pipelines. Optimize queries and systems for low latency and high throughput. Integrate kdb+ with internal platforms, APIs, and market data feeds. Troubleshoot production issues and ensure data quality and system reliability. Collaborate with quants, traders, and engineering teams. Requirements: Strong proficiency in kdb+/q and time-series data processing. Experience with … market data, trading systems, or financial analytics. Solid knowledge of Linux , Scripting, version control, and distributed systems. Familiarity with Python, Kafka, or cloud platforms is a plus. Excellent problem-solving and communication skills. More ❯

Engineer/Engineering Manager – London OR Manchester - Salary up to £110k We’re hiring a Hands-On Engineering Manager with deep technical leadership experience across Python , large-scale data systems, and modern AWS infrastructure. You’ll lead a squad of 4 engineers , guiding them through complex technical decisions and helping them deliver high-performance, data-intensive … Be Doing Lead and develop a squad of 4 engineers , supporting growth, coaching, and high-quality delivery. Set technical direction across Python services, distributed systems, and large-scale data processing. Work heavily with AWS — especially Redshift, Lambda, ECS, S3 , plus data formats like Parquet . Shape high-throughput data pipelines and SQL-based workflows … Collaborate with Product & Design to define technical requirements, prioritise roadmaps, and drive measurable outcomes. Tech Environment You’ll Influence Primary language: Python AWS stack: Redshift, Lambda, ECS, S3 Data workflows: Parquet, SQL, distributed data pipelines Scale: systems processing hundreds of millions to billions of rows Focus areas: performance tuning, reliability, cost optimisation, architectural clarity What You More ❯

Engineer/Engineering Manager – London OR Manchester - Salary up to £110k We’re hiring a Hands-On Engineering Manager with deep technical leadership experience across Python , large-scale data systems, and modern AWS infrastructure. You’ll lead a squad of 4 engineers , guiding them through complex technical decisions and helping them deliver high-performance, data-intensive … Be Doing Lead and develop a squad of 4 engineers , supporting growth, coaching, and high-quality delivery. Set technical direction across Python services, distributed systems, and large-scale data processing. Work heavily with AWS — especially Redshift, Lambda, ECS, S3 , plus data formats like Parquet . Shape high-throughput data pipelines and SQL-based workflows … Collaborate with Product & Design to define technical requirements, prioritise roadmaps, and drive measurable outcomes. Tech Environment You’ll Influence Primary language: Python AWS stack: Redshift, Lambda, ECS, S3 Data workflows: Parquet, SQL, distributed data pipelines Scale: systems processing hundreds of millions to billions of rows Focus areas: performance tuning, reliability, cost optimisation, architectural clarity What You More ❯

client helps enterprises discover, assess, and respond to third-party and supply-chain risks through advanced AI-driven analytics and intelligence . Their mission is to deliver continuous, data-backed visibility into the extended enterprise — enabling organizations to identify vulnerabilities, map their digital ecosystems, and make informed decisions about vendor and partner risk. As they continue to scale … we are seeking a Head of Product to lead a world-class technical team , shape the architectural vision , and drive execution across multiple product streams — including large-scale data pipelines and real-time risk intelligence systems . Role Overview: As Head of Product you will be responsible for owning the product roadmap and execution for one or more … major modules of our platform (e.g., discovery & mapping, risk scoring & analytics, automated response). You will work closely with the CTO/founder, engineering, data/AI teams, UX/design, marketing, and customer-success to define product strategy, prioritise features, and deliver value to customers and the business. You will play a key role in shaping the More ❯

client helps enterprises discover, assess, and respond to third-party and supply-chain risks through advanced AI-driven analytics and intelligence . Their mission is to deliver continuous, data-backed visibility into the extended enterprise — enabling organizations to identify vulnerabilities, map their digital ecosystems, and make informed decisions about vendor and partner risk. As they continue to scale … we are seeking a Head of Product to lead a world-class technical team , shape the architectural vision , and drive execution across multiple product streams — including large-scale data pipelines and real-time risk intelligence systems . Role Overview: As Head of Product you will be responsible for owning the product roadmap and execution for one or more … major modules of our platform (e.g., discovery & mapping, risk scoring & analytics, automated response). You will work closely with the CTO/founder, engineering, data/AI teams, UX/design, marketing, and customer-success to define product strategy, prioritise features, and deliver value to customers and the business. You will play a key role in shaping the More ❯

Senior Data Engineer - Commodities - 140,000k + bonuses You don’t need any prior buy-side experience to join this firm, where you’ll join this new team within this established firm whose mission is to bridge the gap across technology and trading. This global energy and commodities firm is seeking an experienced Senior Data Engineer … the business users to understand what they need, before building out the application. You’ll see the impact you’re having, daily. Key responsibilities include building and optimising data pipelines, managing cloud-based storage and processing systems, and partnering with analysts and data scientists to deliver production-ready data solutions. They are looking for … an experience data engineer with strong skills in Python, SQL, and modern cloud technologies to take a leading role in a forward-thinking, data-driven organisation. No up-to-date CV required. More ❯