626 to 650 of 1,061 Data Pipeline Jobs in England

a Technical Project Manager to join a scaling startup in the Education sector Salary up to £60k , depending on experience Fully remote role (UK-based preferred) Tech environment: Data Engineering | AI | Python | GCP | Agile | Jira If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan … WHO WE ARE: We're an EdTech startup using AI and data-driven technology to transform how students learn and educators teach. Our intelligent learning platform empowers users through personalised insights, automating complex processes and enabling smarter decision-making. As we continue to scale, we're strengthening our technical delivery capability and looking for an organised, tech-savvy … Technical Project Manager to help keep our engineering efforts running smoothly. WHAT YOU WILL BE DOING: Coordinate and track technical projects across data, engineering, and AI teams. Facilitate Agile delivery - managing sprint planning, daily stand-ups, retrospectives, and backlog prioritisation. Act as a bridge between engineering and product , ensuring goals are aligned and progress is transparent. Monitor project More ❯

when needed. The ideal candidate will act primarily as a Solutions Architect - collaborating with clients, consultancy teams, and internal stakeholders to design scalable, future-proof solutions across digital, data, and MarTech domains. However, this individual should also be comfortable getting hands-on in engineering scenarios, whether it's during critical build phases, technical troubleshooting, or prototyping new concepts. … technical ideas into business value. Solution Design & Delivery Translate business requirements into architectural designs and actionable technical documentation. Design robust, scalable, and maintainable digital solutions across web, mobile, data, and MarTech ecosystems. Take ownership of high-level designs, low-level designs, integration specifications, and build oversight. Client Collaboration & Delivery Execution Participate in workshops and discovery sessions to capture … and non-technical audiences. Nice to Have Experience with platforms like Braze, Google Analytics, Adobe Analytics, Contentful, or Sitecore. Experience across technology domains including CMS, CRM, Martech platforms, data pipelines, analytics, and cloud services. Exposure to CDPs (e.g., Bloomreach, Segment, BlueConic, Tealium) and data integration pipelines. Understanding of data modelling, ETL processes, and basic More ❯

Job Title: Data Engineer - Advanced Analytics Location: On-site in London, with Occasional Travel to Croydon Clearance Required: BPSS + SC Start Date: ASAP Duration of contract: 2+ Years The ideal candidate will have active SC Clearance or be eligible to undergo SC Clearance. We are actively looking to secure Data Engineers to join Experis on … behalf of our client. Job Purpose/The Role: We are seeking 3 experienced Data Engineers to support a high-profile Public Sector client. These roles will be part of a large project, contributing to the ongoing development and live support of critical systems within a secure, agile, and data-driven environment. Your Key Responsibilities: Work … collaboratively in a multi-disciplinary Agile & DevOps team to deliver data solutions and maintain live systems. Apply best practices for data integration, transformation, and delivery in a secure and scalable environment. Support data pipelines and ETL processes across various technologies and cloud platforms Maintain, monitor, and troubleshoot systems using a wide array of tools More ❯

their models not just trained, but deployed, adopted, and driving measurable results. What You’ll Do Design and deliver AI systems: Build and deploy machine learning models and data-driven products that directly impact investment decisions and portfolio company performance. Drive measurable impact: Partner with internal desks and portfolio teams to integrate ML products into their existing workflows … drive adoption and effectiveness. Automated Deal Sourcing Workflows: Prototype experimental systems to automate early-stage deal sourcing. You’ll build integrations to extract signals from public and proprietary data sources, integrate with third-party APIs to enrich lead information, and integrate with in-house GenAI platform to create a structured data asset. This includes designing modular … computer vision, or optimization. Python expertise: Skilled in writing production-grade code in Python (e.g., using type hints and understanding the limitations of the language) and in building data pipelines and ML models using modern libraries across multiple domains: Data science stack: NumPy, pandas/polars, scikit-learn, XGBoost, LightGBM Deep learning: PyTorch, JAX Statistical programming More ❯

their models not just trained, but deployed, adopted, and driving measurable results. What You’ll Do Design and deliver AI systems: Build and deploy machine learning models and data-driven products that directly impact investment decisions and portfolio company performance. Drive measurable impact: Partner with internal desks and portfolio teams to integrate ML products into their existing workflows … drive adoption and effectiveness. Automated Deal Sourcing Workflows: Prototype experimental systems to automate early-stage deal sourcing. You’ll build integrations to extract signals from public and proprietary data sources, integrate with third-party APIs to enrich lead information, and integrate with in-house GenAI platform to create a structured data asset. This includes designing modular … computer vision, or optimization. Python expertise: Skilled in writing production-grade code in Python (e.g., using type hints and understanding the limitations of the language) and in building data pipelines and ML models using modern libraries across multiple domains: Data science stack: NumPy, pandas/polars, scikit-learn, XGBoost, LightGBM Deep learning: PyTorch, JAX Statistical programming More ❯

Hybrid – London | Global FinTech Innovator Our client is an established yet fast-growing FinTech specialising in high-performance market data analytics . Their platform ingests and processes terabytes of global trading data daily , powering decision-making for leading investment firms, exchanges, and research institutions. They’re now seeking a Market Data Engineering Lead to … take ownership of their equities data pipelines and infrastructure , helping scale the next generation of data-processing systems within a collaborative engineering leadership team. This role offers a 50/50 split between hands-on coding and technical leadership — ideal for someone who thrives on solving deep engineering challenges while guiding a small team to deliver … best-in-class data solutions. The Role Lead development for the firm’s equities data processing platform , working alongside other engineering leads and a senior architect. Plan and execute two-week Agile sprints, define priorities, and manage workloads across developers. Take full ownership of project lifecycles — from requirements gathering to design, implementation, testing, and deployment. Develop More ❯

Data & Software Engineers – DV Cleared (UK*C) Duration: 12 Months Location: Southwest Rate: £650 - £800/day DOE Status: INSIDE IR35 Clearance: DV Clearance (UK*C) Start Date: ASAP Summary My market-leading consultancy client is looking to secure the services of several DV Cleared Data & Software Engineers to support critical project work over the coming … months. You’ll be contributing to high-impact, secure systems within an agile, technology-driven environment, working alongside talented engineers and data specialists. The role also offers opportunities to gain training and certifications in modern data management platforms such as Databricks. We also have permanent positions available if that’s your preferred mode of employment. Key … Skills - Software development with Java, JavaScript, Python, and SQL - Working with JSON and data-driven APIs - Experience building and maintaining data pipelines (e.g. Apache NiFi) - Familiarity with AWS cloud services, including Redshift and related tools - Exposure to containerisation and orchestration technologies (e.g. Kubernetes/K8s) - Understanding of AI, LLMs, and modern data processing approaches More ❯

SENIOR DATA ENGINEER LONDON £60,000 - £80,000 THE COMPANY This fast-growing digital marketplace is revolutionizing how complex commercial insurance is traded, using cutting-edge technology to automate and streamline the matching of brokers and insurers. As a Senior Data Engineer here, you’ll play a pivotal role in scaling the platform that has processed … millions! THE ROLE As a Senior Data Engineer , you’ll own the end-to-end development and optimization of the data platform, directly impacting how the business trades and analyses large-scale insurance deals. You’ll work across the full stack, from infrastructure to dashboarding, ensuring data is reliable, scalable, and secure. Specifically, you … can expect to be involved in the following: Technical tasks: Building and maintaining scalable data pipelines using Python, SQL, Prefect, and dbt Managing cloud infrastructure with Terraform and Azure Implementing observability and data quality metrics Other key responsibilities: Collaborating with analytics and actuarial teams to deliver actionable insights Working in a small, agile team with full More ❯

SENIOR DATA ENGINEER LONDON £60,000 - £80,000 THE COMPANY This fast-growing digital marketplace is revolutionizing how complex commercial insurance is traded, using cutting-edge technology to automate and streamline the matching of brokers and insurers. As a Senior Data Engineer here, you’ll play a pivotal role in scaling the platform that has processed … millions! THE ROLE As a Senior Data Engineer , you’ll own the end-to-end development and optimization of the data platform, directly impacting how the business trades and analyses large-scale insurance deals. You’ll work across the full stack, from infrastructure to dashboarding, ensuring data is reliable, scalable, and secure. Specifically, you … can expect to be involved in the following: Technical tasks: Building and maintaining scalable data pipelines using Python, SQL, Prefect, and dbt Managing cloud infrastructure with Terraform and Azure Implementing observability and data quality metrics Other key responsibilities: Collaborating with analytics and actuarial teams to deliver actionable insights Working in a small, agile team with full More ❯

Junior Data Engineers are required by this major client, as they continue to build the cloud engineering capability in their Leeds offices, where you will provide best in class Data Engineering services to a wide range of major Public Sector organisations. As a result of the work that they do, this client requires applicants to hold … national or dual UK national. Please note your application will not be taken forward if you cannot fulfil these requirements. In order to secure one of these Junior Data Engineer roles you must be able to demonstrate the following experience: Commercial experience gained in a Data Engineering role on any major cloud platform (Azure, AWS or … and experience using at least one Data Platform Technology such as Quantexa, Palantir and DataBricks Knowledge of test automation frameworks and ability to automate testing within the pipeline This is an opportunity for significant growth, but with a start-up feel and mentality. In this role you will have the chance to build and be part of More ❯

Contract until end of February | I am Looking for a NetSuite Analytics Warehouse (NSAW) Developer to support ongoing data and reporting work. The focus will be on building and maintaining datasets, optimising data pipelines, and supporting business reporting needs. Responsibilities • Develop and manage NSAW datasets, dashboards, and data models • Support integrations between NetSuite and … external data sources • Optimise data pipelines and ensure data accuracy • Collaborate with Finance and BI teams to deliver usable insights • Troubleshoot issues and support ongoing enhancements Requirements • Hands-on experience with NetSuite Analytics Warehouse (NSAW) • Strong SQL skills and understanding of data modelling • Experience with Oracle Analytics or similar BI tools • Knowledge … of NetSuite data structures and schemas • Able to work independently and remotely Contract details Outside IR35. Until end of February. UK-based only. More ❯

Contract until end of February | I am Looking for a NetSuite Analytics Warehouse (NSAW) Developer to support ongoing data and reporting work. The focus will be on building and maintaining datasets, optimising data pipelines, and supporting business reporting needs. Responsibilities • Develop and manage NSAW datasets, dashboards, and data models • Support integrations between NetSuite and … external data sources • Optimise data pipelines and ensure data accuracy • Collaborate with Finance and BI teams to deliver usable insights • Troubleshoot issues and support ongoing enhancements Requirements • Hands-on experience with NetSuite Analytics Warehouse (NSAW) • Strong SQL skills and understanding of data modelling • Experience with Oracle Analytics or similar BI tools • Knowledge … of NetSuite data structures and schemas • Able to work independently and remotely Contract details Outside IR35. Until end of February. UK-based only. More ❯

deploying and monitoring secure production backend systems at scale comprised of the following components: Ansible- and Terraform-based automated deployments Bare-metal and cloud computing Networking Data Pipeline Tools Relational, In-Memory, and Time-series Databases Kubernetes Notification Systems Experience with cloud infrastructure best practices around automation, identity management, and security, having created and maintained infrastructure for More ❯

global collaboration, and keeping delivery on point. What you’ll do: Lead cross-functional teams (UK & India-based) delivering FS products on Azure Embed AI across development and data pipelines Streamline Kanban delivery using JIRA, Confluence & Azure DevOps Balance ad hoc requests with strategic initiatives Scale processes, mentor teams & drive continuous improvement What you’ll bring: Proven technical More ❯

systematic trading strategies. Responsibilities: Develop and maintain robust, low-latency trading systems and infrastructure. Collaborate with traders and quantitative researchers to translate strategies into production-ready code. Optimize data pipelines, analytics tools, and backtesting frameworks for maximum efficiency and scalability. Contribute to the design and implementation of automated trading platforms and real-time monitoring systems. Requirements: Strong proficiency More ❯

systematic trading strategies. Responsibilities: Develop and maintain robust, low-latency trading systems and infrastructure. Collaborate with traders and quantitative researchers to translate strategies into production-ready code. Optimize data pipelines, analytics tools, and backtesting frameworks for maximum efficiency and scalability. Contribute to the design and implementation of automated trading platforms and real-time monitoring systems. Requirements: Strong proficiency More ❯

across cross-functional technical teams Managing complex interdependencies between products and projects Driving continuous improvement of agile (Kanban) processes Partnering with engineers to integrate AI into development and data pipelines Overseeing delivery metrics, reporting, and governance Acting as the link between stakeholders and technical teams Designing scalable delivery frameworks to support future growth Requirements: Experience leading technical delivery More ❯

teams to build seamless user experiences What will the Senior Product Engineer bring? Strong backend development expertise with Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building high-quality products that customers More ❯

teams to build seamless user experiences What will the Senior Product Engineer bring? Strong backend development expertise with Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building high-quality products that customers More ❯

Innovator, in technology and GTM, you love delivering ideas whose time has come. AI/ML literate - understands LLM limits, evals, performance/latency/cost trade-offs, data pipelines, guardrails, and can quickly gain respect of Eng/Research. Specific Voice AI experience certainly helps! We encourage you to apply even if you do not feel you More ❯

Work Location: London (Office Based) The Role The role will be integral to realizing the customer's vision and strategy in transforming some of their critical application and data engineering components. As a global financial markets infrastructure and data provider , the customer leverages cutting-edge technologies to support its core services and business requirements. This role … is critical in enabling the technical thought leadership and excellence required for that purpose. Your Responsibilities Design, build, and optimise scalable data pipelines for batch and streaming workloads. Develop and manage dataflows and semantic models to support analytics-related business requirements. Implement complex transformations, aggregations, and joins ensuring performance and reliability. Apply robust data validations, cleansing … and profiling techniques to ensure data accuracy and consistency. Implement role-based access, data masking, and compliance protocols. Performance tune and optimise jobs and workloads to reduce latency. Collaborate with analysts and business stakeholders to translate requirements into technical solutions. Create, maintain, and update documentation and internal knowledge repositories. Your Profile Essential Skills/Knowledge/ More ❯

ROLE TITLE: Data Quality Automation Tester LOCATION: Remote - Occasional travel to London CLEARANCE: The ideal candidate will have active SC Clearance or be eligible to undergo SC Clearance. We are actively looking to secure multiple Data Quality Automation Tester s to join Experis. Experis Consultancy is a Global entity with a well-established team with over … approach is a very personal one, with both our clients and our own employees. We are passionate about training, technology and career development. Technical Skills Advanced automation of data profiling, validation, and consistency checks Proven expertise with InfoSphere DataStage and QualityStage Understanding of MOSAIC or comparable data migration frameworks Strong proficiency in XML , XSLT , and data transformation techniques Familiarity with SQL , data pipelines, and ETL processes Experience using test automation tools (e.g. Selenium, pytest, or custom frameworks for data testing) Knowledge of version control systems (Git, Bitbucket) and CI/CD pipelines for automated testing Understanding of data governance , metadata management , and data lineage concepts Analytical More ❯

ROLE TITLE: Data Quality Automation Tester LOCATION: Remote - Occasional travel to London CLEARANCE: The ideal candidate will have active SC Clearance or be eligible to undergo SC Clearance. We are actively looking to secure multiple Data Quality Automation Tester s to join Experis. Experis Consultancy is a Global entity with a well-established team with over … approach is a very personal one, with both our clients and our own employees. We are passionate about training, technology and career development. Technical Skills Advanced automation of data profiling, validation, and consistency checks Proven expertise with InfoSphere DataStage and QualityStage Understanding of MOSAIC or comparable data migration frameworks Strong proficiency in XML , XSLT , and data transformation techniques Familiarity with SQL , data pipelines, and ETL processes Experience using test automation tools (e.g. Selenium, pytest, or custom frameworks for data testing) Knowledge of version control systems (Git, Bitbucket) and CI/CD pipelines for automated testing Understanding of data governance , metadata management , and data lineage concepts Analytical More ❯

SENIOR PYTHON ENGINEER LONDON £65,000 - £85,000 You’re a problem-solver who thrives on complex data challenges and wants to see your work make a measurable impact? Here’s your chance to join. Work with real-world ML datasets, cutting-edge data systems, and a platform that processes billions of events — all while helping … protect and optimise their campaigns. Their machine learning platform detects and blocks invalid or low-value clicks across search, display, and social channels, empowering marketing teams with trusted data and higher ROI. Your work will directly support their mission to make digital advertising more transparent and impactful. THE ROLE As a Senior Python Engineer , you’ll play a … real-time tracking, and deliver high-performance backend solutions that process massive datasets. Specifically, you can expect to be involved in the following: Developing and maintaining large-scale data pipelines and backend systems in Python . Working with AI/ML datasets to help train and deploy new detection models. Building and improving integrations, and working on greenfield More ❯

SENIOR PYTHON ENGINEER LONDON £65,000 - £85,000 You’re a problem-solver who thrives on complex data challenges and wants to see your work make a measurable impact? Here’s your chance to join. Work with real-world ML datasets, cutting-edge data systems, and a platform that processes billions of events — all while helping … protect and optimise their campaigns. Their machine learning platform detects and blocks invalid or low-value clicks across search, display, and social channels, empowering marketing teams with trusted data and higher ROI. Your work will directly support their mission to make digital advertising more transparent and impactful. THE ROLE As a Senior Python Engineer , you’ll play a … real-time tracking, and deliver high-performance backend solutions that process massive datasets. Specifically, you can expect to be involved in the following: Developing and maintaining large-scale data pipelines and backend systems in Python . Working with AI/ML datasets to help train and deploy new detection models. Building and improving integrations, and working on greenfield More ❯