851 to 875 of 1,317 Data Pipeline Jobs in England

and equity long and short strategies they have been a household name in the buy side space for close to 2 decades. This client are hiring a Lead Data Engineer for a core team to take ownership of their core data platform, and build data pipelines to parse a broad range of financial data … wider teams. This is a senior seat, ideally looking for a hedge fund background and 8 years+ experience in a revelant role. This will mean exposure to market data vendors, ability to communicate with traders and mentoring junior engineers. Tech stack: Deep Python, Pandas, AWS, Airflow, Kubernetes, ETL, SQL Please apply if this of interest More ❯

and equity long and short strategies they have been a household name in the buy side space for close to 2 decades. This client are hiring a Lead Data Engineer for a core team to take ownership of their core data platform, and build data pipelines to parse a broad range of financial data … wider teams. This is a senior seat, ideally looking for a hedge fund background and 8 years+ experience in a revelant role. This will mean exposure to market data vendors, ability to communicate with traders and mentoring junior engineers. Tech stack: Deep Python, Pandas, AWS, Airflow, Kubernetes, ETL, SQL Please apply if this of interest More ❯

a quarter of a billion users, we're building a world-class R&D team to push the boundaries of AI creativity. The Role: As a Research Engineer - Data at Leonardo , you will architect and manage petascale data pipelines, combining text, images, 3D models, and other data modalities to drive world-class AI models. … You'll work hand-in-hand with our Researchers to create and curate large, multi-modal datasets, including synthetic data, that supercharge SOTA generative AI solutions. Your expertise in distributed systems, data processing, and experimentation will shape the backbone of our research work. Responsibilities: Data Acquisition & Curation Lead the ingestion, unification, and organization of … large, unstructured data sources (e.g., text, images, 3D geometry, code snippets) into scalable, high-quality datasets suitable for machine learning research and production. High-Performance Data Pipelines Develop and optimize distributed systems for data processing, including filtering, indexing, and retrieval, leveraging frameworks like Ray, Metaflow, Spark, or Hadoop. Synthetic Data Generation Build More ❯

Data Scientist Up to £110k per year. 4 days/week in-office, Camden. Employment Type: Full-time We’re looking for a Data Scientist to join a growing team in Camden working on AI-first products in a collaborative, high-performance environment. What you’ll do: Design, build, and deploy data-driven models … and AI systems Work closely with engineers and product teams to integrate insights into customer-facing features Extract insights from large datasets using Python and SQL Build scalable data pipelines and experimentation frameworks Translate complex findings into clear business recommendations What we’re looking for: Strong experience building AI/ML models in production Advanced Python and SQL More ❯

Data Scientist Up to £110k per year. 4 days/week in-office, Camden. Employment Type: Full-time We’re looking for a Data Scientist to join a growing team in Camden working on AI-first products in a collaborative, high-performance environment. What you’ll do: Design, build, and deploy data-driven models … and AI systems Work closely with engineers and product teams to integrate insights into customer-facing features Extract insights from large datasets using Python and SQL Build scalable data pipelines and experimentation frameworks Translate complex findings into clear business recommendations What we’re looking for: Strong experience building AI/ML models in production Advanced Python and SQL More ❯

and lean team dynamics. Tech We Work With: Python, React, JS Airflow, Docker, Kubernetes, Postgres, Slurm, Glue, ECS, AWS Batch Transformers, LLMs, Fine-Tuning, Prompt Pipelines Real-time data pipelines & scalable APIs More ❯

Senior Data Scientist - AI/ML LLMs Geospatial & 3D Data We're looking for a hands-on Senior Data Scientist with deep AI/ML expertise (including LLMs) to help build the intelligent backbone of a next-gen 3D design and GIS platform. You'll work across geospatial, 3D, and internal datasets-designing and … smart automation, predictive tools, and spatial intelligence systems. What You'll Do: Build and deploy ML/LLM models (GPT, Claude, etc.) into real-world tools Develop intelligent data pipelines and AI-driven product features Work with geospatial + 3D data to push the boundaries of spatial analytics Collaborate with product, data, and engineering More ❯

On behalf of our client, HW Interim Solutions are seeking a Finance BI Data Lead to help bridge technical delivery and strategic finance insight, drive data strategy and lead key projects within the Finance BI function, for a 6 month engagement. This is a hands-on role combining strong SQL and ETL expertise with the ability … to shape architecture, influence stakeholders, and deliver impactful, data-driven solutions. Reporting into the Head of BI, the successful candidate will work closely with finance teams, system accountants, and senior leadership to ensure reporting is accurate, scalable, and aligned to wider business goals. From designing robust data pipelines to mentoring team members and championing best practice … this role bridges the gap between technical delivery and strategic business insight. Candidates will need proven experience in SQL development, a strong understanding of ETL and data warehousing and the confidence to lead projects in a fast-paced environment. Excellent communication skills, a collaborative mindset, and a passion for continuous improvement are essential. Experience with financial reporting structures More ❯

more junior team members; deeper expertise and applied knowledge within relevant area. Apply link Copy link Bachelor's degree or equivalent practical experience. 5 years of experience in data architecture, data modeling, data mining, data pipelines, structured data APIs, analytics, and managing metrics. 5 years of experience in a technical … Computer Science, or a related Engineering field. Experience in advanced SQL tuning and optimization for cost and performance. Experience architecting, developing software, or internet scale production-grade Big Data solutions on top of public cloud managed services. Experience in AlloyDB, Infrastructure as Code (e.g., Terraform), Enterprise, VMWare, Kubernetes and Containerization, Vertex AI, Gemini. About the job The Google … both regional and international customers. Your relationships with customers are crucial in helping Google grow its Cloud business and helping companies around the world innovate. As a Cloud Data Consultant, you'll guide customers on how to ingest, store, process, analyze, and explore/visualize data on the Google Cloud Platform. You will work on data More ❯

Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team at the centre … of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design to insights creation. As part of this role, you will be responsible for some of the following areas Design, develop and … maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of cloud data platforms solutions To be successful in the role you will have Solid experience designing and delivering data solutions focused on Databricks Strong ETL experience with More ❯

Data Engineer - MS Fabric - UK role (WFH) - 6 months initial contract - Top rates - Outside IR35 Major consultancy urgently requires a Data Engineer with experience of MS Fabric (tech stack is Microsoft Fabric, PySpark/RSpark and Github) for an initial 6 months contract (WFH and Outside IR35) who is passionate about building new capabilities from the … ground up and want to help explore the full potential of your data platform. As aa Data Engineer you will have hands-on technical ability and experience of building and managing modern data platforms, preferably in Microsoft Fabric and ideally be familiar with integrating customer/third-party data into Fabric, possess … Product Development Awareness: Understanding how data platform capabilities may integrate into digital products and services. Experience working with or within product development teams is a plus Technical knowledge and underrating of the following is required:- Data Engineering Best Practices, CI/CD for data pipelines, Modular, testable ETL development, Git-based collaboration and branching More ❯

A high performing, multi-billion dollar AUM hedge fund are looking to make a newly created Data Analyst hire into their rapidly growing centralised Data Management team. Reporting into the Global Head of Data and taking on a highly visible role within the team, the hire will be working very closely with Operations, Product … of data, in a role that has a highly technical/engineer angle. You will optimize the operation and quality management of the internal data pipeline with oversight of raw data initially being onboarded through to the delivery of datapoints to front office/investment teams. You will use your technical knowledge of … SQL/python/VBA/Matlab to conduct quality checks and anomaly identification, by interrogating complex dataset analysis. The hire will act as the main interface between data sourcing and data engineering and be the point of contact for Traders. The hire will also take on ad hoc projects working with front office and technology More ❯

A high performing, multi-billion dollar AUM hedge fund are looking to make a newly created Data Analyst hire into their rapidly growing centralised Data Management team. Reporting into the Global Head of Data and taking on a highly visible role within the team, the hire will be working very closely with Operations, Product … of data, in a role that has a highly technical/engineer angle. You will optimize the operation and quality management of the internal data pipeline with oversight of raw data initially being onboarded through to the delivery of datapoints to front office/investment teams. You will use your technical knowledge of … SQL/python/VBA/Matlab to conduct quality checks and anomaly identification, by interrogating complex dataset analysis. The hire will act as the main interface between data sourcing and data engineering and be the point of contact for Traders. The hire will also take on ad hoc projects working with front office and technology More ❯

A high performing, multi-billion dollar AUM hedge fund are looking to make a newly created Data Analyst hire into their rapidly growing centralised Data Management team. Reporting into the Global Head of Data and taking on a highly visible role within the team, the hire will be working very closely with Operations, Product … of data, in a role that has a highly technical/engineer angle. You will optimize the operation and quality management of the internal data pipeline with oversight of raw data initially being onboarded through to the delivery of datapoints to front office/investment teams. You will use your technical knowledge of … SQL/python/VBA/Matlab to conduct quality checks and anomaly identification, by interrogating complex dataset analysis. The hire will act as the main interface between data sourcing and data engineering and be the point of contact for Traders. The hire will also take on ad hoc projects working with front office and technology More ❯

of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 3 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For … leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: Demonstrate the More ❯

of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 3 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for you as a … GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For … leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key responsibilities: Demonstrate the More ❯

partners. Continuing to support and complement Ripple's Payments, Custody and Stablecoin business units WHAT YOU'LL DO: Design and build scalable, low-latency microservices and event-driven data pipelines to support high-throughput trading systems. Champion data engineering best practices including schema evolution, data contracts, and data quality across event streams. … Collaborate with cross-functional teams to model, publish, and maintain high-quality data products aligned with enterprise standards. Implement CI/CD pipelines, automated testing, infrastructure-as-code, and monitoring solutions to ensure operational excellence. Lead end-to-end software development efforts-from gathering requirements to deployment and production support. Contribute to engineering excellence through mentoring, code reviews … proficiency in Java or similar languages (Golang, Scala, etc.). Proven track record building large-scale, low-latency distributed systems in trading or financial environments. Deep understanding of data streaming, order management systems, and modern persistence technologies (e.g., Aurora, DynamoDB). Experience working in front-office trading environments, ideally with exposure to FX and/or crypto trading More ❯

Data Engineering Manager | London (Hybrid) | Leadership | Cloud | Agile Lead the future of data at Reward. Build, scale, and shape our engineering excellence. At Reward, data sits at the core of everything we do — powering loyalty programmes for some of the world’s biggest names like Visa and Experian. We’re now on the lookout … for an exceptional Data Engineering Manager to help us scale our engineering practice, drive operational excellence, and deliver impactful products through modern data solutions. This is more than just people management — it’s your chance to build high-performing, agile teams, guide the evolution of our data engineering standards, and play a pivotal role … in the continued growth of our Belfast Centre of Excellence. What you'll do Lead, coach, and grow our Data Engineering teams — setting the bar for quality, performance, and collaboration Embed best practices in engineering, documentation, design assurance, and code quality across teams Drive resource planning and capacity management in line with fast-paced product priorities Remove blockers More ❯

Data Engineering Manager | London (Hybrid) | Leadership | Cloud | Agile Lead the future of data at Reward. Build, scale, and shape our engineering excellence. At Reward, data sits at the core of everything we do — powering loyalty programmes for some of the world’s biggest names like Visa and Experian. We’re now on the lookout … for an exceptional Data Engineering Manager to help us scale our engineering practice, drive operational excellence, and deliver impactful products through modern data solutions. This is more than just people management — it’s your chance to build high-performing, agile teams, guide the evolution of our data engineering standards, and play a pivotal role … in the continued growth of our Belfast Centre of Excellence. What you'll do Lead, coach, and grow our Data Engineering teams — setting the bar for quality, performance, and collaboration Embed best practices in engineering, documentation, design assurance, and code quality across teams Drive resource planning and capacity management in line with fast-paced product priorities Remove blockers More ❯

Data Engineering Manager | London (Hybrid) | Leadership | Cloud | Agile Lead the future of data at Reward. Build, scale, and shape our engineering excellence. At Reward, data sits at the core of everything we do — powering loyalty programmes for some of the world’s biggest names like Visa and Experian. We’re now on the lookout … for an exceptional Data Engineering Manager to help us scale our engineering practice, drive operational excellence, and deliver impactful products through modern data solutions. This is more than just people management — it’s your chance to build high-performing, agile teams, guide the evolution of our data engineering standards, and play a pivotal role … in the continued growth of our Belfast Centre of Excellence. What you'll do Lead, coach, and grow our Data Engineering teams — setting the bar for quality, performance, and collaboration Embed best practices in engineering, documentation, design assurance, and code quality across teams Drive resource planning and capacity management in line with fast-paced product priorities Remove blockers More ❯

Application closing date: 16/02/25 at 23:59 A bit about the role As the Head of Data Engineering and Data Platform, you will lead the design, development, and management of our cloud-based data environment, ensuring it meets the organisation's current and future needs. You will drive the growth … and evolution of the Platform, identifying opportunities to adopt new technologies and enhance capabilities to support the Agency. This is a critical role within the Data & Analytics directorate, where you will oversee the end-to-end engineering of data pipelines, ensuring the efficient ingestion, transformation, and accessibility of trusted data across the agency. Your … work will underpin the agency's data-driven decision-making, enabling advanced analytics, AI, and innovation. You will provide strategic leadership to the data platform team, driving the adoption of emerging technologies and ensuring that the platform is secure, scalable, and aligned with organisational objectives. As Head of Profession for data engineers, you will More ❯

travelers, driving engagement and loyalty by providing value to them through ownership of the loyalty program, credit card/gift card, and targeted CRM. The Director of CRM Data and Audiences will be responsible for the strategic technical direction, implementation, and continuous optimization of our global marketing data and segmentation systems. This role will collaborate closely … with Product, Data Engineering, and Analytics teams to align evolving business objectives with scalable data solutions that power personalized, high-impact marketing experiences. In this role, you will: Act as a strategic advisor to senior leadership for topics related to our Marketing Data Platforms, providing insights and recommendations to support evolving goals and business … needs. Be responsible for the technical global strategy and execution for marketing data and audience segmentation across Expedia Group's portfolio of brands, to translate the Traveler Engagement teams needs into measurable business outcomes. Partner closely with Product, Engineering, Data Science, and Analytics teams to co-design and implement scalable architectural solutions for audience and data More ❯

Role: Data Engineer Tech stack: Python, SQL, AWS, data processing frameworks (e.g. Airflow, Tensorflow) Salary: £40,000–£70,000 + big equity Location: London (on site) This fast-growing team is addressing a real-world challenge that's impacted a huge number of people across the UK - especially those balancing work with study or other commitments … The team is now looking to bring on someone with a solid academic background and a few years of hands-on experience to take ownership of some core data pipelines. You'll be joining a mission-led environment where autonomy is really encourage and the learning curve is steep but supportive. They have a flagship product and also … putting their efforts into which they're hoping to completely change their sector). You'll work closely with an ambitious and collaborative group (with a really impressive Data/AI background) who are experimenting with how to build smarter, more flexible systems. The kind of person who thrives here enjoys solving problems end-to-end, asking questions More ❯

Role: Data Engineer Tech stack: Python, SQL, AWS, data processing frameworks (e.g. Airflow, Tensorflow) Salary: £40,000–£70,000 + big equity Location: London (on site) This fast-growing team is addressing a real-world challenge that's impacted a huge number of people across the UK - especially those balancing work with study or other commitments … The team is now looking to bring on someone with a solid academic background and a few years of hands-on experience to take ownership of some core data pipelines. You'll be joining a mission-led environment where autonomy is really encourage and the learning curve is steep but supportive. They have a flagship product and also … putting their efforts into which they're hoping to completely change their sector). You'll work closely with an ambitious and collaborative group (with a really impressive Data/AI background) who are experimenting with how to build smarter, more flexible systems. The kind of person who thrives here enjoys solving problems end-to-end, asking questions More ❯

Octopus Energy, a leading force in the energy sector, is seeking a Data Engineer to join their Energy Markets team. This role sits at the intersection of energy trading, forecasting, and technological innovation, supporting the company's mission towards Net Zero transition. The position offers a unique opportunity to work with complex data engineering challenges while … teams to design and build operational and reporting pipelines across regions Maintain critical data pipelines supporting trading, forecasting, risk and PPA processes Develop automations and alerts for pipeline monitoring Set up and maintain processes for capturing, preparing and loading data into the data lake Design and build operational dashboards Work with international teams … team members Requirements For Data Engineer Strong aptitude with SQL, Python and Airflow Experience in Kubernetes, Docker, Django, Spark and related monitoring tools Experience with dbt for pipeline modelling Ability to shape needs into requirements and design scalable solutions Quick understanding of new domain areas and data visualization Team player with project ownership mindset Passion More ❯