51 to 75 of 599 Data Pipeline Jobs in London

AWS Data Engineer Salary: Negotiable to £80,000 Dependent on Experience London: Hybrid working 3 days per week in the office 2 days home-based Job Ref: J12931 A leader in consumer behaviour analytics, seeks a driven AWS Data Engineer to guide data infrastructure … architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you’ll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs). You’ll … skills for data transformation, cleaning, and loading. Strong coding experience with Python and Pandas. Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc. Build processes supporting data transformation, data structures, metadata, dependency and workload management. More ❯

Job Title: Senior Generative AI Data Engineer ? Location: London, United Kingdom ? Salary: Negotiable ? Recruitment Agency: 167 Solutions ? Job Description: 167 Solutions is seeking an experienced Senior Generative AI Data Engineer to join our client's innovative team in London. This pivotal role offers … the opportunity to lead the development and deployment of generative AI models, driving transformative solutions across various business domains. ? Key Responsibilities: Data Pipeline Architecture: Design, develop, and maintain robust, scalable data pipelines to support generative AI models, ensuring efficient data flow and processing. … or similar. ? Data Processing: Expertise in big data technologies such as Apache Spark, Hadoop, and experience with data pipeline tools like Apache Airflow. ? Cloud Platforms: Strong experience with cloud services, particularly AWS, Azure, or Google Cloud Platform, including services like S3, EC2, Lambda More ❯

ASCS. We are establishing a new centralized Business Intelligence team to build self-service analytical products for ASCS that provide relevant insights and data deep dives across the business. By leveraging advanced analytics and AI/ML, we will transform catalog data into predictive insights, helping … prevent customer issues before they arise. Real-time intelligence will support proactive decision-making, enabling faster, data-driven decisions across the organization and driving long-term growth and an enhanced customer experience. We are looking for a creative and goal-oriented Business Intelligence Engineer (BIE) to join our … Spark, Hive, Hadoop, PyTorch, PySpark) PREFERRED QUALIFICATIONS - Master's degree, or Advanced technical degree - Knowledge of data modeling and data pipeline design - Experience with statistical analysis, co-relation analysis - Experience in the data/BI space - Experience in designing and implementing custom reporting More ❯

Exciting Opportunity in Health Tech! Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Reporting To: Vice President of Software Development Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with … cutting-edge technology? If so, we have an exciting new role for you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalize clinical research applications. This is your chance to make a meaningful impact on healthcare while … working with some of the most advanced technologies in data engineering. About Us We are a pioneering health tech company dedicated to revolutionizing clinical research through innovative data solutions. Our cross-functional team, including Frontend Developers, QA Engineers, and DevOps Engineers, collaborates to create high-performance More ❯

digital business model and diversify into other digital media products across multiple Clarion portfolios. To support this growth, Clarion requires an outstanding Azure Data Engineer to join the Data and Analytics team. You will be responsible for designing, developing, and implementing data migration solutions. … Your expertise in Azure services, data integration, and Terraform will be essential as we build innovative solutions for our transformation programmes. Key Responsibilities Data Migration: Migrate data from existing Big Data platforms into Dynamics 365, Data Verse and other Azure … data environments. Migrating from hand-rolled Code-based ETL processes to modern Azure Cloud Computing solutions Data Aggregation: Aggregate from smaller data sources and SaaS platforms into our Microsoft data environments Azure Development: Utilize Azure Data Factory, Azure Functions, and More ❯

Senior Data Engineer Hybrid working (3 days per week onsite in London) 6 Month contract initially, good scope for extension Market rates (Umbrella-PAYE) One of our blue chip clients … are looking for a number Senior Data Engineer to join the team on a long term programme of work. Key Responsibilities: * ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data quality. * Monitor and troubleshoot production data pipelines, ensuring their performance and reliability. * Mentor junior engineers and lead technical discussions to drive best practices and innovation within the team. * Stay up to date with the latest trends and technologies in data engineering and recommend solutions More ❯

Date: March 31, 2025 (30+ days left to apply) Job requisition id R26624 At FactSet, we're working to be the best financial data provider. We need highly motivated, talented individuals empowered to find answers through creative technology to get there. As a Software Engineer in Data Solutions Engineering, you will be part of our Digital Transformation, a mission to automate our data acquisition, quality assurance, content creation, and analytics in a scalable cloud environment. With the guidance of financial experts, you will leverage these large data sets to improve the … mapping, and company valuation. There is huge potential for machine learning, analytics, and NLP. Your responsibilities: Build and scale an automatic data pipeline Ingest and analyze various data sources to drive innovation in content creation. Automate the acquisition, relevance scoring, and storage of incoming sources. More ❯

join us at FPSM and be part of something bigger… What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This … is a critical role within our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding … with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data More ❯

join us at FPSM and be part of something bigger… What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This … is a critical role within our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding … with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data More ❯

as we possibly can. If this sounds good to you, then we're thrilled you're considering joining our team! Role Overview The Data Engineer will play a critical role in implementing and maintaining Lumon's technical data infrastructure. Reporting to the Head of Data … who thrives on designing scalable data solutions and enjoys solving complex data challenges. Key Responsibilities Data Infrastructure and Pipeline Development Design, develop, and maintain ETL/ELT pipelines using Azure Synapse Analytics, Data Factory and other Azure related cloud warehouse tools. … years in data engineering or similar technical roles, preferably in financial services or a related field. Hands-on experience with Azure Synapse, Pipeline creations, Azure Data Factory, and Azure Data Lake Storage. Strong proficiency in SQL, including database management, query optimisation, and troubleshooting. More ❯

as we possibly can. If this sounds good to you, then we're thrilled you're considering joining our team! Role Overview The Data Engineer will play a critical role in implementing and maintaining Lumon's technical data infrastructure. Reporting to the Head of Data … who thrives on designing scalable data solutions and enjoys solving complex data challenges. Key Responsibilities Data Infrastructure and Pipeline Development Design, develop, and maintain ETL/ELT pipelines using Azure Synapse Analytics, Data Factory and other Azure related cloud warehouse tools. … years in data engineering or similar technical roles, preferably in financial services or a related field. Hands-on experience with Azure Synapse, Pipeline creations, Azure Data Factory, and Azure Data Lake Storage. Strong proficiency in SQL, including database management, query optimisation, and troubleshooting. More ❯

Job Title: Senior Data Architect Location: Hybrid (London, UK) Salary: £75,000–£135,000 per annum, plus 20% Bonus and Benefits About the Role: Our client is a leading professional services firm with a strong UK presence and global reach, delivering expert audit, tax, advisory, and risk solutions. … As part of their ongoing investment in digital transformation, they are scaling their data capabilities to better serve clients in regulated and data-intensive sectors. This newly created Senior Data Architect role will focus on designing and implementing data architecture solutions for … architecture within the insurance and asset management industries, including regulatory and compliance requirements. Proficiency in SQL , Python , and modern data pipeline design (ETL/ELT). Experience with both batch and streaming data processing architectures. Strong communication and stakeholder engagement skills, particularly with More ❯

Job Title: Senior Data Architect Location: Hybrid (London, UK) Salary: £75,000–£135,000 per annum, plus 20% Bonus and Benefits About the Role: Our client is a leading professional services firm with a strong UK presence and global reach, delivering expert audit, tax, advisory, and risk solutions. … As part of their ongoing investment in digital transformation, they are scaling their data capabilities to better serve clients in regulated and data-intensive sectors. This newly created Senior Data Architect role will focus on designing and implementing data architecture solutions for … architecture within the insurance and asset management industries, including regulatory and compliance requirements. Proficiency in SQL , Python , and modern data pipeline design (ETL/ELT). Experience with both batch and streaming data processing architectures. Strong communication and stakeholder engagement skills, particularly with More ❯

Job Type: Contract Job Location: Wimbledon , UK Job Description : For this role, senior experience of Data Engineering and building automated data pipelines on IBM Datastage & DB2, AWS and Databricks from source to operational databases through to curation layer is expected using the latest cloud modern technologies … where experience of delivering complex pipelines will be significantly valuable to how to maintain and deliver world class data pipelines. Knowledge in the following areas essential: Databricks: Expertise in managing and scaling Databricks environments for ETL, data science, and analytics use cases. AWS Cloud: Extensive experience … security, and data quality across our data platform. Ensure data is well-documented, accessible, and meets compliance standards. Pipeline Automation & Optimisation: Drive the automation of data pipelines and workflows to improve efficiency and reliability. Team Management: Mentor and grow a team More ❯

You will need to login before you can apply for a job. Senior Data Engineer, 3PX Private Pricing - Analytics & Insights Sector: Data Science Role: Senior Executive Contract Type: Permanent Hours: Full Time DESCRIPTION Amazon Web Services (AWS) is a dynamic and rapidly growing business within Amazon … Private Pricing Analytics and Insights (PPA&I) team owns building scalable analytical solutions that enable the GDSP organization with actionable insights to make data-driven decisions. This role will focus on Data Engineering, and Analytics related to the Private Pricing Program, requiring deep technical skills, strong … business acumen and a deep analytical background to provide actionable data-driven insights and decision support. As a Senior Data Engineer on this team, you will drive efficiency in data handling processes; build and maintain data pipelines and associated infrastructure; partner with More ❯

Data Lead Senior Data Engineer/Scientist Judge.me Role: Data Lead Senior Data Engineer/Scientist Location: Remote with hybrid option (2 days in Shoreditch office near Old Street) Salary: £90-115k (includes comprehensive benefits package) Our Mission: Fixing Trust in … ve achieved 40% year-over-year growth purely through word of mouth-no paid marketing or sales teams needed The Opportunity As our Data Lead, you'll lead the development of our Trust Optimisation Platform-a critical initiative to unlock insights from our vast review dataset to help … data into actionable merchant insights NLP/ML Development : Create models that analyse review content, identify trust patterns, and establish merchant benchmarks Pipeline Architecture : Build scalable systems that efficiently process our extensive review and merchant data Cross-Functional Collaboration : Work with product and design teams More ❯

Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and … secure data capabilities. This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the … team's growth, and help shape our overall data strategy. On a typical day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product More ❯

create groundbreaking products and solutions. Our AI Team is committed to exploring AI and machine learning's full potential. Job Summary: As a Data Engineer on AI Team, you will craft the foundation of our AI models and algorithms. You will build and maintain reliable data pipelines, ensuring data availability, integrity, and quality for our AI projects. Your work will directly influence our AI initiatives, contributing to innovative solutions for complex problems. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks and Azure services. Perform feature set engineering … report preparations, and ML tasks. Work with data scientists, ML engineers, and collaborators to deliver high-quality data solutions. Collaborate with the Data & Analytics Team on data infrastructure and ingestion. Discuss data inputs with Business Development and collaborators, advising on More ❯

automation. This team will be required to build high quality data models and products that monitor and reports on data pipeline health and data quality. Work closely with all members of the Data Reliability Engineering team to set project deliverables, review … junior members of the team. Collaborate with engineering teams to improve, maintain, performance tune, and respond to incidents on our big data pipeline infrastructure. Build out observability and intelligent monitoring of data pipelines and infrastructure to achieve early and automated anomaly detection and alerting. Present … ownership and drive A passionate bias to action and passion for delivering high-quality data solutions Deep understanding of end-to-end pipeline design and implementation. Attention to detail and quality with excellent problem solving and interpersonal skills Bachelor's degree in Computer Science, Information Systems, Software More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … client base. They are providing the utmost level of quality and security in everything they do. The Role We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and … evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth. You will be responsible for designing, building, and optimising Azure Data More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … client base. They are providing the utmost level of quality and security in everything they do. The Role We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and … evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth. You will be responsible for designing, building, and optimising Azure Data More ❯

We are looking for a Data Engineer to join our growing data engineering team at Our Future Health. The Data Engineer will bring an in-depth knowledge of NHS data and data solutions to help solve some of the key … challenges around a programme of work at industrial scale with global significance. Our data engineers work with our participant data (including various health records from the NHS, genetic data, Our Future Health's own questionnaires) and build pipelines and systems to process it, control … quality and create data releases for researchers. You'll take a lead on developing specific pipelines related to questionnaire and physical measurements data. Our Future Health will be the UK's largest ever health research programme, bringing people together to develop new ways to detect, prevent, and treat More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity … that is redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising … data pipelines, virtualised environments, and business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data More ❯

Data Engineer Are you ready to make an impact in one of the UK's most dynamic and transformative public sector organisations? We are recruiting for the role of Data Engineer within the in-house digital product and services department of a groundbreaking public sector entity … that is redefining the way data is leveraged to drive decision-making and innovation. The Role: Data Engineer The Data Engineer will be responsible for designing, building, and maintaining the organisation’s data infrastructure. This role will focus on developing and optimising … data pipelines, virtualised environments, and business intelligence solutions.The successful candidate will have expertise in Denodo, SQL, Qlik, Power BI, and Master Data Management (MDM), ensuring high-quality data is available to support strategic decision-making. Responsibilities Strategic: Lead the development of a modern data More ❯

You will need to login before you can apply for a job. Data Engineering Lead - Finance and Master View more categories View less categories Sector Manufacturing Role Manager Contract Type Permanent Hours Full Time Job Description: Are you passionate about Data and Analytics (D&A) and … of data products meeting quality standards. DataOps and Optimization Implement DataOps practices to improve workflows and operational efficiency. Automate data pipeline deployment and monitoring with CI/CD tools. Technical Leadership Provide guidance on data engineering best practices. Stay updated on industry trends … Ensure compliance with data governance policies and standards. Promote data quality, security, and integrity. Monitor and optimize data pipeline performance for scalability and reliability. Stakeholder Engagement Collaborate with PN D&A leadership and product owners to prioritize data initiatives that maximize More ❯