51 to 75 of 1,944 Data Pipeline Jobs in London

Recruitment | Connecting Talent to Opportunity Techyard is supporting a growing Databricks-partnered consultancy in securing a Databricks Champion Solution Architect to lead the design and delivery of advanced data and AI solutions on the Databricks Lakehouse Platform. This strategic, high-impact role is ideal for a seasoned professional who can operate as both a hands-on architect and … a trusted advisor—bridging business vision with technical excellence. You’ll play a pivotal part in driving innovation, embedding best practices, and shaping the consultancy’s data engineering capabilities as they scale their team and client base. Key Responsibilities: Architect and implement end-to-end, scalable data and AI solutions using the Databricks Lakehouse (Delta Lake … Unity Catalog, MLflow). Design and lead the development of modular, high-performance data pipelines using Apache Spark and PySpark. Champion the adoption of Lakehouse architecture (bronze/silver/gold layers) to ensure scalable, governed data platforms. Collaborate with stakeholders, analysts, and data scientists to translate business needs into clean, production-ready datasets. More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise … our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect More ❯

The role Position: Data Engineer Contract type: Full Time/Permanent Reporting to: Head of Data Location: London Overview of role Zodiac Maritime is undergoing an exciting data transformation, and we're looking for a talented Data Engineer to join our growing data team. In this role, you'll be … instrumental in building and deploying modern Azure Databricks based data solutions, enabling the business to make faster, data-driven decisions. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to design scalable data pipelines, implement efficient data models, and ensure high-quality data … practices (Git, Azure DevOps) for automated testing and deployment. Optimize Spark jobs, Delta Lake tables, and SQL queries for performance and cost efficiency. Troubleshoot and resolve data pipeline issues proactively. Partner with Data Architects, Analysts, and Business Teams to deliver end-to-end solutions. Stay ahead of emerging data technologies (e.g., streaming with More ❯

GX) is delivering on the promise of AI. GX has built specialised knowledge AI assistants for the banking and insurance industry. Our assistants are fed by sector-specific data and knowledge and easily adaptable through ontology layers to reflect institution-specific rules. GX AI assistants are designed for Individual Investors, Credit and Claims professionals. Our assistants are being … our assistants are empowering financial professionals and delivering 10x improvements by supporting them in their day-to-day tasks. Responsibilities: Helping to architect, design, implement, and optimise our data ingestion, transformation, and spreading pipelines and processes. Developing data models, processing pipelines, and back-end services supporting the data science teams, automating processes, building integrations … pipelines deployed in at least one of the big 3 cloud ML stacks (AWS, Azure, GCP). Hands-on experience with open-source ETL, and data pipeline orchestration tools such as Apache Airflow and Nifi. Experience with large scale/Big Data technologies, such as Hadoop, Spark, Hive, Impala, PrestoDb, Kafka. Experience with workflow More ❯

Join to apply for the Lead Data Engineer role at ITV . This range is provided by ITV. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Contract Type: Perm Full Time Workplace: White City, London - expectation is 2 days in the office. Closing Date: 15th … Lead Data Engineer, both directly and via your team of data engineers, you will be responsible for developing, maintaining, and optimising our data pipeline infrastructure using our proprietary central data platform, which is based on Databricks. You will collaborate with cross-functional teams to design and implement scalable data solutions, ensuring efficient data ingestion, transformation, storage, and analysis. This role offers the chance to lead impactful projects, work with cutting-edge technologies, and shape the future of data engineering at ITV. If you’re passionate about data, leadership, and innovation, we’d love to hear from you! Key responsibilities Lead and More ❯

Senior Manager at Tenth Revolution Group - Helping organisations across the UK hire the best Cloud Talent. Azure Data Engineer - £70,000 - Home based with occasional client visits. Locations: London, Edinburgh, Manchester About Us: We are a leading data consultancy, dedicated to empowering businesses with cutting-edge data solutions. Our focus is on AI readiness … Responsibilities: Develop and implement data engineering solutions using tools like Azure Data Factory, Azure Synapse, and Fabric . Build and optimize ETL/ELT pipelines , data lakes, and data warehouses. Engage with stakeholders to translate business requirements into effective data strategies . Support data governance, architecture, and best … . A solid grasp of data governance, data modeling, and business intelligence best practices. Knowledge of Agile, DevOps, Git, APIs, microservices, and data pipeline development . Familiarity with Spark, Kafka, or Snowflake is a plus. Desirable Certifications: Microsoft Certified: Fabric Analytics Engineer Associate Why Join Us? Competitive salary up to £70,000 per More ❯

based at any one of our network of 20 offices nationally, but will require travel to client sites: www.kpmg88careers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Technology + Data function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting-edge solutions across the … United Kingdom. Working on complex engagements including working closely with clients to design, implement, and manage scalable data solutions, this team is responsible for the delivery of cutting-edge technical solutions and trusted to get it right first time. KPMG is one of the world's largest and most respected consultancy businesses, we've supported the UK through … Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, and related tools. Microsoft Fabric – experience with dataflows, lakehouses, notebooks, and workspace management. Azure Synapse Analytics – pipeline and notebook creation, performance tuning, and data transformation logic. Power BI – data modelling, DAX, and visualisation development. Delta Lake – supporting structured streaming and batch data More ❯

Manchester, Milton Keynes, Newcastle upon Tyne, Norwich, Nottingham, Plymouth, Reading, South Coast - Southampton, Watford Capability: Advisory Experience Level: Manager Type: Full Time or Part Time Service Line: Technology & Data Contract type: Permanent Job Description Lead Data Engineer - 107311 Base Location: Could be based at any one of our network of 20 offices nationally, but will require … travel to client sites: The KPMG Technology + Data function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting-edge solutions across the United Kingdom. Working on complex engagements including working closely with clients to design, implement, and manage scalable data … Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, and related tools. Microsoft Fabric – experience with dataflows, lakehouses, notebooks, and workspace management. Azure Synapse Analytics – pipeline and notebook creation, performance tuning, and data transformation logic. Power BI – data modelling, DAX, and visualisation development. Delta Lake – supporting structured streaming and batch data More ❯

About Bauer Media Audio Data & Decision Sciences Team The Data and Decision Sciences The Data and Decision Sciences (DDS) team is at the core of Bauer Media Audio with a mission to leverage data as a strategic enabler across our nine European markets. Our goal is to provide trusted, actionable insights and … robust data solutions that empower business growth, enhance audience engagement, and drive operational efficiency. The DDS team operates as a collaborative, cross-functional unit that bridges the gap between data and business strategy, delivering solutions that align with our organizational goals and market needs. We are structured to support our stakeholders with a combination of centralized … our European markets. Over the first six months, you will focus on critical migrations from legacy systems, international expansion of our competitions business, and strengthening our data pipeline infrastructure to support advanced analytics. About Bauer Media Group We are a media business focused on creating content that matters to millions of people across Europe. Our offering extends More ❯

therapies for sleep disorders and epilepsy, and a growing portfolio of cancer treatments. Our patient-focused and science-driven approach powers pioneering research and development advancements across our robust pipeline of innovative therapeutics in oncology and neuroscience. Jazz is headquartered in Dublin, Ireland with research and development laboratories, manufacturing facilities and employees in multiple countries committed to serving patients … worldwide. Please visit www.jazzpharmaceuticals.com for more information. The Principal will be responsible for supporting complex or leading singular projects related to data engineering requirements and initiatives across Jazz Research and Development. The Principal will support data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD and Omics. Essential Functions Support the design … development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and other tools. Build More ❯

Social network you want to login/join with: Data Engineer – Growing Data & AnalyticsConsultancy Location: Greater Manchester (Hybrid) Salary: £50,000 – £60,000 with excellent benefits About the Company: The company is an ambitious, innovative, and rapidly expanding data consultancy dedicated to delivering impactful data solutions for a diverse client portfolio. The … culture is built on collaboration, continuous learning, and making a real difference through data-driven insights. The organisation prioritises a supportive environment that encourages growth, practical problem-solving, and technical excellence. Why Join the Company: Work on high-impact, diverse projects for impressive clients across finance, retail, manufacturing, and technology sectors. Be part of a supportive team that … a flexible hybrid working model with remote and on-site options. Enjoy a comprehensive package including 35 days holiday plus bank holidays, pension scheme, and ongoing training opportunities. Data Engineer (2+ Years of Experience) The company is looking for a talented Data Engineer to join the technical team. The successful candidate will be responsible for building More ❯

Daintta are a rapidly growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a Data Engineer, you will … work closely with our public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases. Key Responsibilities Assessing your clients' technical needs and understanding how their needs are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing aspects related to data engineering, identification of risks and proposing and implementing their mitigations) Modelling, structuring and storing data along with their More ❯

Social network you want to login/join with: Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. Our … broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise we’ve acquired with our 1000+ client base around the globe. … We have over 1500 employees across 20 offices who are focused on accelerating digital transformation. Thanks to a unique mix of company assets: State of the art data technologies, lean AI agile methodologies for fast delivery, and cohesive teams of the finest business consultants, data analysts, data scientists, data engineers, and digital More ❯

with clients, understanding their needs, and translating them into effective outcomes. You understand and align with Solirius Reply Values. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. Requirements Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design … and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based Working collaboratively with the client and More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

technological advancements, using AI to create groundbreaking products and solutions. Our AI Team is committed to exploring AI and machine learning's full potential. Job Summary: As a Data Engineer on our AI Team, you will craft the foundation of our AI models and algorithms. You will build and maintain reliable data pipelines, ensuring data … and quality for our AI projects. Your work will directly influence our AI initiatives, contributing to innovative solutions for complex problems. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks and Azure services. Perform feature set engineering, report preparations, and ML tasks. Work with data scientists, ML engineers, and collaborators to deliver high-quality … data solutions. Collaborate with the Data & Analytics Team on data infrastructure and ingestion. Discuss data inputs with Business Development and collaborators, advising on data integration. Ensure data accuracy and consistency across sources and systems. Optimize data workflows for performance and efficiency. Implement best practices for data More ❯

L), based on your location. Our hybrid policy is 3 days a week at the office and 2 days working from home. Are you a passionate and skilled Data Engineer looking to make a tangible impact in a fast-paced, global food delivery platform? Do you thrive on building robust self-serve analytics platforms and scalable data pipelines that power critical business decisions? If so, Just Eat is looking for a talented mid-level Data Engineer to join our dynamic Customer & Partner Care Product Analytics team in London (or Amsterdam or Enschede) ! As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure to support partner data sharing. You'll collaborate closely with Sales, Product, Analysts, and other Engineering teams to ensure the seamless flow and accessibility of high-quality data across the organisation. This is an exciting opportunity to contribute to a data-driven culture within a company that serves millions of customers More ❯

Direct message the job poster from Fruition Group Job Title: Senior Data Engineer - 12 month FTC Location: London/Hybrid (2 days per week onsite) Salary: Competative market rate + bonus + benefits Why Apply? This is an exciting opportunity for an experienced Azure Data Engineer to play a key role in delivering the next phase … of a business-critical data programme. You'll apply your technical expertise across Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Responsibilities: Design, build and optimise scalable data solutions using Azure cloud technologies. Lead the … development of data pipelines in Azure Databricks, Data Factory, and T-SQL. Provide senior-level technical direction to onshore and offshore development teams. Translate data requirements into effective data engineering solutions. Collaborate closely with business stakeholders to ensure alignment with project goals. Maintain detailed documentation and ensure robust testing practices. Plan and More ❯

months ago Be among the first 25 applicants Location: Gurgaon, Bangalore, Chennai - India Experience: 7+ Years Job Type: Full-time, Permanent Job Summary We are looking for a Data Analyst – FinCrime with expertise in Business Intelligence (BI) & Data Visualization to join our Financial Crime (FinCrime) department within the banking domain. The ideal candidate will have experience … datasets, developing insightful reports and dashboards using Tableau, Power BI, and Matplotlib, and supporting fraud detection, anti-money laundering (AML), and other financial crime risk initiatives. Job Title: Data Analyst – FinCrime (Banking Domain) Location: Gurgaon, Bangalore, Chennai - India Experience: 7+ Years Job Type: Full-time, Permanent Job Summary We are looking for a Data Analyst – FinCrime … with expertise in Business Intelligence (BI) & Data Visualization to join our Financial Crime (FinCrime) department within the banking domain. The ideal candidate will have experience working with large datasets, developing insightful reports and dashboards using Tableau, Power BI, and Matplotlib, and supporting fraud detection, anti-money laundering (AML), and other financial crime risk initiatives. Key Responsibilities Design and More ❯

days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Senior Data scientist (Social Media App) - Equity-Only role 0.25% – 0.5% About Luupli Luupli is a social media app 'in-development', which will provide opportunities for diverse creators coming from marginalized communities. Luupli will highlight the work of diverse … a range of vested benefits. Once the app launches in the spring of 2024, this role will transition into a paid full-time role. Job Description: As a Data Scientist at Luupli, you will play a pivotal role in leveraging AWS analytics services to analyse and extract valuable insights from our data sources. You will collaborate … with cross-functional teams, including data engineers, product managers, and business stakeholders, to develop data-driven solutions and deliver actionable recommendations. Your expertise in AWS analytics tools and techniques will be crucial in shaping our data strategy and driving business growth. Responsibilities: Collaborate with cross-functional teams to understand business objectives, identify data More ❯

Data Engineer - Leading Fashion Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We're recruiting on behalf of a leading fashion brand based in London that's recognised for combining creativity with cutting-edge technology. They're on the lookout for a talented Data Engineer … to join their growing data team. This is a fantastic opportunity to work with a household name and play a key role in shaping data-driven decisions across the business. The Role As a Data Engineer, you'll be responsible for building and maintaining scalable, efficient, and reliable data pipelines. You'll … work across a modern tech stack with a strong focus on Google Cloud Platform (GCP) and collaborate with various teams to ensure data flows securely and accurately throughout the organisation. Key Responsibilities Design, build, and maintain robust data pipelines. Work with Python and SQL for data processing, transformation, and analysis. Leverage a wide range More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be … the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places … processing tools. Stron g technical proficiency in data modelin g , SQL, NoSQL databases, and data warehousing . Hands-on experience with data pipeline development, ETL processes, and big data technolo g ies (e. g ., Hadoop, Spark, Kafka). Proficiency in cloud platforms such as AWS, Azure, or Goo g More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be … the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places … processing tools. Stron g technical proficiency in data modelin g , SQL, NoSQL databases, and data warehousing . Hands-on experience with data pipeline development, ETL processes, and big data technolo g ies (e. g ., Hadoop, Spark, Kafka). Proficiency in cloud platforms such as AWS, Azure, or Goo g More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can transform enterprise operations? Do you possess strategic vision, technical expertise, and leadership skills to drive data-driven solutions? If so, you might be the ideal candidate for the Data and Analytics role in Mars's Global Pet … achieve growth and pet parent centricity. This initiative requires scalable digitization, thought leadership, technical know-how, and the ability to navigate complex challenges while leading a team of data and analytics professionals. The role involves developing and maintaining data pipelines and storage solutions to support analytics and machine learning initiatives, reporting to the Director of Data Engineering Solutions, and collaborating globally with engineering teams. Responsibilities include: Providing technical leadership to data and DevOps engineers. Designing and evolving scalable data platforms and assets. Establishing engineering standards, patterns, and frameworks. Driving DataOps adoption to improve operational efficiency. Embedding governance, security, and data quality practices. Collaborating with leadership and stakeholders to More ❯

Join Our Team as an Analytics Engineer! Are you passionate about turning complex data into actionable insights? Do you thrive on solving problems and enabling data-driven decision-making in the dynamic world of payments? If so, we want to hear from you! As anAnalytics Engineerspecializing in the payments space, you'll be at the forefront … of analysing payment transaction data, uncovering trends, and optimizing card issuance operations. Your work will directly shape strategic initiatives and improve business outcomes. Key Responsibilities Analyze large datasets related to payment processing and customer transactions to uncover trends and actionable insights. Develop dashboards and reports to track KPIs and support decision-making. Work with stakeholders to understand data needs and provide insights through presentations and reports. Deliver data-driven recommendations to support business objectives. Build and optimize data pipelines using dbt, ensuring clean and accessible data. Monitor data quality and implement validation processes in collaboration with data engineers. Create scalable data models in Snowflake using dbt More ❯