26 to 50 of 1,519 Data Pipeline Jobs in London

serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering … providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. … Collaborate with data analysts data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. More ❯

serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering … providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. … Collaborate with data analysts data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. More ❯

serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering … providing technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. … Collaborate with data analysts data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. More ❯

our people, customers and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Overview: As a Senior Technical Consultant - Data and AI, you will be responsible for designing, implementing, and optimizing data and AI solutions for our clients. You will work closely with clients to understand their … business needs and translate them into technical solutions that leverage the latest technologies in data and AI. This role requires a deep understanding of data architecture, machine learning, and AI technologies, as well as strong problem-solving and communication skills. Key Responsibilities: Design and implement data and AI solutions that meet client requirements. Collaborate … with clients to understand their business needs and translate them into technical solutions. Develop and maintain data pipelines, data warehouses, and data lakes using tools such as Azure Data Factory, Azure Synapse Analytics, and Azure Databricks. Implement machine learning models and AI algorithms using frameworks like Azure Machine Learning, Microsoft Cognitive Services More ❯

through the Medallion architecture in Databricks . Data Transformation : Create and manage data models and transformations using dbt , ensuring clear lineage, version control, and modularity. Pipeline Orchestration : Develop and manage workflow orchestration using Azure Data Factory , including setting up triggers, pipelines, and integration runtimes. System Maintenance : Monitor, maintain, and optimize existing data … including notebooks, cluster configuration, and Delta Lake. Proficiency in dbt for transformation logic and version-controlled data modeling. Deep knowledge of Azure Data Factory , including pipeline orchestration and integration with other Azure services. Experience with data integration (e.g. : APIs, JSON, XML, Web Services) essential Expertise in Python and SQL for data manipulation and pipeline development. Hands-on experience implementing and maintaining Medallion Architecture (Bronze/Silver/Gold). Familiarity with CI/CD, Git version control, and agile development methodologies. Strong understanding of data warehousing principles, data modeling, and performance optimization. Experience with cron jobs , job orchestration, and error monitoring tools. Good to More ❯

and expertise are designed to support operational needs for our clients and deliver a seamless experience to customers in the moments that matter. We are looking for a Data Engineer to join our team and support with designing, implementing, and maintaining the data systems that support our Gen AI-driven applications and data-driven … Strong programming skills in Python and SQL. Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases. Deep experience with ETL processes and data pipeline development. Strong understanding of data warehousing concepts and best practices. Experience with cloud platforms such as AWS and Azure. Excellent problem-solving skills and attention to detail. … Spanish language skills are a bonus. Tools and Applications Programming languages and tools: Python, SQL. Big data technologies: Hadoop, Spark, NoSQL databases. ETL and data pipeline tools: AWS Glue, Airflow. Cloud platforms: AWS, Azure. Data visualization tools and data modeling software. Version control systems and collaborative development platforms. Our Offer Impactful More ❯

providing our customers with expertise on financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern … lake environment and the engineer will collaborate in cross-functional teams to gather requirements and develop the conceptual data models. This role plays a crucial part in driving data-driven decision-making across the organisation, ensuring data availability, quality, and accessibility for various business needs. This is not a line management role, but you … play a key part in guiding and upskilling more junior data engineers and setting data standards and guidelines. What You'll Do Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process, and present data. Ensure data quality, accuracy, and consistency. Collaborate with data More ❯

About us: Turning the fantasy of analytics, data and A.I. into reality... In a world where vast amounts of data are being created in a multitude of different ways, Lumilinks exist to help companies collate and use data in an automated and compliant way, creating live and actionable insights. We help businesses across the … Platforms: Proficient in using cloud platforms (e.g., AWS, Google Cloud Platform, Microsoft Azure) for data storage, processing, and deployment of data solutions. Data Pipeline Orchestration : Experience with workflow orchestration tools such as Apache Airflow or Prefect to manage and schedule data pipelines. Data Modelling : Strong understanding of data … governance practices to ensure data integrity and compliance. Monitoring and Performance Tuning : Experience with monitoring tools and techniques for optimising database and data pipeline performance, including query optimisation and resource management. APIs and Data Integration : Familiarity with RESTful APIs and experience in integrating data from various sources, including third More ❯

Job Title: Senior Data Engineer Location: London Victoria, Hybrid Reports to: Engineering Manager A bit about us At nudge we believe people need to be in control of their finances. nudge puts you in control of your money. Combining behavioural psychology, data, and personalised education, our financial wellness benefit empowers people to develop their financial skills … PepsiCo, to support the financial wellbeing of their employees. About the team Our team is united by the shared purpose to create brighter financial futures for everyone, everywhere. Data is at the heart of our decision-making. You’ll work closely with product, data, infosecand engineering teams. Role purpose You will be instrumental in designing and … building scalable data infrastructure, pipelines, and tooling to support advanced analytics, real-time data applications, and regulatory compliance. This is an opportunity to make a meaningful impact on the lives of thousands of people across the globe. What will you be doing? Things move fast at nudge, and we are always learning. This means we need More ❯

Join to apply for the Senior Data Analytics Developer role at Coveo Join to apply for the Senior Data Analytics Developer role at Coveo Are you the expert who transforms data into strategic insights to drive our success? As a Senior Data Developer, you will be at the heart of developing our … data platform. Your main role? Designing fundamental data models, creating data warehouses to facilitate business analysis, and improving data monitoring and observability solutions. Using advanced technologies, you will build efficient and scalable data pipelines. What’s exciting about this role? Your efforts will have a direct impact on uncovering essential … product insights and supporting the development of data-driven product features. Through your expertise, you will empower our teams to fully leverage data for strategic decision-making and optimized solutions. Here Is a Glimpse Of Your Responsibilities Collaborate with cross-functional teams to define data requirements and implement efficient data pipelines for More ❯

At Ascent, we are committed to protecting your privacy and handling your personal data responsibly. Work Preference Option(s): Hybrid model | Work from Office The creative mind behind every project Put your skills to the test to build solutions that continue to shape the world we live in. About Us We are Ascent! and we help our customers … solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data … to our offices. Our aim is to cultivate a positive atmosphere and sense of belonging by facilitating easy access to the office. About the role As a Senior Data Engineer, you will make an impact on the future of data-driven innovation by joining our dynamic, forward-thinking team. You’ll play a key role in More ❯

About Us We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions … machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in the brightest businesses and we employ the sharpest minds too! At Ascent, we also believe … to our offices. Our aim is to cultivate a positive atmosphere and sense of belonging by facilitating easy access to the office. About the role As a Senior Data Engineer, you will make an impact on the future of data-driven innovation by joining our dynamic, forward-thinking team. As a Senior Data Engineer More ❯

At Dufrain , we don't just build data solutions-we shape the future of data-driven decision-making. Do you thrive on solving complex challenges and turning data into powerful insights that drive transformation? We're looking for Data Engineers who havea broad range of data engineering skills, with a … focus on Microsoft Databricks. Experience with Microsoft Fabric or Snowflake is also highly desirable. ABOUT THE ROLE As a Data Engineer, you will play a key role in delivering high-quality data solutions for our clients. This role offers the opportunity to work across a variety of technologies and contribute to the growth of our Consulting … practice. ROLE RESPONSIBILITIES Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise … our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect More ❯

Position: Data Engineer Overview of the Role An established organisation is currently undergoing a data transformation and is seeking a skilled Data Engineer to join its growing data team. This role plays a key part in building and deploying modern data solutions based on Azure Databricks, enabling faster and more … informed business decisions. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to design scalable data pipelines, implement efficient data models, and ensure high-quality data delivery. This is a great opportunity to shape the future of data within the organisation while working … Git, Azure DevOps) for automated testing and deployment. Optimise Spark jobs, Delta Lake tables, and SQL queries for performance and cost-effectiveness. Troubleshoot and proactively resolve data pipeline issues. Partner with data architects, analysts, and business teams to deliver end-to-end data solutions. Stay current with emerging data technologies (e.g. More ❯

Job description Lead Data Engineer - 107311 Base Location: Could be based at any one of our network of 20 offices nationally, but will require travel to client sites: www.kpmg88careers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Technology + Data function is a cornerstone of our business. We do work that matters to our local business and … supporting technical innovation and adoption of cutting-edge solutions across the United Kingdom. Working on complex engagements including working closely with clients to design, implement, and manage scalable data solutions, this team is responsible for the delivery of cutting-edge technical solutions and trusted to get it right first time. KPMG is one of the world's largest … Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, and related tools. Microsoft Fabric - experience with dataflows, lakehouses, notebooks, and workspace management. Azure Synapse Analytics - pipeline and notebook creation, performance tuning, and data transformation logic. Power BI - data modelling, DAX, and visualisation development. Delta Lake - supporting structured streaming and batch data More ❯

About Bauer Media Audio Data & Decision Sciences Team The Data and Decision Sciences The Data and Decision Sciences (DDS) team is at the core of Bauer Media Audio with a mission to leverage data as a strategic enabler across our nine European markets. Our goal is to provide trusted, actionable insights and … robust data solutions that empower business growth, enhance audience engagement, and drive operational efficiency. The DDS team operates as a collaborative, cross-functional unit that bridges the gap between data and business strategy, delivering solutions that align with our organizational goals and market needs. We are structured to support our stakeholders with a combination of centralized … our European markets. Over the first six months, you will focus on critical migrations from legacy systems, international expansion of our competitions business, and strengthening our data pipeline infrastructure to support advanced analytics. About Bauer Media Group We are a media business focused on creating content that matters to millions of people across Europe. Our offering extends More ❯

Candidates should take the time to read all the elements of this job advert carefully Please make your application promptly. About Bauer Media Audio Data & Decision Sciences Team The Data and Decision Sciences The Data and Decision Sciences (DDS) team is at the core of Bauer Media Audio with a mission to leverage data as a strategic enabler across our nine European markets. Our goal is to provide trusted, actionable insights and robust data solutions that empower business growth, enhance audience engagement, and drive operational efficiency. The DDS team operates as a collaborative, cross-functional unit that bridges the gap between data and business strategy, delivering solutions that … our European markets. Over the first six months, you will focus on critical migrations from legacy systems, international expansion of our competitions business, and strengthening our data pipeline infrastructure to support advanced analytics. About Bauer Media Group We are a media business focused on creating content that matters to millions of people across Europe. Our offering extends More ❯

therapies for sleep disorders and epilepsy, and a growing portfolio of cancer treatments. Our patient-focused and science-driven approach powers pioneering research and development advancements across our robust pipeline of innovative therapeutics in oncology and neuroscience. Jazz is headquartered in Dublin, Ireland with research and development laboratories, manufacturing facilities and employees in multiple countries committed to serving patients … worldwide. Please visit www.jazzpharmaceuticals.com for more information. The Principal will be responsible for supporting complex or leading singular projects related to data engineering requirements and initiatives across Jazz Research and Development. The Principal will support data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD and Omics. Essential Functions Support the design … development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and other tools. Build More ❯

Social network you want to login/join with: Data Engineer – Growing Data & AnalyticsConsultancy Location: Greater Manchester (Hybrid) Salary: £50,000 – £60,000 with excellent benefits About the Company: The company is an ambitious, innovative, and rapidly expanding data consultancy dedicated to delivering impactful data solutions for a diverse client portfolio. The … culture is built on collaboration, continuous learning, and making a real difference through data-driven insights. The organisation prioritises a supportive environment that encourages growth, practical problem-solving, and technical excellence. Why Join the Company: Work on high-impact, diverse projects for impressive clients across finance, retail, manufacturing, and technology sectors. Be part of a supportive team that … a flexible hybrid working model with remote and on-site options. Enjoy a comprehensive package including 35 days holiday plus bank holidays, pension scheme, and ongoing training opportunities. Data Engineer (2+ Years of Experience) The company is looking for a talented Data Engineer to join the technical team. The successful candidate will be responsible for building More ❯

Daintta are a rapidly growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a Data Engineer, you will … work closely with our public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases. Key Responsibilities Assessing your clients' technical needs and understanding how their needs are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing aspects related to data engineering, identification of risks and proposing and implementing their mitigations) Modelling, structuring and storing data along with their More ❯

Social network you want to login/join with: Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. Our … broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise we’ve acquired with our 1000+ client base around the globe. … We have over 1500 employees across 20 offices who are focused on accelerating digital transformation. Thanks to a unique mix of company assets: State of the art data technologies, lean AI agile methodologies for fast delivery, and cohesive teams of the finest business consultants, data analysts, data scientists, data engineers, and digital More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise … will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and … data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's More ❯

technological advancements, using AI to create groundbreaking products and solutions. Our AI Team is committed to exploring AI and machine learning's full potential. Job Summary: As a Data Engineer on our AI Team, you will craft the foundation of our AI models and algorithms. You will build and maintain reliable data pipelines, ensuring data … and quality for our AI projects. Your work will directly influence our AI initiatives, contributing to innovative solutions for complex problems. Key Responsibilities Design, develop, and maintain scalable data pipelines using Databricks and Azure services. Perform feature set engineering, report preparations, and ML tasks. Work with data scientists, ML engineers, and collaborators to deliver high-quality … data solutions. Collaborate with the Data & Analytics Team on data infrastructure and ingestion. Discuss data inputs with Business Development and collaborators, advising on data integration. Ensure data accuracy and consistency across sources and systems. Optimize data workflows for performance and efficiency. Implement best practices for data More ❯

Direct message the job poster from Fruition Group Job Title: Senior Data Engineer - 12 month FTC Location: London/Hybrid (2 days per week onsite) Salary: Competative market rate + bonus + benefits Why Apply? This is an exciting opportunity for an experienced Azure Data Engineer to play a key role in delivering the next phase … of a business-critical data programme. You'll apply your technical expertise across Azure Databricks, Data Factory, Azure SQL, and SQL Server, contributing directly to the integration of financial data into a new Azure Data Platform. Responsibilities: Design, build and optimise scalable data solutions using Azure cloud technologies. Lead the … development of data pipelines in Azure Databricks, Data Factory, and T-SQL. Provide senior-level technical direction to onshore and offshore development teams. Translate data requirements into effective data engineering solutions. Collaborate closely with business stakeholders to ensure alignment with project goals. Maintain detailed documentation and ensure robust testing practices. Plan and More ❯