1 to 25 of 188 Permanent Data Pipeline Jobs in London

Location: London, Potters Bar or Bristol (Hybrid working options available) The Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate … guiding and upskilling more junior data engineers and setting data standards and guidelines. What you'll do Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process, and present data. Ensure data quality, accuracy ...

contracts, and data mesh to ensure a decentralized and consumer-oriented approach to data management Data Pipeline Development : Develop and optimise high-performance, batch and real-time data pipelines employing advanced streaming technologies like Kafka, and Flink. Utilise workflow … such as Databricks and Snowflake. Well-versed in various storage technologies including AWS S3, Google Cloud BigQuery, Cassandra, MongoDB, Neo4J, and HDFS. Adept in pipeline orchestration tools like AWS Glue, Apache Airflow, and dbt, as well as streaming technologies like Kafka, AWS Kinesis, Google Cloud Pub/ ...

Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing products and services. Working closely with experienced developers, data analysts, data scientists … instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of scalable data pipelines • Implement ETL (Extract, Transform, Load) processes to ingest data ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Robert Half Technology are assisting a market leading AI-driven data platform organisation to recruit a Data Platform Engineer paying c£125 - £150k per annum. Remote working (UK based). Role The Data Platform Engineer will be an expert level engineer within Snowflake … build scalable solutions within the Data Platform Perform root cause analysis on often complex errors to help ensure data pipeline availability Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 10 + ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer Manager Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Attractive Bonus & Benefits This newly created Data Engineer Managers position is an excellent opportunity for someone that enjoys being hands on technically as well as managing a small team … Data Engineers. It would suit those with official management experience, or potentially a Lead or Senior Engineer used to leading teams and now looking to take on more managerial responsibility. Our client is a well-established and rapidly growing global business with its headquarters based in London. ...

Data Engineer Manager Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Attractive Bonus & Benefits This newly created Data Engineer Managers position is an excellent opportunity for someone that enjoys being hands on technically as well as managing a small team … Data Engineers. It would suit those with official management experience, or potentially a Lead or Senior Engineer used to leading teams and now looking to take on more managerial responsibility. Our client is a well-established and rapidly growing global business with its headquarters based in London. ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

love our differences. Everyone plays a part, and comes together to work hard, go beyond, and make sure everyone feels they belong. Our Data team is growing, and we're hiring for an Analytics Engineer who can join our Comparison collective. Join us to start going beyond comparison. … ABOUT OUR DATA STRATEGY As part of the MONY Group Data Team, our goal is to drive business growth by building and maintaining data products that power analytics and personalized customer experiences. We work closely with teams across the business to ensure that data ...

Description Job summary: As a Lead Data Architect on the Markets Sales CDAO team in London, you will be responsible for defining data products and their attributes, analysing and restructuring existing data products, and ensuring high standards of data quality and accessibility … dynamic environment. You will collaborate with both Sales users and technical and analytical teams. Your expertise will drive the success of our data initiatives, ensuring that data products meet customer needs and enable a variety of high priority analytics initiatives. If you have strong background ...

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform.You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Lead Data Engineer Lead Data Engineer required to join my Clients Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

company is one of the largest technology start-ups in the region and Tech Unicorn. Position Summary: We are looking for a Senior Data Engineer to design, build, and scale the core data infrastructure that powers analytics, AI/ML , and Generative AI solutions across the organization. You will own end-to-end data pipeline development, drive architectural decisions, and ensure our data ecosystem is reliable, scalable, cost-efficient, and optimized for advanced AI use cases. ...

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions … strategic insurance project The ideal candidate will have deep expertise in Azure cloud services Azure Data Factory and Databricks with a strong understanding of data modeling data integration and analytics in the insurance domain Key Responsibilities Architect and design end to end data ...

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions … strategic insurance project The ideal candidate will have deep expertise in Azure cloud services Azure Data Factory and Databricks with a strong understanding of data modeling data integration and analytics in the insurance domain Key Responsibilities Architect and design end to end data ...

across all systems. Integrate multiple data sources into a unified platform for analytics and reporting. Monitor, troubleshoot, and enhance data pipeline performance. Collaborate with cross-functional teams to deliver robust data solutions. Implement best practices for ETL processes and cloud-based data engineering. Support CI/CD automation for data pipeline deployments. Your Profile 4–6 years of experience as a Data Engineer or Software Developer in data engineering. Strong expertise in Azure Databricks, Apache Spark, and big data technologies. Proficient ...

types of flexible working as well as location-based arrangements. Please speak to your recruiter to discuss more. The Role We recognize Data as a critical strategic driver to fuel our growth ambitions. We're looking for a motivated Business Analyst with strong data analysis experience … support the delivery of our Investments Data Strategy and enhance our data capabilities. The successful candidate will collaborate with stakeholders across the Business and Technology teams to clarify the business requirements, define the requirements for building data pipelines to develop our Data ...

advisers and their clients by combining our innovative proprietary technology with exceptional customer service. As we scale, we are growing our multi-disciplinary Data, Analytics&AI function to unlock the full potential of our data assets. About the Role This is a high-impact hands … leadership role with the opportunity to design and build Fundment's data and analytics infrastructure from the ground up. Reporting to our Head of Data&Analytics, you will create the data foundations that allow us to deliver data-driven insights, automated systems ...

pipelines and transformation workflows using Databricks and Python. Ensure data platforms support analytics, business intelligence, and emerging GenAI/ML needs. Pipeline Development & Workflow Management Develop, optimise, and monitor ETL/ELT pipelines across various data sources. Implement data validation, governance, quality … engineering within the organisation. Ensure data models and pipelines effectively support reporting and decision-making. Performance & Continuous Improvement Monitor system and pipeline performance, ensuring SLAs are met. Evaluate and implement new technologies and tools to improve data capabilities. Automate and streamline processes to enhance ...

grow our SAP practice. We are seeking an experienced SAP BW/4HANA Lead to own the design, delivery, and assurance of data warehousing and integration across large-scale S/4HANA transformation programmes. This role is critical to enabling enterprise-wide data integrity, auditability … performance for reporting, analytics, and compliance. The BW/4HANA Lead will be responsible for governing data modelling, extraction, transformation, and harmonisation across SAP S/4HANA, legacy systems, and external data sources. The ideal candidate will combine strong technical depth in SAP BW/4HANA ...