1 to 25 of 54 Data Pipeline Jobs in Central London

Seasoned and HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You A data engineer with advanced knowledge of SQL and hands-on experience with both relational and non-relational databases, supporting data needs in fast-paced, content-driven environments. Experience … to best practice methods with the current framework. Key Responsibilities and Accountabilities Design and Maintain Data Pipelines: Develop and maintain robust, scalable, and efficient data pipeline architecture to support current and future business needs. Engineering and Integration: Assemble large, complex datasets from a variety of structured and unstructured sources, ensuring they meet functional requirements. Process … using Python, SQL, and Google Cloud Platform (GCP) big data technologies, such as BigQuery, Dataflow, Dataproc and Cloud Storage. Business Intelligence Enablement: Prepare and transform pipeline data to support downstream analytics and feed BI tools (DOMO), enabling data-driven decision-making across the organization. Cross-Functional Collaboration: Partner with internal stakeholders More ❯

HuffPost UK. The additional brands echo the existing business ethos and allow for increased audiences and a further strategic diversification of revenue streams. About You An experienced Lead Data Architect & Engineer who is a positive, collaborative, proactive, self-driven professional with a passion for building scalable data solutions. Confident working across teams, and comfortable managing multiple … team goals and technical standards. Key Responsibilities and Accountabilities - what is delivered Design and Maintain Data Pipelines: Develop and maintain robust, scalable, and efficient data pipeline architecture to support current and future business needs. Engineering and Integration: Assemble large, complex datasets from a variety of structured and unstructured sources, ensuring they meet functional requirements. Process … using Python, SQL, and Google Cloud Platform (GCP) big data technologies, such as BigQuery, Dataflow, Dataproc and Cloud Storage. Business Intelligence Enablement: Prepare and transform pipeline data to support downstream analytics and feed BI tools (DOMO), enabling data-driven decision-making across the organization. Cross-Functional Collaboration: Partner with internal stakeholders More ❯

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Data Strategy Define and lead enterprise wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance, Modern data platforms: Cloud Data quality Management, metadata, lineage and data modelling Experience with Data integration, master data management (MDM) and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practises BI Tools Power BI, Tableau, Looker proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring that data is effectively utilised to inform business strategies and initiatives. Develop data plan to address data quality issues in line with More ❯

We are seeking a highly organized and technically skilled professional to join the Program SPACE team for implementing the ESG performance tool. The role involves end-to-end data integration, ESG technical data model governance, and contract interface management across corporate and local systems. The successful candidate will oversee data integration into the SPACE … ecosystem via the Federated Data Platform (FDP) (Microsoft Fabric), ensuring automation, consistency, and high-quality data flows to support ESG reporting and performance tracking. Your responsibilities Data Integration & Automation Lead data integration activities from corporate systems into the SPACE ecosystem via FDP. Manage and maintain contract interfaces with corporate and local entities … transfers. Design scalable data architectures for ESG data products. Coordinate with corporate IT, business, and local teams to ensure timely and secure data pipeline automation. ESG Data Model Governance Manage governance of the ESG technical data model, ensuring compliance and standards alignment. Supervise changes to the data More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be … the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places … processing tools. Stron g technical proficiency in data modelin g , SQL, NoSQL databases, and data warehousing . Hands-on experience with data pipeline development, ETL processes, and big data technolo g ies (e. g ., Hadoop, Spark, Kafka). Proficiency in cloud platforms such as AWS, Azure, or Goo g More ❯

An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other … data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help deliver data for visualisation solutions, such as Power BI Key skills required: Expertise in Python, Java, Scala, or other programming languages used to build data pipelines, implement data transformations More ❯

We are seeking a skilled Data Analyst with a good understanding in data modeling/data warehouse development , and business intelligence tooling to join my clients payments team, within the fintech space . This role is pivotal in building and optimizing data systems and pipelines that support analytics, reporting. Key Responsibilities Develop … high-quality Power BI and Tableau dashboards , supporting business teams in making data-informed decisions. Ensure data integrity, reliability, and performance through testing, monitoring, and documentation. Exposure to Data Modelling and Warehousing would beneficial as you will need to build data models or migrate existing ones. Drive best practices in data … and experience with scripting languages such as Python or Scala . Demonstrated ability to create impactful dashboards using Power BI and Tableau . Deep understanding of data pipeline orchestration tools (e.g., Airflow, dbt, Azure Data Factory). Experience working in agile, cross-functional teams, collaborating closely with data analysts, engineers, and business stakeholders. More ❯

totaled $13.8 billion. Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and … cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data More ❯

Data Operations Manager. Duration 6 months We are seeking a dynamic and driven Data Operations Manager to lead a team of data engineers. You will oversee the daily operations of our data infrastructure and ensure the accuracy, availability, and security of data across the organization. This role will lead a … team of data engineers and analysts, manage data workflows, and collaborate with cross-functional teams to support data-driven decision-making. You will support the Head of Data in the delivery of the data operations roadmap. Key Responsibilities for the Data Operations Manager: Data Infrastructure Management … Oversee the design, implementation, and maintenance of data pipelines, databases, and data warehouses. Process Optimization: Develop and refine data operations processes to improve efficiency, scalability, reliability and observability. Drive Engineering Excellence: Lead and manage all engineering activities across internal and external teams, ensuring high productivity and quality of execution. AWS Expertise: Strong expertise across More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … Integrate data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected Data Engineer, your background will include: 3+ years industry More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … technologies such as Apache Spark , Kafka , or Snowflake . A comprehensive understanding of the data engineering lifecycle, including Agile delivery , DevOps , Git , APIs , containers , microservices , and pipeline orchestration . Nice to have: DP-203 Azure Data Engineering/Microsoft Certified: Fabric Analytics Engineer Associate The ideal candidate will be a self-motivated team player More ❯

As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest … pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and provide excellent customer support service. Problem-solve in a More ❯

Power BI & Data Platform Developer Reports to: Head of IT About Harmony Fire Harmony Fire is one of Europe’s fastest-growing fire protection companies, ranked 72nd among the fastest-growing businesses in the region. Our mission is to make the UK safer — one building at a time — by delivering fire protection services that combine technical excellence with … we serve our clients, grow our business, and support each other. Key Responsibilities Design, develop, and maintain interactive Power BI dashboards and reports Extract, transform, and load (ETL) data from Salesforce , Simpro , Unleashed and other systems into the Microsoft Fabric Data Lake (OneLake) Build and manage data pipelines into Fabric using tools like Dataflows … looking for 3+ years of experience in Power BI development and/or data engineering Proven experience with Microsoft Fabric , including OneLake, Lakehouse , and data pipeline tools Hands-on experience extracting data from systems like Salesforce , Simpro , and ERP platforms into a data lake environment Strong DAX, Power Query (M), and More ❯

Job Title: Data Architect • Key Skills: SPARQL, Python, Clinical Knowledge Graph and GraphDB • Experience: 8+ Years • Location: London, UK •We at Coforge are seeking “Data Architect” with the following skill-set: Job Overview We are seeking a highly experienced Data Architect to support the ongoing development and continuous improvement of our Clinical Knowledge Graph … platform. This role is pivotal in enhancing technical architecture, streamlining processes, and ensuring high-quality delivery aligned with customer use cases. Key Responsibilities Design, develop, and maintain scalable data pipelines using SPARQL and Python. Create and optimize complex SPARQL queries for data retrieval and analysis. Develop graph-based applications and models to extract insights and solve … experience with SPARQL and Python. Strong understanding of graph databases (e.g., RDF, Neo4j, GraphDB). Experience in data modeling and schema design. Familiarity with data pipeline tools and frameworks (e.g., Apache Airflow, Luigi). Excellent problem-solving and analytical skills. Ability to work independently and collaboratively within cross-functional teams. Preferred Background Experience in Health More ❯

Profitable, innovative, and customer-obsessed, we’re on a mission to redefine how modern Job Summary We’re seeking a Senior Analytics Engineer to transform how we leverage data, automate reporting, and unlock actionable insights to drive our business forward. In this role, you’ll work closely with commercial, product, and leadership teams to turn raw data … and recurring BI tasks. Build and maintain dashboards in Looker Studio (and other tools as needed) to provide business users with timely, self-serve insights. Deep-dive into data to uncover the drivers behind key metrics—identifying trends, anomalies, and the “why” behind our numbers. Integrate new data sources (e.g., Stripe, CRM platforms) into our data … FinTech), especially in areas like compliance, payments, or SaaS metrics. Exposure to statistical analysis or experimentation (A/B testing, cohort analysis, etc.). Familiarity with data pipeline tools (e.g., Airflow) and modern data stack concepts. Why join us Unique opportunity . Be part of a company with direct access to tens of thousands of More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools. * Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment. * Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools. * Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL. * Prepare and preprocess large datasets to ensure More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Data Scientist - Property London – Hybrid Up to £65,000 About the Role A leading London-based data and technology company in the property space is looking for a Data Scientist to join their growing product-focused team. This is an exciting opportunity to work as a full stack/end to end Data Scientist, driving real business impact. You’ll collaborate closely with stakeholders to build and deploy ML models and data-driven tools that are core to the company’s commercial offerings. Key Responsibilities Identify and scope opportunities where machine learning and data science can enhance product offerings. Design and run experiments to test hypotheses and … support product development. Develop robust data pipelines to support science experimentation and production. Deploy, maintain, and monitor predictive models in live environments. Communicate findings and technical concepts clearly to both technical and non-technical audiences. Contribute to agile delivery workflows and cross-functional collaboration. What We’re Looking For Solid understanding of core data science techniques More ❯

Data Manager - Government & Social Impact 12 month contract with potential to extend Salary: £73,000 -£80,000 per year PAYE Location: London onsite Are you passionate about using data to drive social impact? A leading technology company is seeking a Data Manager to join their Government & Social Impact (GSI) team. This team works on … cutting-edge data projects that support government and nonprofit stakeholders globally. Key Responsibilities: Manage and maintain civic data sets, ensuring compliance and equitable support. Collaborate with internal partner managers and engineers to optimize data processes. Conduct QA, analyze complex datasets, and support election-time data updates. Test engineering pipelines and assist in … We’re Looking For: 5–10 years of experience in data operations, analytics, or a related field. Strong skills in SQL, Excel, Python, and data pipeline monitoring. Ability to translate complex data into actionable insights. Clear communication and experience working cross-functionally with internal teams. Background in government or political data More ❯

exciting journey as we build out our internal engineering capability, spearheading our tech transformation, building best in class products and tackling exciting and complex challenges along the way! Data is at the core of what we do at QiH, but our people are at the heart of our success! At QiH, we have created an energetic and target … at the forefront of designing, developing, and deploying ML models that power personalised advertising, customer journey analytics, audience segmentation, and real-time bidding strategies. Working closely with BI, data engineers, and product teams, you'll build scalable solutions that drive measurable business outcomes for some of the world's most recognised brands. Our infrastructure is powered by Google … Business Acumen: Ability to understand marketing and advertising concepts like customer lifetime value (CLV), attribution modeling, real-time bidding (RTB), and audience targeting. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills More ❯

Azure Data Engineer - 1/2 days onsite Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse, and Logic Apps. You'll work across the full data lifecycle … from ingestion to transformation and delivery - enabling smarter, faster insights. Key Responsibilities: * Develop and maintain data pipelines using Azure services. * Ingest, transform, and model data from diverse sources. * Optimise data flows for performance and reliability. * Support data quality and monitoring processes. * Collaborate with cross-functional teams in an agile environment. Collaboration With … Data Engineers, Architects, Product Owners, Test Analysts, and BI Teams. Skills & Experience: * Proficiency in Azure tools (Data Factory, Databricks, Synapse, etc.). * Strong SQL and experience with data warehousing (Kimball methodology). * Programming skills in Python, Scala, or PySpark. * Familiarity with Power BI, SharePoint, and data integration technologies. * Understanding of DevOps, CI More ❯

Lead Data Architect £75,000 - 83,000 GBP Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Lead Data Architect Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £67,000 - £76,000 (non-London)/Up to £83,000 (London) + Benefits … A respected digital consultancy is hiring a Lead Data Architect to join its growing Data Engineering practice. Known for delivering modern, human-centred services across public and private sectors, this organisation supports clients through meaningful transformation by combining data, design, and engineering. This role is ideal for experienced architects who enjoy shaping cloud-native … data platforms, working in multidisciplinary teams, and embedding data governance and architectural rigour across complex service ecosystems. The Role: As a Lead Data Architect, you'll play a key role in designing scalable, secure, and accessible data platforms that enable insight-driven decision-making. You'll work closely with engineering teams and More ❯

We’re looking for a talented Data Engineer to join a dynamic technology team driving innovation across a fast-paced and forward-thinking organization. This is a unique opportunity to be part of mission-critical projects that shape the way the company uses and understands its data. As a Data Engineer, you'll play a key … role in modernizing legacy platforms and building robust data pipelines using the latest Azure cloud technologies. You’ll work closely with cross-functional teams to ensure data is reliable, accessible, and valuable across all areas of the business. What you’ll be doing: Designing, building, and owning high-performance data pipelines and APIs Developing … processes to support analytics, reporting, and business operations Assembling complex datasets from a wide variety of sources using tools like SQL, Python, dbt, and Azure Supporting and improving data quality, data infrastructure, and performance Defining and documenting cloud-based data architecture and technical solutions Collaborating across teams and contributing to architectural decisions Troubleshooting data More ❯

Mid-Level Data Scientist Up to 65,000 West London (Hybrid, 3 days onsite per week) Company: This data-first property tech startup empowers businesses to make smarter decisions by turning complex data into clear, actionable insights. Leveraging rich UK property data and advanced data science, they provide deep customer … insights, predict behaviour, and enable hyper-targeted marketing. Responsibilities: Collaborate to develop data science solutions and outputs supporting the organisation’s product offerings Recognise opportunities to use data science or ML to solve product problems Develop data pipelines to support data science experimentation Show an understanding of the organisation and the benefits … of data science Develop, deploy and support science models in live production products Confidently talk about the benefits of data science approaches to existing and potential customers Requirements: 2/3 years in data science or a related field, or a Master’s degree. Proficient in Python (core skill), with strong experience in SQL More ❯

Lead Data Engineer – London – £120,000 Sector: AI Consulting | Client Delivery Type: Full-time | Hybrid Join a tech consultancy at the forefront of applied AI—helping global brands design and deploy intelligent systems that solve real business problems. They combine deep engineering know-how with domain expertise to build the data infrastructure that powers machine learning … and generative AI at scale. 🔍 About the Role As a Lead Data Engineer , you’ll play a critical role in delivering AI-driven solutions for clients—owning the architecture and development of robust, scalable data platforms that feed into machine learning models and intelligent applications. You’ll work closely with Data Scientists, MLOps Engineers … and domain experts to ensure clean, accessible, and production-grade data pipelines are in place to support experimentation and deployment. 🛠️ Key Responsibilities Build and maintain high-performance data pipelines to power AI/ML use cases Architect cloud-native data platforms using tools like Databricks , Airflow , Snowflake , and Spark Collaborate with AI/ML More ❯