1 to 25 of 487 Data Pipeline Jobs in London

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain. Solid understanding of commodities data ...

Senior Data Engineer £72,000 GBP Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent The Opportunity A leading technology and digital intelligence organisation is seeking an experienced Senior Data Engineer to design, develop and maintain data engineering solutions supporting complex client … requirements, including work within the National Security and public sector environments. The successful candidate will combine strong technical data engineering expertise with the ability to lead engineering teams, engage with stakeholders and translate business requirements into effective, scalable data solutions. Working alongside data architects ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required.· Establish monitoring, logging and operational support processes for Fabric workloads.· Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues.· Support testing, release management and transition into live service.· Contribute to technical assurance reviews, identifying ...

data-enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target-state data models and modern data engineering principles. Partner with … including: Azure Data FactoryAzure Synapse AnalyticsMicrosoft FabricAzure Data LakeAdvanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production-grade data pipelines. Experience integrating data ...

Lead Data Engineer/Senior Data Engineer - AWS, Snowflake, CI/CD Location: Heathrow - 1-2 days per week onsite Contract: Immediate start until December 2026, likely extension into 2027 Rate: Up to £630 per day all-inclusive - Inside IR35/PAYE Lead Data … cloud data warehousing and modern data platform delivery. AWS data services, cloud-native architecture and data pipeline orchestration. DataOps, automated deployment, Infrastructure as Code and release automation. Agile software development, code reviews, test-driven development and engineering quality assurance. AI-assisted ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

world as well, creating the next generation of sustainable luxury for customers, driving industry change and championing our communities. JOB PURPOSEThe Data Engineer is accountable for the data products that underpin Burberry's reporting and analytics. Operating within cross-functional squads, the role works alongside Data … models or analyses developed in the business and engineering them into scalable, governed data products. Support L2/L3 data pipeline incidents where required, investigating and resolving data quality or pipeline failure issues in collaboration with the Data Platform Engineer ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI.We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps).Expertise in data ...

data we deliver to our clients is right. Sitting between data analysis and quality assurance, you will test the pipelines, data warehouses and lakehouse platforms that drive marketing, billing, credit and debt outcomes for clients across financial services, retail, energy, telecoms & media, water … using Sagacity SPHERE’s YAML-driven test framework, keeping coverage current as new data sources are onboarded Investigate failures and anomalies, distinguish pipeline bugs from source data issues, and log clear, evidenced defects developers can act on first time Work directly with clients ...

environment that's empowering, collaborative, and full of opportunities to turn today's challenges into tomorrow's solutions. Job DescriptionWavestone is seeking a Data Architect or Data Engineer to support the design and delivery of innovative data solutions for clients operating in complex, regulated … client-facing roles, or equivalent industry experience delivering data engineering and architecture solutions. Strong understanding of data engineering principles, including pipeline design, ETL/ELT, ingestion patterns, orchestration, and integration approaches. Experience designing or governing modern data architectures (lakehouse, warehouse, data ...

Cloud Data Architect - AWS-focusedAbout BIPBIP is an international consultancy specialising in business transformation, technology and innovation. We work with leading organisations to solve complex challenges and deliver meaningful, sustainable change. BIP xTech is our Centre of Excellence for technology consulting and digital engineering, bringing together specialists across … modern data platforms, cloud, data science, AI and emerging technologies. We are looking for a Cloud Data Architect to join our xTech team and help design and deliver modern, scalable and secure data platforms for major UK and international clients. The roleAs ...

Data Programme to build the foundational data capabilities required for those products: trusted, reusable data assets, reliable pipelines, data quality, lakehouse models and analytical products. These capabilities will support R&D products, AI applications, client intelligence and firm-wide decision support. This … documentation, evaluation evidence and clear statements of limitations and appropriate use. Use AI agents and coding assistants responsibly to accelerate exploratory work, pipeline development, testing and documentation, while retaining ownership of analytical judgement and verification. Initial Focus Establish foundational, governed and permission-aware data assets ...

Senior Data Management Professional - Data Quality - Entities Data (Private Markets) Location London Business Area Data Ref # 10052950 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole … picture for our clients, around the clock – from around the world. In Data, we are responsible for delivering this data, news, and analytics through innovative technology – quickly and accurately. We optimize the value of our data by combining domain and technical expertise to make ...

core fundamentals of our Data Engineering and Software Engineering (Data Platform) groups, this unified team combines deep data pipeline expertise with robust platform engineering capabilities. We are responsible for providing the software and infrastructure that enable Tripadvisor to better understand visitor preferences … that makes them the default rather than the exception. Apply AI to accelerate the team's own work (e.g., building reusable Claude skills for pipeline migrations and upgrades) and share those patterns with individual teams. Set and evolve engineering standards, patterns, and best practices for data modeling ...

Data Manager Salary: £65,000-£70,000 + Benefits Location: Hybrid - 2-3 days per week on-site Contract: Permanent An opportunity to build something from the ground up. Cedar Recruitment is partnering with an established organisation undergoing a significant period of technology and business transformation to appoint … Data Manager into a newly created position. With data currently fragmented across multiple systems and business functions, the organisation is looking to establish a more structured, connected and scalable data environment. This is a genuine greenfield opportunity to take ownership of the data ...

Data Architect (Senior/Principal) Location: Remote, with occasional travel to Blandford, Dorset Security Clearance: SC required Why Apply? An opportunity for a Senior or Principal Data Architect to shape the design and strategy of complex data platforms within an Army Digital environment. This … Engineering into architecture and strategy. Strong experience in data platform architecture, data integration, data modelling and complex pipeline design. Knowledge of data governance, assurance frameworks and data migration. Experience delivering data capabilities associated with ...

About the Role We are seeking talented and motivated data professionals with experience in Data Engineering, Data Analysis, or Data Science who are looking to further develop their careers towards Data Architecture . This role offers the opportunity to work … large-scale, business-critical data initiatives, helping organisations design, build, and optimise modern data platforms and solutions. You will collaborate with technical teams, business stakeholders, and customers to deliver high-quality data solutions that enable informed decision-making and drive digital transformation. Key Responsibilities ...

About the Role We are seeking talented and motivated data professionals with experience in Data Engineering, Data Analysis, or Data Science who are looking to further develop their careers towards Data Architecture . This role offers the opportunity to work … large-scale, business-critical data initiatives, helping organisations design, build, and optimise modern data platforms and solutions. You will collaborate with technical teams, business stakeholders, and customers to deliver high-quality data solutions that enable informed decision-making and drive digital transformation. Key Responsibilities ...

Data Engineer/Data Architect Location: London/Hybrid Salary: Dependent on experience Type: Permanent, with potential for an initial contract architecture engagement I'm working with a growing wealth management business looking to strengthen its data platform and bring greater consistency, accuracy … They're looking for a hands-on Data Engineer with strong architectural instincts who can take ownership of data quality, pipeline development and data modelling across multiple incoming sources. This isn't a traditional backend engineering role. The focus is on ensuring financial ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … Synapse , and Azure Data Lake . Hands-on experience with Spark (PySpark/SparkSQL) , ETL/ELT design, and data pipeline orchestration . Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working ...

Company DescriptionTalan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan Data x AI, innovation … heart of everything we do, and we have been recertified as a 2025 Great Place to Work. This achievement not only highlights Talan Data x AI's positive organisational culture but also strengthens its reputation as an employer of choice within the industry. We invest heavily ...

seeking an experienced Senior Data Engineer to design, develop and deliver high-quality data engineering solutions for complex client environments. You will work closely with clients, data architects, data scientists, analysts and other technical specialists to understand business requirements and build reliable … scalable data infrastructure. Your responsibilities will include developing data pipelines, managing cloud-based data platforms, improving data flows and ensuring datasets are accessible, secure and ready for downstream use. As a Senior Data Engineer, you will also provide technical leadership ...