1 to 25 of 105 Remote/Hybrid Data Pipeline Jobs in London

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title: Data Architect – Azure Databricks/Azure Data Factory For London Market Insurance Exp Required – 10 years Plus Location: London About the Job you are considering … optimisation Unity Catalog, if applicable Databricks SQL, if applicable Cluster sizing and cost optimisation Security and access control patterns Azure Data Factory Pipeline orchestration Linked services and datasets Integration runtime Parameterised pipelines Triggers and scheduling Error handling and retry patterns Metadata-driven ingestion frameworks Monitoring and operational ...

platforms so they are reliable, secure, and easy to change. You will work across engineering and operations to automate delivery, improve data pipeline observability, and embed good governance so analytics and AI workloads can run at scale. You will be part of the Data Platforms … restricted environments. Delivering data applications in an automated and continuous fashion. Utilising tools like Airflow for orchestration and automating data pipeline deployments using DevOps tools and techniques (Docker, Containers, Terraform, Kubernetes) Building data pipelines using both cloud-native and open-source data ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With The Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety … projects and sectors. Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference ...

Lead Data Engineer Location: London, City (Hybrid) £ Highly competitive base with bonus and benefits Lead Data Engineer is sought by expanding central data platform team within a prestigious global wealth management organisation. This role offers the opportunity to help shape enterprise-wide data engineering standards, contribute to platform strategy, and build modern, scalable data solutions that support business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role ...

identifying data migration requirements. Onboarding datasets, users + workloads onto target platform. Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation. AWS Cloud Platform, S3, IAM, CI/… concepts, DevOps principles, Agile Delivery. Advantageous Skills: Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS/Healthcare data experience. Government/GOV.UK/Public Sector domain experience strongly preferred. Must be active SC Cleared or fully eligible ...

identifying data migration requirements. Onboarding datasets, users + workloads onto target platform. Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation. AWS Cloud Platform, S3, IAM, CI/… concepts, DevOps principles, Agile Delivery. Advantageous Skills: Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS/Healthcare data experience. Government/(url removed)/Public Sector domain experience strongly preferred. Must be active SC Cleared or fully ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

Data Migration Lead London (Hybrid) £75,000 - £90,000 + benefits We're partnering with a fast-growing fintech organisation building a modern, cloud-native banking platform used by financial institutions across the UK. Following continued client growth and major transformation programmes, they are looking to hire … senior data leader to own and drive data migration and broader data delivery initiatives across complex banking environments. This is a high-impact, business-critical role sitting between data, product, and programme delivery. The successful candidate will act as the primary owner ...

exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start … delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring ...

Robert Half Technology are assisting UK's market leading legal organisation to recruit a Data Engineer on a 12 month contract basis - Hybrid working - London based. A Data Engineer is required to join a growing data team and play a key role in expanding … Experience with data modelling principles and best practices. Hands-on experience working with enterprise data platforms and data pipeline development. Experience working with Azure Databricks. Strong problem-solving skills and attention to detail. Ability to work collaboratively within a cross-functional environment Experience ...

Data Engineer £70,000 - West London (Hybrid - 1 day onsite) We are seeking a Data Engineer to join a well-established, international organisation operating within a sustainability-focused industry. The business is undergoing a significant digital and data transformation, with major investment in modern … solutions in fast-paced environments Hands-on experience with Microsoft Fabric Proven track record working with ETL processes, data integration and pipeline development Advanced SQL/T-SQL skills Experience designing and implementing data models to support reporting and analytical use cases Ability ...

Data Scientist (Palantir/FDP essential) - £560/day (Inside IR35) - RemoteYou will require Palantir (FDP) experience as well and UK Citizenship to apply I'm currently looking for an experienced Data Scientist with strong Data Engineering capability to join a high-profile public … considered, your CV must clearly show experience with the following: *Palantir (FDP) *Python *PySpark *Exploratory Data Analysis *Data pipeline design/data engineering concepts *Dashboard/reporting dataset development *BI tools (Redshift, Databricks or similar) *Agile delivery environments If these technologies aren ...

Data Solution Architect Remote working £650-675/day overall assignment rate to umbrella 3-month initial contract Working with a market leading client who have a requirement for a Data Solution Architect to design, lead and deliver scalable, enterprise-grade data platforms. This … with Databricks (preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers ...

Senior Business Data Analyst Contract: £450-£550 per day Location: London, 1 day per week We are currently looking for a Senior Business Data Analyst (Data Architecture & Discovery) to join a, data-driven team on an initial 3-month contract focused … senior business stakeholders, this person will play a key role in helping the organisation understand, document and future-proof a complex reporting and data infrastructure environment. The successful candidate will act as the bridge between commercial teams and technical data specialists, helping to untangle legacy data ...

Data Migration Lead Contract: £450-£550 per day Location: London, 1 day per week We are currently looking for a Senior Business Data Migration Lead (Data Architecture & Discovery) to join a, data-driven team on an initial 3-month contract focused … senior business stakeholders, this person will play a key role in helping the organisation understand, document and future-proof a complex reporting and data infrastructure environment. The successful candidate will act as the bridge between commercial teams and technical data specialists, helping to untangle legacy data ...

streamline how we collect and process data. Key responsibilities: Own daily revenue reporting, including data extraction, validation and transformation across multiple systems. Pipeline Monitoring - You'll check that our data ingestion pipelines are running correctly and flag any issues, helping maintain the integrity … environment where priorities can shift quickly Familiarity with BI/reporting tools (e.g., Looker, Tableau, Google Data Studio) and data pipeline concepts Broadstone Resourcing Ltd acts as an Employment Agency and an Employment Business and all appointments will be made on merit alone. ...

Cleared Data Governance Manager - Contract Rate: Up to £620 per day (Inside IR35) Location: London or Manchester (1-2 days per week on-site) Contract: 6 months Clearance: Active SC required We're hiring an experienced SC-cleared Data Governance Manager to support the delivery … high-profile central government data programme. This role focuses on establishing and embedding robust data governance frameworks, ensuring data quality, compliance, and effective data management across complex government environments. This is a hands-on leadership role, working closely with data ...

hiring a Data Architect to define and implement an organisation-wide data strategy, building a modern, scalable, and AI-ready data platform. This role will sit at the heart of a major transformation programme, integrating fragmented data and enabling advanced analytics … investing heavily in technology to enhance engagement, optimise operations, and unlock the full value of their data. Description Define and lead the enterprise data strategy , governance model, and data policies Design and implement scalable data architecture across multiple business domains (HR, Finance, Commercial ...

Initial 3 months (strong extension potential) IR35: Inside IR35 Clearance: BPSS required Overview We're seeking an experienced Business Intelligence Engineer/AWS Data Engineer to support the development of a modern data platform and contribute to emerging AI-driven initiatives. This role offers the opportunity … Strong hands-on experience with: AWS data stack (Glue, S3, Lambda, Redshift, Athena) Advanced SQL Python for data processing and pipeline development Exposure to tooling such as Terraform, APIs, or CI/CD pipelines (desirable) Experience working in Business Intelligence/analytics environments AI/ ...

Senior Data Engineer** (Contract) Duration: 6 Months (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile We are seeking a highly skilled Senior Data Engineer with strong expertise … Python and Databricks to design, build, and optimise scalable data pipelines and platforms. You will play a key role in enabling data-driven decision-making by delivering reliable, efficient, and high-quality data solutions. Key Responsibilities Design, develop, and maintain scalable data ...

Data Engineer 12 months London - remote £466 pre day inside IR35 - Umbrella only Role description We are looking for an experienced Data Engineer to join the NHS England Digital Screening programme, contributing to the development of data dashboards and reporting products … Data Scientists, Analysts and UCD professionals. This is a largely remote role. Essential skills and experience Strong experience in data pipeline engineering, ETL development and PySpark Experience with Palantir products, including the NHS Federated Data Platform (FDP) Ability to ensure data ...

HEAD OF DATA £140,000 LONDON This is a senior opportunity to take ownership of data strategy within a fast-growing, product-led technology business. You'll have the chance to bring structure to a fragmented data landscape, make visible impact quickly, and build … data function with real autonomy. THE COMPANY Our client is a global technology business operating in the employee experience and benefits space. Following a recent merger, the organisation is entering a new phase of growth and scale. This role has been created to help unify data ...

Cleared Data Engineer - Contract Rate: Up to £650 per day (Inside IR35) Location: London or Manchester (1-2 days per week on-site) Contract: 6 months Clearance: Active SC required We're hiring an experienced SC-cleared Data Engineer to support a large-scale central government … data programme. This role focuses on building, optimising, and maintaining secure, cloud-based data pipelines to enable analytics, reporting, and insight across complex government environments. You'll work as part of a multidisciplinary data team alongside architects, analysts, and platform engineers, contributing to modern ...

Data Engineer ££45,000 - £53,000 GBP Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Engineer London | Hybrid Working 2-3 days on site | £45,000 - £53,000 + bonus + package Must be Sole British Citizen A leading consultancy operating within … complex digital, cyber and data environments is looking to hire a number of Data Engineers to join their growing London team. This is an excellent opportunity for someone with around 2-4 years' experience who is looking to further develop their data engineering career ...

Lead Data Engineer | Microsoft Fabric | Azure | AI London Hybrid | 2-3 days per week £60,000 - £70,000 + 10% bonus + excellent benefits If you enjoy building data platforms rather than simply maintaining them, this could be worth a look. Were supporting a well-established … Experience around some of the following would be useful: Azure Data Engineering environments SQL and data modelling ETL/ELT pipeline design Azure Synapse Azure Data Lake Microsoft Fabric Power BI Azure DevOps API integrations Exposure to AI, ML or Copilot-enabled initiatives ...