26 to 50 of 61 Data Lake Jobs in London

consultancy seeking a Microsoft BI Stack Developer to design, build, and support end-to-end business intelligence and analytics solutions using the Microsoft data and analytics ecosystem. This is initially a 3 month contract with potential to extend and will be a hybrid role based in London … data services such as: Azure SQL Database/SQL Server Azure Synapse Analytics Azure Data Factory Azure Data Lake Support ingestion, transformation, and orchestration of data pipelines (in collaboration with data engineers where applicable). Governance, Security and Performance ...

people who care about building things properly, you’ll fit right in. You’ll Work With Azure Data Factory, Data Lake, Key Vault, Azure Functions Databricks, Delta Lake, Unity Catalog, PySpark, Spark SQL Medallion architecture, Lakehouse patterns, distributed compute CI/CD pipelines using … thrive in this role if you have: Strong hands‐on experience with Azure Data Services and Databricks Solid understanding of Delta Lake, Medallion architecture and Lakehouse patterns Proficiency in Python, PySpark and Spark SQL Experience building CI/CD pipelines using Azure DevOps Knowledge of data ...

passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing … category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program ...

evolve, offering continuous opportunities for development, influence, and leadership* Serve as the primary contact for architectural aspects of IT projects* Integrate business process, data, application, technical, and information security dimensions into cohesive IT solutions* Ensure solution architectures are documented using standard templates and tooling complying with Shell … architecture (event hub, event bus, Kafka), ELK* Intermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQL* Integration experience with Confluent/Kafka, API Management, Logic Apps* Practical agile experience in both start ...

Define the long-term technical vision and roadmap for our modern Data Platform, Mobius (including Data Warehousing, Data Lake, Streaming, and Governance tooling). Design and govern the reference architecture for core data infrastructure, ensuring optimal scalability, reliability, and security. Establish … engineering, with provable experience operating at a Principal, Staff, or equivalent level. Deep proficiency across the modern data stack (Snowflake, BigQuery, Delta Lake, Iceberg, Kafka, Flink). Proven track record designing scalable, self-service data platforms using cloud-native services (AWS/GCP) and infrastructure ...

active SC clearance to be considered. Responsibilities Design, build and maintain Databricks data pipelines using Apache Spark (PySpark & Spark SQL) Implement Delta Lake/Lakehouse architectures (Bronze, Silver, Gold) Develop scalable ELT/ETL workflows for batch and streaming data Optimise performance, reliability and cost … experience as a Databricks Data Engineer Strong PySpark and SQL capability Hands-on delivery within AWS, Azure or GCP Experience with Delta Lake , data lakes and data warehouses Strong understanding of data modelling and scalable pipeline design Experience with ...

Define the long-term technical vision and roadmap for our modern Data Platform, Mobius (including Data Warehousing, Data Lake, Streaming, and Governance tooling). Design and govern the reference architecture for core data infrastructure, ensuring optimal scalability, reliability, and security. … engineering, with provable experience operating at a Principal, Staff, or equivalent level. Deep proficiency across the modern data stack (Snowflake, BigQuery, Delta Lake, Iceberg, Kafka, Flink). Proven track record designing scalable, self-service data platforms using cloud-native services (AWS/GCP) and infrastructure ...

other Azure services). Strong Power BI capability (reporting + modelling) and ability to connect engineering outputs to analytics consumption. Understanding of Direct Lake semantic modelling design considerations (model creation, table choices, and enforcing access rules). Proven experience with ingestion and transformation patterns (ETL/ELT concepts), data … Experience across adjacent Microsoft services often paired with Fabric (e.g., Azure Synapse Analytics, Azure Data Factory, Azure Databricks, Azure Data Lake). Familiarity with Microsoft Purview and broader governance practices. Dynamics 365 CE and FO integration and analytics. Exposure to AI/ML enablement ...

JR110**The Role**We are seeking a dynamic and adaptable hands-on leader in architecture (cloud and solution) and engineering (digital and data) to champion best practices, develop solutions and support our technology evolution. This role is crucial for enabling the business and delivering a differentiated client … Proven ability to design and build Data Lakehouses using Microsoft technologies (Data Factory, Data Bricks, Data Lake, PowerBI).* Proficiency in software engineering languages such as Python, Java, C#, JavaScript, and TypeScript.* Deep knowledge of data engineering languages ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Penetration testing and security assurance Cloud security across Microsoft and Google environments Support key transformation programmes, particularly across data (data lake, analytics, data science platforms) Improve overall cloud security posture, including CSPM and visibility of risks Identify and address gaps, particularly across data ...

working with a global healthcare and insurance organisation who are making a real difference to people's lives. We require an experienced Senior Data Platform Engineer to join the AI and Data Platform teams. £100,000 + Bonus + Excellent Benefits Fully remote with occasional travel … Azure-based data solutions. * Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. * Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

Cleared Technical Architect – Data Platforms Truenorth are currently working with a leading technology consultancy on a Technical Architect (Data Platforms) opportunity, supporting the design and evolution of large-scale, cloud-based data platforms across a range of high-impact programmes. This role is ideal … time). Proficiency in Infrastructure as Code (Terraform). Experience with GitHub-based workflows and CI/CD pipelines. Experience with data lake and lakehouse architectures. Strong understanding of: Data ingestion patterns Data transformation and curation layers Data access and productisation ...

companies globally – with offices in New York, London, Madrid and Singapore. We are at an early and exciting stage of embedding AI and data capabilities across the firm. This hire is central to that effort. The Role: We are looking for a commercially minded AI and data … into the business in a practical, considered way Data Infrastructure and Reporting Help maintain and extend our Snowflake-based data lake, supporting data quality and accessibility across the business Build and maintain Power BI dashboards and reports that drive commercial decision-making across ...

engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory … Services and Databricks in enterprise environments. Proven delivery experience within the Lloyd's of London or London Market insurance sector Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns and data modelling. Strong Python, PySpark and Spark SQL capability Solid understanding of data governance Proven ...

Entry-level Data & AI Consultant role for individuals looking to build a career in data engineering and AI. You will work on real client projects, supporting the design and delivery of data pipelines, models, dashboards, and AI-driven solutions. This is not a passive … Support development of Power BI dashboards Assist in AI use cases (automation, simple models, insights) Work within Azure-based environments (Databricks, Data Lake, etc.) Test, validate, and document solutions Training Possible promotion within the organisation Moving onto a higher level apprenticeship Apprenticeship Standard Data technician ...

Principal Data Engineer Location: Remote Salary: Up to £95,000 Sponsorship: Not available VIQU have partnered with a nationally recognised organisation that has recently completed a full migration from on-premise infrastructure to Google Cloud Platform (GCP) and is now building a modern, domain-oriented Data … essential) Strong SQL and Python expertise Experience building cloud-native data platforms end-to-end Strong background in Data Lake/Warehouse architecture Proven experience implementing CI/CD and infrastructure as code Confidence to challenge stakeholders and influence technical direction Candidates without strong, proven ...

Senior AWS Data Engineer - SC Cleared Rate: Up to £475 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically a couple of days per month) in Telford or Hove Security Clearance: Active SC Clearance required Role … Overview We are seeking an experienced Senior AWS Data Engineer to support a large-scale central government data transformation programme . The role sits within a major data delivery area that provides data and analytics solutions aligned to critical business priorities, including ...

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients … senior, hands-on Data Engineer role. As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose ...

Senior ML/MLOps Engineer (MLflow) | Databricks | Azure) About Optima Partners We’re an advanced data & business consultancy helping major consumer brands transform through data-driven customer strategy, design, and engineering. Our clients include leading UK and global brands across financial services, retail, and more. Join … workflows Build scalable data & ML pipelines in Databricks (Delta, DLT, Jobs) Design and maintain Azure data architectures (Data Lake, Synapse, SQL DW) Create robust CI/CD pipelines for ML + data using Azure DevOps, Git, Jenkins Automate infrastructure with Terraform ...

Contract AI & Data/Jr Forward Deployed Engineer | Up to £500.00 Outside IR35 | 3 months (rolling) | Hybrid Monthly (UK) A fast-growing UK-based FinTech scale-up is looking for 2x Contract AI & Data Engineers to join their financial analytics platform team. Haven't held … PyTorch) Background in data engineering, analytics engineering, or similar Desirables: ETL/ELT pipeline experience Microsoft Fabric/Data Lake knowledge BI tools (e.g. Power BI, Tableau) Financial services or payments experience On Offer: £500.00 per day Outside IR35 3-month contract (rolling) Hybrid monthly ...

Data Engineer – Azure - Databricks/Fabric - Remote – up to £65,000 I’m currently supporting one of the UK's fastest-growing Microsoft data consultancies as they continue to scale their team. If you're a Data Engineer who wants to work on modern … this could be a great fit. What You’ll Be Doing In this role, you’ll be central to designing and delivering modern data solutions for a range of clients: Architect and deliver scalable data solutions using Databricks, Synapse, and Microsoft Fabric Build and optimise ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high quality services … reliable data products at scale. You ll work closely with cross functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands on role suited to someone who enjoys ownership, technical depth, and influencing ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high‑quality services … reliable data products at scale. You’ll work closely with cross‑functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands‑on role suited to someone who enjoys ownership, technical depth, and influencing ...

deterministic and observable decision pipelines Architect integrations with external risk/compliance vendors such as: LexisNexis Ekata AML engines Sanctions screening services Define: Data mapping strategies Orchestration patterns Fallback and resilience patterns Reduce lock-in while preserving regulatory robustness Design cloud-native, horizontally scalable risk services … event-based data persistence strategies Support: Batch AML monitoring Regulatory reporting Merchants Transactions Case management Ensure compatibility with enterprise data lake and analytics platforms Act as trusted adviser to Risk leadership Influence roadmap prioritization and capability sequencing Mentor engineers and domain architects Drive architecture standards ...