226 to 250 of 353 Data Lake Jobs in England

Data Engineer – Azure/Databricks/3-month contract/Remote Data Engineer/Data Engineering/Azure/Databricks/Ingestion/Pipelines/API/Azure API Management (APIM)/Python/3-month contract/Outside IR35/Fully remote/…/WFH Duration – Initial 3 month Day Rate – £400-500 per day Outside IR35 Role/Responsibilities: Define and build a data lake architecture on Azure (ADLS + Databricks) Layered data model (bronze/silver/gold) for ingestion, processing, and reporting Develop ingestion patterns ...

train, evaluate, and deploy models at scale - forming the foundation of Hollywood's AI transformation.Our team sits at the intersection of large-scale data systems, machine learning, and high-performance computing. We own the full stack, from data ingestion and curation through distributed training and production … data processing pipelines.Familiarity with modern data storage and analytics technologies, including columnar data formats and data lake architectures.Strong debugging, problem-solving, and systems design skills.Experience collaborating effectively with cross-functional teams.Additional Expectations for Staff EngineersDemonstrated technical leadership across significant infrastructure initiatives.Experience ...

lead a team, manage senior stakeholders across multiple functions and markets, and oversee major change activity including ERP upgrades, AI, data lake and broader finance transformation initiatives.What you'll do:Develop the finance transformation strategy & roadmaps for Sky: to meet business priorities and in the broader organisation … transform finance operations, decision-making and colleague experience.Projects: deliver strategic change and transformation initiatives successfully, including ERP upgrades, AI and data lake initiatives. Lead complex business change programmes, ensuring successful adoption of new processes, technologies and ways of working across multiple markets and functions.Activate resources: defining, leading ...

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code ...

Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You’d drive out the cloud transformation, taking a lead on all things data related in a Google Premier Partner. You will actively engage with … robust ETL processes - thus ensuring the integrity of the data. Your role will be instrumental in the creation of a new data lake/warehouse/hub built in GCP. You are confident using the full suite of Google data products, IAC, CI/ ...

creating a smarter, more connected ecosystem where users and businesses thrive together. Role Overview As a key member of the Tencent Cloud Big Data team, you will be responsible for technical consulting and solution implementation for key overseas accounts. This role requires a blend of deep technical expertise … deep understanding of components like Spark, Flink, Elasticsearch, Doris, ClickHouse, and Trino., Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi) and Serverless data concepts. Familiarity with mainstream global cloud products such as AWS EMR/Redshift, Google BigQuery, Snowflake ...

successful multinational technology business is looking for a Data Engineer to join its growing data team in Central London. This role is hybrid – you'll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You'll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You'll take ownership of data reliability end-to-end, designing ...

Solution Architect – 6-month Contract Willis Re is building its global technology estate from the ground up, centered on data, analytics, and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics, and client-facing platforms. … Responsibilities Design secure, scalable, cloud-native solutions on Microsoft Azure, encompassing infrastructure, PaaS services, networking, identity, security, and observability. Architect data-lake platforms, designing performant pipelines, sound data models, and strong governance for large volumes of reinsurance placement, exposure, claims, and market data. Build proofs ...

entirely new network for the world's money.For everyone, everywhere.More about our mission and what we offer.Job DescriptionWe’re looking for a Lead Data Scientist to join our growing CRM Team in London. This role will give you the opportunity to have a direct impact on how millions … modelling and conditional average treatment effects for personalisation. You are familiar with dbt, Snowflake, AWS (S3, SageMaker), Airflow, and Trino/data lake stacks.You have prior CRM/marketing/e-commerce ML experience — customer lifecycle segmentation, campaign attribution, contact strategy optimisation.Office: London, UKSalary range: GBP 90.5K ...

midst of an ambitious enterprise-wide modernisation programme. This is a brand-new role within the business, reporting into the Group Data Director. As Data Architect, you will be responsible for defining and delivering the group data architecture strategy that underpins BI and self … governance frameworks, metadata management, and regulatory compliancIt would be a bonus if you have:Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability toolingExperience leading architecture workshops with both technical and non-technical stakeholdersA background providing technical ...

EngineerWe’re looking for an Analytics Engineer to join our client’s high-performing Business Intelligence team, helping to build scalable, high-quality data solutions that power reporting, dashboards and self-service analytics across the business.Working closely with BI Developers and business stakeholders, you’ll design and optimise …/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to work with modern cloud technologies in a collaborative, forward-thinking environment.What ...

seeking an experienced Senior Databricks Engineer to join a high-profile client project. This is an excellent opportunity for a skilled data engineering professional with strong expertise in Azure technologies and Microsoft Fabric to design and deliver modern cloud-based data platforms. Working as part … using Azure Data Factory and Microsoft Fabric. Develop high-performance data processing solutions using Python, PySpark, and SQL. Implement Delta Lake and Lakehouse architectures following industry best practices. Work with Azure Data Lake Storage (ADLS Gen2) to manage large-scale datasets. Optimise ...

Python Data Engineer – Investment Management90k, Bonus, 3 days a week in the office.Quant Capital is urgently looking for a Python Data Developer to join our high profile client.Our client is a well known Systematic Trading Hedge Fund. They like technology especially the opensource variety as well … passionate about.Day to Day the Python Data Engineer will:Support and monitor the end-to-end lifecycle of a data lake system, including fixing errors and building out further functionality.Assist ingestion of external data that will result in seamless integration of internal ...

technologies, and tools that empower you to own your career.Join MUFG, where being inspired is expected and making a meaningful impact is rewarded.The Data Fabric team is part of the Data Engineering & Business Intelligence (DEBI) Department, which is part of the broader Architecture, Middleware, Data Engineering & Business Intelligence (AMD) pillar of Technology. Data Fabric is responsible for designing and developing enterprise-grade solutions that support Data Virtualisation.It’s services are highly sought after across the firm, often collaborating with other departments, management, and the executive. NUMBER OF DIRECT REPORTSTwoMAIN ...

## Sr. Software Engineer - Data Query Platform - (London, Hybrid)Applylocations: United Kingdom - Londontime type: Full timeposted on: Posted Todayjob requisition id: R26425As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here … starts with you.**About the Role:** The data engineering team is on a mission to create a hyper scale data lake, which helps find bad actors and stop breaches. The team builds and operates systems to centralize all of the data the falcon ...

trusted BI products from model to report layer. Architect the platform — Lead the shift to a cloud-native lakehouse on Azure Databricks with Delta Lake and Unity Catalog. Establish Python-first standards and reusable framework patterns for the team. Rationalise KPIs — Drive "one version of the truth" for core … modern Azure data stack — and strong bridging skills for the legacy environment you're migrating from. Python, PySpark, Azure Databricks (Delta Lake, Unity Catalog, pipelines, notebooks, jobs), Azure Data Lake Storage Gen2, Azure Data Factory, Azure Key Vault, Power BI (complex model ...

including Specification Driven Development (SDD), API's and REST services, and Continuous engineering practices Database engines and technologies (SQL MI, Azure SQL etc. Data pipelines … processes using Azure Data Factory, Data Flow, Databricks/Spark (using Python & associated frameworks) and Azure storage (data lake, blob) You will need an Agile mindset with demonstrated experience working in fully Agile Scrum environments. This 6 month+ contract role is an excellent ...

RoleWe are seeking a talented Senior Software Engineer to help build and run the data services and platform behind Datalex's dynamic pricing and offer optimisation. This is a Python-first, backend and infrastructure-focused role: you will work on end-to-end solutions — from robust application code … optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue-based integration — including customer-facing ...

insurance. We support millions of customers worldwide, helping them navigate life's uncertainties with confidence. Job overview: We’re seeking a talented Lead Data Scientist to work on some of our most exciting and complex challenges, developing innovative data science solutions that really make a difference. You'll get to work with our state-of-the-art, cloud-based data lake, build sophisticated machine learning and Agentic AI models, and mentor a squad of talented data scientists. Having a real ...

What you'll be doing:We are seeking a Data Architect to lead the design and delivery of secure, cloud-based data platforms for UK Central Government departments. The role combines architectural strategy with delivery oversight – shaping target-state architectures while ensuring they are implemented pragmatically … patterns, including:Cloud-native data platforms (AWS, Azure, GCP).Snowflake, Microsoft Fabric, and/or SageMaker (multi-platform experience advantageous).Data lake and lakehouse architectures.Event-driven and streaming architectures.Data Mesh and/or Data Fabric principles (applied pragmatically, not theoretically).Data product-oriented design ...

ability to effectively collaborate with cross-functional teams Strong problem-solving and decision-making abilities Knowledge of agile project management methodologies Experience with data analysis and reporting Ability to adapt to changing priorities and work well under pressure Project management certification (e.g., PMP) is a plus Bachelor … harness the data from a variety of data tables at the bank and collate a Data Lake from which to extract a variety of AI reports to increase the banks customer strategy. By strategically implementing AI in these areas, a Digital Banking Operations ...

Genpact is a global professional services and solutions firm delivering outcomes that shape the future. With deep domain expertise, digital operations capabilities, data, AI, cloud, and platform-led transformation experience, Genpact helps global enterprises modernize operations and drive sustainable business value. As part of Genpact’s Microsoft Business … including data cleansing, mapping, validation, reconciliation, and cutover planning. Provide oversight on reporting and analytics design using Power BI, Data Lake, Dataverse, and Microsoft Fabric where applicable. Ensure non-functional requirements such as performance, security, scalability, auditability, and maintainability are considered in solution design. Review ...

Capital One UK is seeking a Senior Manager Architect in Data to shape the architecture of a cloud-based data ecosystem. You will lead cross-functional teams, influence senior stakeholders, and define standards for distributed data processing, data lakes, and data products. You will collaborate with engineers, data scientists, and governance teams to drive real-time data capabilities, ML/AI readiness, and scalable data platforms across the organization. #J-18808-Ljbffr ...

Senior Databricks Technical Engineer Up to £111,500 + 10% Bonus | UK Wide Hybrid | SC Clearance Ready to build data platforms that actually make an impact? We're looking for an experienced Senior Databricks Technical Engineer to join a growing enterprise data team where … platforms from the ground up Designing robust data pipelines using Databricks and SQL Working with modern Lakehouse/Data Lake architectures Delivering analytics and insight solutions that drive business decisions Improving platform performance, scalability and data quality Providing technical leadership within ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...