376 to 400 of 601 Data Lake Jobs in the UK

DevSecOps / Data Engineer

Hiring Organisation
Lorien Resourcing
Location
Southampton, UK
Employment Type
Full-time
Sector: ITReference: BBBH185994_1789574348 DevSecOps/Data Engineer Southampton (Hybrid - minimum 1 day per week onsite, Wednesdays)6 Months400pdInside of IR35 We are seeking an experienced DevSecOps/Data Engineer to join a major data delivery programme, developing secure, scalable cloud solutions within … pipelines. Essential Skills & Experience Strong Azure DevOps experience. Hands-on experience with Azure Cloud Services, including: Entra IDAzure BatchAzure Data Lake Storage (ADLS)Azure Data Factory (ADF)Databricks development experience, including Unity Catalog. Strong Apache Spark and Scala expertise. Infrastructure as Code using ...

Data Architect - Central Government

Hiring Organisation
NTT DATA
Location
London, UK
Employment Type
Full-time
What you'll be doing: We are seeking a Data Architect to lead the design and delivery of secure, cloud-based data platforms for UK Central Government departments. The role combines architectural strategy with delivery oversight – shaping target-state architectures while ensuring they are implemented pragmatically … patterns, including: Cloud-native data platforms (AWS, Azure, GCP).Snowflake, Microsoft Fabric, and/or SageMaker (multi-platform experience advantageous).Data lake and lakehouse architectures. Event-driven and streaming architectures. Data Mesh and/or Data Fabric principles (applied pragmatically, not theoretically ...

Lead Data Engineer

Hiring Organisation
LinuxRecruit
Location
London, UK
Employment Type
Full-time
Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You'd drive out the cloud transformation, taking a lead on all things data related in a Google Premier Partner. You will actively engage with … robust ETL processes - thus ensuring the integrity of the data. Your role will be instrumental in the creation of a new data lake/warehouse/hub built in GCP. You are confident using the full suite of Google data products, IAC, CI/ ...

Lead Data Engineer

Location
West of England, England, United Kingdom
London or Bristol (1 day a week in office) This is an opportunity to take ownership of a growing Azure-based data platform and play a key role in shaping its future. You will combine hands-on engineering with architectural decision-making, delivering a modern data environment that supports analytics, reporting, and business-critical applications. THE COMPANY They are a growing organisation investing heavily in data and technology to support continued expansion. Their data platform is central to business operations, reporting, and digital products, creating an opportunity to influence both ...

Lead Azure Data Engineering Architect – Lloyds Marketplace

Location
Greater London, England, United Kingdom
where people truly BELIEVE in what they are doing! We're committed to bringing passion and customer focus to the business. Lead Azure Data Engineering Architect – Lloyds Marketplace London Onsite - Hybrid Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human … marketplace. Good understanding of tools and platforms used across the Lloyd’s insurance ecosystem. Proficiency in Azure ecosystem: Blob Storage, Data Lake, Synapse Analytics, Databricks, Functions, and Monitor. Demonstrated expertise in analytics consulting, data analysis, and data analytics. Strong business acumen with ...

Data Engineer

Hiring Organisation
Tria Recruitment
Location
London, UK
Employment Type
Full-time
EngineerWe're looking for an Analytics Engineer to join our client's high-performing Business Intelligence team, helping to build scalable, high-quality data solutions that power reporting, dashboards and self-service analytics across the business. Working closely with BI Developers and business stakeholders, you'll design … optimise ETL/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to work with modern cloud technologies in a collaborative, forward-thinking ...

Data Engineer for Generative AI Data Lakes (Hybrid/Remote)

Location
United Kingdom
Synthesia is seeking a Data role at the intersection of applied research, data engineering, and ML infrastructure. You will manage the data lifecycle for researchers, working with over a million hours of video and audio data to power model improvements … scalable pipelines in a hybrid Europe setting. You will collaborate closely with model training teams to build a world-class data lake and drive longer-term data strategy. #J-18808-Ljbffr ...

Data Architect (Contract/London)

Hiring Organisation
Tenth Revolution Group
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
£400.00 per day
Opportunity | £400/day (Outside IR35) | Hybrid London (2-3 days onsite) We're working with a leading insurance organisation seeking an experienced Data Architecture Lead to support the evolution of its enterprise data platforms and drive key transformation initiatives. Key Requirements: Proven experience in Data … Insurance domain knowledge covering areas such as policy, claims, underwriting, billing, broker, customer, risk, or reinsurance data Knowledge of data lake, lakehouse, or modern analytics platforms such as Snowflake, Databricks, Redshift, Synapse, or Fabric. London Market insurance experience essential ...

Data Platform Engineer I

Location
Greater London, England, United Kingdom
team has grown extremely quickly as a result. With this rapid growth, we are looking for Platform Engineers to join our team. The data platform team works across the whole customer domain, handling everything from natural language understanding of our customer communications to processing billions of smart meter … application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit ...

Lead Software Data Engineer - Corporate Know Your Customer

Hiring Organisation
JP Morgan Chase
Location
Glasgow, UK
Employment Type
Full-time
make a meaningful impact on millions of customers worldwide. As a Lead Software Engineer at JPMorgan Chase in the Corporate Sector's agile data engineering team, you will promote the development of a trusted Global Know Your Customer (KYC) and Risk Assessment Data Platform. You will … MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal)Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governancePractical cloud-native experience (AWS, Azure, or GCP)Ability to present and communicate effectively with senior leaders and executivesCommitment ...

Assistant Vice President, Data Virtualisation Lead

Hiring Organisation
MUFG
Location
London, UK
Employment Type
Full-time
tools that empower you to own your career. Join MUFG, where being inspired is expected and making a meaningful impact is rewarded. The Data Fabric team is part of the Data Engineering & Business Intelligence (DEBI) Department, which is part of the broader Architecture, Middleware, Data Engineering & Business Intelligence (AMD) pillar of Technology. Data Fabric is responsible for designing and developing enterprise-grade solutions that support Data Virtualisation. It's services are highly sought after across the firm, often collaborating with other departments, management, and the executive. NUMBER OF DIRECT ...

Senior Consultant Data Engineer

Location
Greater London, England, United Kingdom
thrive in it. Loyalty – We stand by each other and our mission. Job Summary About the Role Movar is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems. You will design and manage data pipelines that support analytics … engineers to deliver robust and reusable data products. Manage data lakes and warehouses using formats such as Delta Lake and Parquet. Implement best practices for data governance, performance, and security. Continuously evaluate and adopt new technologies to evolve Movar's data ...

Lead Software Data Engineer - Corporate Know Your Customer

Hiring Organisation
Hackajob Ltd
Location
Glasgow, Lanarkshire, Scotland, United Kingdom
Employment Type
Permanent
make a meaningful impact on millions of customers worldwide. As a Lead Software Engineer at JPMorgan Chase in the Corporate Sector's agile data engineering team, you will promote the development of a trusted Global Know Your Customer (KYC) and Risk Assessment Data Platform. You will … MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability to present and communicate effectively with senior leaders ...

Senior AI Data Platform & Data Space Architect

Location
United Kingdom
DATA is seeking a Forward Deployment Engineer specializing in AI data platforms and sovereign data spaces. You will work directly with clients to assess data ecosystems, design AI-ready platforms, and deliver production-ready solutions that accelerate AI transformation. Ideal candidates have … 5+ years in enterprise data roles, strong experience with data lakes, lakehouses, data warehouses, ETL/ELT, APIs, and modern data architectures, in a cloud/hybrid environment. #J-18808-Ljbffr ...

Data Engineer - Investment Management

Hiring Organisation
Quant Capital
Location
London, UK
Employment Type
Full-time
Python Data Engineer – Investment Management90k, Bonus, 3 days a week in the office. Quant Capital is urgently looking for a Python Data Developer to join our high profile client. Our client is a well known Systematic Trading Hedge Fund. They like technology especially the opensource variety … about. Day to Day the Python Data Engineer will: Support and monitor the end-to-end lifecycle of a data lake system, including fixing errors and building out further functionality. Assist ingestion of external data that will result in seamless integration of internal ...

Director of Data Engineering

Hiring Organisation
JP Morgan Chase
Location
Glasgow, UK
Employment Type
Full-time
changing career, working for one of the world's leading financial institutions, you've come to the right place. As a Director of Data Engineering at JPMorgan Chase within the Corporate Sector, you provide expertise and engineering excellence as an integral part of an agile data … MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal)Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governancePractical cloud-native experience (AWS, Azure, or GCP)Ability to present and effectively communicate with senior leaders and executivesDemonstrable ...

Finance Automations Developer

Location
Newcastle upon Tyne, England, United Kingdom
consistent delivery of such. Continue to drive "true" automation by converting manually triggered automation tools into robotically automated processes and/or data pipelines. Work with the IT Data Department to convert existing automations for data transfer into proper data pipelines, making … data tables available through the Data Lake. Create and maintain live reports for key metrics using Power BI, to replace Excel-based reports currently being produced both within the team and by managers across Finance Who we're looking for Process Automation Experience in office process ...

Data Engineer

Location
West of England, England, United Kingdom
Attachments Person Specification.pdf Job Description.pdf Full Time, Fixed Term - 18 months A great opportunity has arisen to join Bristol City Council's Data and Insight Team at an exciting time as we develop our Azure Fabric Data and Analytics Platform. You will join a team providing … corporate wide data and analytics to achieve the strategic objective of becoming increasingly data driven to facilitate better decision making. We require an enthusiastic, self-motivated and experienced Data Engineer that will be responsible for the loading and transformation of data from ...

Spark AWS Data Engineer in Glasgow: UK-Based Applicants Only

Location
Glasgow, Scotland, United Kingdom
visa sponsorship. Right-to-work in the UK is preferred. Foreigners may still enquire with the employer. Capgemini is seeking a Spark AWS Data Engineer in Glasgow, Scotland, offering a salary of £47,037.09. This full-time Tech role is ideal for UK-based applicants with existing right … eligibility. The position offers hybrid working, blending office and remote work for flexibility. Job Description This role involves designing, building, and maintaining scalable data pipelines, data lakes, and data warehouse solutions specifically on AWS. You will be at the forefront of developing high-performance ...

Sr. Software Engineer - Data Query Platform - London (Hybrid)

Location
Greater London, England, United Kingdom
## Sr. Software Engineer - Data Query Platform - (London, Hybrid)Applylocations: United Kingdom - Londontime type: Full timeposted on: Posted Todayjob requisition id: R26425As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here … starts with you.**About the Role:** The data engineering team is on a mission to create a hyper scale data lake, which helps find bad actors and stop breaches. The team builds and operates systems to centralize all of the data the falcon ...

Software Engineer III - Data Engineering- Corporate Know Your Customer

Hiring Organisation
Hackajob Ltd
Location
Glasgow, Lanarkshire, Scotland, United Kingdom
Employment Type
Permanent
make a meaningful impact on millions of customers worldwide. As a Software Engineer at JPMorgan Chase in the Corporate Sector's agile data engineering team, you will promote the development of a trusted Global Know Your Customer (KYC) and Risk Assessment Data Platform. You will work … MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability to present and communicate effectively with senior leaders ...

Data Engineering Lead - Cloud Data Lake & AI Solutions

Location
Reading, England, United Kingdom
seeking a Lead Data Engineer to drive enterprise-scale data solutions across cloud platforms. You will lead the data engineering team, shape architectural decisions, and deliver high-quality data products that enable automated decision making. You will work closely with architects … consultants in a hybrid environment, leveraging Azure Databricks, Microsoft Fabric, and SQL/Python to build scalable data pipelines and governance controls. #J-18808-Ljbffr ...

Data Engineer

Location
Birmingham, England, United Kingdom
Inside IR35 Location: Birmingham Working Pattern: Hybrid - 3 days per week onsite at Birmingham office We are looking for an experienced Senior Data Engineer to join a major enterprise technology programme within the financial services sector. You will be responsible for designing, building and optimising large-scale data … optimise data-processing solutions within AWS environments. Develop performant solutions using Java or Scala alongside advanced SQL. Support modern data lake and lakehouse architectures. Work alongside AI/ML teams to provide data platforms supporting Generative AI, machine learning and advanced analytics ...

Lead Data Engineer

Location
United Kingdom
solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Lead Data Engineer

Location
Bristol, England, United Kingdom
solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...