51 to 75 of 174 Data Lake Jobs in the UK

Data Engineer/Architect This organisation builds and manages critical healthcare infrastructure used by communities across the UK. As data becomes central to decision-making and innovation, they’re investing heavily in modern platforms and AI-led solutions. This role sits at the heart of that … pipelines Advanced Python and SQL skills Solid hands-on experience with Azure data services (Data Factory, Synapse, Data Lake, Functions, Logic Apps) Power BI data modelling and dashboard development expertise Practical experience using OpenAI APIs or similar AI/ML services ...

tailored to finance and retail business needs. Extract and transform financial and transactional data from Dynamics 365 via Azure Data Lake/Synapse/Data Factory (as applicable). Collaborate with finance and IT teams to understand data requirements and reporting … Dynamics 365 Finance and Operations data structures. Experience with Azure tools such as Data Factory, Synapse Analytics, Data Lake, or SQL Databases . Solid knowledge of data warehousing concepts and financial reporting. Ability to work independently in a contract capacity with ...

Permanent Job Summary: AWS Support Engineer/Data Engineer Telecom Domain (JD) Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/… Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort ...

Data Architect Edinburgh 6-Month contract Paying up to 69p/h (Inside IR35) Please note - due to the nature of the work, you will need to hold or be eligible to obtain a high level of UK Security clearance - please only apply if suitable Key Responsibilities: Design … implement enterprise-level data architecture solutions, including databases, data warehouses, and data lakes. Develop and maintain logical, physical, and conceptual data models. Define data management standards, policies, and best practices. Work with data engineers to design and optimize ...

Details Role/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management: Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing ...

Details Role/Job Title: Data Engineer Work Location: Manchester, UK Mode of Working: Hybrid Office Requirement (Hybrid): Tuesday/Wednesday/Thursday The Role Seeking a Data Engineer profile with deep technical expertise and thought leadership, provides advanced data solutions by using software … process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | 🌍 Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We’re hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you’ll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

patterns used across multiple teams and environments. Automate Azure platform deployments using Terraform, including: Azure Data Factory Synapse Analytics Data Lake & Storage Key Vault Azure networking and AI/ML services Implement and manage Terraform state, backends, workspaces , and strategies for drift detection and remediation. … large, multi-environment Terraform estates Proven experience deploying Azure Data Platform services using Terraform: Azure Data Factory Data Lake/Storage Synapse Analytics AI/ML services Strong experience building Terraform-driven CI/CD pipelines using Azure DevOps, GitHub Actions, or similar. ...

revenues as of 12 months ending December 2024 totaled $13.8 billion. Hybrid role: 3 days working from onsite. We are seeking an experienced Data Architect to design, govern, and optimize enterprise data platforms. The architect will lead end-to-end data architecture, data … modeling, and cloud-based data engineering strategies. Key Responsibilities: - Design scalable data architectures across OLTP, OLAP, and Data Lake environments. - Architect data ingestion, ETL/ELT pipelines, and integration frameworks. - Drive data modeling (conceptual, logical, physical) using best practices. ...

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms … data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Role Overview We are seeking an experienced Databricks Data Engineer to design and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. This is a hands-on role focused on building scalable data pipelines, optimising performance, and applying best practices … Experience 3+ years’ experience in data engineering within enterprise environments Strong expertise in Azure Databricks, ADF, Synapse, and Azure Data Lake Hands-on experience with Spark (PySpark/Spark SQL) and orchestration Strong data modelling and data warehousing knowledge Proficiency ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

Data Engineer Salary: £60,000 - £70,000 Location: Fully Remote (UK-based clients) About the Role My client, a leading Microsoft Partner, is seeking an experienced Data Engineer to design and deliver modern data platform solutions for a broad range of UK organisations, from … platforms and integration patterns, including: Microsoft Data & AI stack, including: Microsoft Fabric Azure Data Services (ADF, Synapse, Data Lake, Azure SQL, Analysis Services) Power BI (primarily upstream data modelling and preparation) Experience with on-prem/IaaS equivalents such as: SSIS ...

client solutions team at Verisk Maplecroft you will be a part of the team charged with using technology to create, collate and deliver data analytics and intelligence to our clients in a geospatial context. We are primarily a Python/Django house with an Angular front end. … projections, raster and vector manipulation within python and usage of GDAL Experience with AWS and data management tools, including data lake, data warehouse ETL, SQL based storage and PostgreSQL. Ability to design and implement data pipelines and data-related ...

hands-on work. What you’ll do: Own the Group BI roadmap and align it with business goals Build on existing data lake work, integrating multiple entities Develop and maintain ETL pipelines, dashboards, and reports Translate business questions into actionable technical solutions Integrate BI with … similar and dashboard design Knowledge of ETL, data lakes, and data pipelines (Python, DuckDB, Azure Data Lake) ERP integration experience Confident communicator with a consultative approach Experience in manufacturing, engineering, or distribution is a plus Why join? Build a group-wide BI function ...

Power BI Data Analyst (12-month FTC) Location: Remote (UK-based) Salary: £40,000 – £45,000 Sponsorship: No sponsorship available VIQU have partnered with a large, values-driven organisation operating at national scale within the education sector. Supporting a wide and diverse network of institutions, they … modelling Partner with stakeholders to translate business needs into actionable insight Support the evolution of the data platform and data lake Promote data literacy through guidance, training, and support Ensure strong data governance, access control, and reporting quality Key Skills & Experience ...

client, a speciality insurance broker, are looking for a Data Analyst to join our Data Analytics team, helping transform data into actionable insights … that drive smarter decision-making across our business.What You'll Be Doing: * Extracting, transforming, and presenting data from our data lake and data marts to support business performance * Designing and delivering visually engaging reports and dashboards using Power BI * Monitoring data ...

Senior Data Engineer Hybrid – 2 days per week in Leeds Salary up to £60,000 + bonus & benefits Are you a technically strong, commercially minded Data Engineer who thrives in modern cloud environments? Elevation Tech & Transformation are looking for a Senior Data Engineer … strong hands-on experience across modern data platforms, including: Proven experience with AWS data technologies: S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation Experience building and deploying cloud data platforms Infrastructure-as-Code and CI/CD practices (GitHub, CodeBuild, pipelines) Strong coding experience ...

/paternity pay – Life assurance – HolidayPlus – Cycle2work Scheme & more REQ5381 The Senior Systems Analyst is a senior technical specialist responsible for keeping HR data accurate, well-governed, and ready for migration to next-generation HR systems like Oracle Fusion Cloud HCM. The role leads complex data … projects, change control, and regression testing cycles. Collaborate with key stakeholders to define requirements and integration points between core HCM platforms, Data Lake, payroll, and reporting environments. Build advanced executive ready Power BI dashboards, data models, and self-service data sets, and scheduled ...

architectures , covering data ingestion, identity resolution, segmentation, and activation Define how the CDP integrates with, Data lake/lakehouse platforms (e.g. Databricks), CRM and sales platforms (e.g. Salesforce), Marketing automation and engagement tools (e.g. Braze) Apply strong understanding of batch vs real-time data … martech and data architectures , spanning CDP and identity resolution, Marketing automation and engagement platforms, CRM and customer-facing systems, Data lake/lakehouse platforms (e.g. Databricks). Proven track record of leading discovery, requirements definition, and solution shaping in complex or ambiguous environments Previous exposure ...

Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification … Doing Managing and maintaining large-scale Hadoop clusters across on-prem environments Supporting and optimising our HDFS-based Data Lake and adjacent platform components Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie , and related tooling Partnering with engineering teams to deliver scalable, high-quality data ...

Senior Manager: Data Officer - Sought by leading bank - London - Permanent Role Overview: We are looking for a Data Officer to lead the data governance, strategy and quality across its London Branch. This is a newly created role within the Risk function, working closely with … senior stakeholders to embed a strong, enterprise-wide data governance framework. Key focus areas: Data strategy & governance, policy and standards, data ownership & stewardship, data quality management, and regulatory compliance (GDPR, risk & audit). Ideal background: 6-8+ years in data ...

Lead Data Engineer - Hybrid - London - Azure - Databricks - £85k + Bonus I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned … Work With Lead the architecture, design, and delivery of Azure Data Services solutions (Data Factory, Data Lake, Azure SQL) Provide technical leadership in Agile delivery teams, mentoring engineers and influencing architectural decisions Design and implement scalable Azure-based data solutions ...

Details Role/Job Title: Data Architect Work Location: Dublin, Ireland Role Type: Contracting Mode of Working: Hybrid/Office based The Role The Data Architect will lead the assessment and design of customer's data landscape to enable seamless integration with … Skills/Knowledge/Experience Technical Expertise: Strong knowledge of SAP S/4HANA, SAP Analytics Cloud, SAP Datasphere, and large data lake (e.g., Snowflake MDH). Experience with ETL tools, APIs, and data integration frameworks. Proficiency in data modeling and architecture design. ...