26 to 50 of 153 Data Lake Jobs in the UK

/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for data … Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory ...

insights. Key Responsibilities: Lead the design and architecture of end-to-end data platforms using Azure services (e.g., Azure Data Lake, Data Factory, Synapse, Fabric, Key Vault). Architect and optimise Databricks environments for data engineering & analytics. Develop data … data estate. Skills & Experience: Strong experience architecting cloud-native data solutions on Microsoft Azure. Hands-on expertise with Databricks (Delta Lake, Spark, notebooks, cluster management). Deep understanding of data modelling, warehousing, and distributed data processing. Experience with Python/ ...

/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices … Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory ...

models for credit risk and debt recovery. Provide insights to support the Bad Debt Transformation programme. Support the migration to a data lake environment, ensuring data integrity and accessibility. Create scalable, efficient SQL code and reporting frameworks. Embed analytics into strategic decision-making across … visualisation. Experience working in cross-functional teams and translating data into strategy. Familiarity with cloud platforms like Azure Data Lake, AWS, or Google Cloud. A degree (or equivalent experience) in Data Science, Mathematics, Statistics, or similar. A passion for continuous improvement and data ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … warehousing concepts and dimensional modeling Proficiency in SQL and Python Experience with Azure data services such as Azure Data Lake Storage (ADLS Gen2) , Azure Data Factory , and Azure SQL Familiarity with CI/CD pipelines and version control (Git, Azure DevOps) Experience ...

Role: Principal Data Engineer Salary: £85,000 - £100,000 per annum Location: Manchester (Remote/Hybrid) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to shape the Data … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think … development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary ...

client is looking for a Senior Data Engineer to join a multi-disciplinary team responsible for delivering a range of data and analytics outcomes in support of wider Technology Services teams. You will play a key role in the design, development, and maintenance of scalable data products and business intelligence solutions. This includes building robust data platforms, ensuring high standards of data quality, and providing actionable insights to support informed decision-making across the organisation. Key Deliverables & Outcomes Development of enterprise-scale data products, including data ...

Senior Data Engineer - Azure Data - Burton-on-Trent - Permanent - Hybrid Salary - £60,000 - £67,000 per annum This role requires 1 day/week in Burton-on-Trent, with hybrid working arrangements. Our client is seeking a highly skilled Senior Data Engineer to join … using Azure. Stay current with Azure technologies and identify areas for enhancement. Databricks (Unity Catalog, DLT), Data Factory, Synapse, Data Lake, Stream Analytics, Event Hubs. Strong knowledge of Python, Scala, C#, .NET. Experience with advanced SQL, T-SQL, relational databases. Azure DevOps, Terraform, BICEP ...

Role: Principal Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Role: Principal Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Should also have knowledge of testing, agile environments … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas … data pipeline development, maintenance, and optimisation for our client-facing products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

Days Onsite per week) Job Description Looking for L3 Data Engineer | Support | Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/… Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort ...

Senior Data Engineer Salary: Up to £70,000 I am working with a forward-thinking organisation that is modernising its data platform to support scalable analytics and business intelligence across the Group. With a strong focus on Microsoft technologies and cloud-first architecture, they are looking … experience with Power BI. Strong understanding of SQL, Python, or PySpark. Knowledge of the Azure data platform including Azure Data Lake Storage, Azure SQL Data Warehouse, or Azure Databricks. Some of the package/role details include: Salary up to £70,000 Hybrid ...

Senior Data Engineer Salary: Up to £70,000 I am working with a forward-thinking organisation that is modernising its data platform to support scalable analytics and business intelligence across the Group. With a strong focus on Microsoft technologies and cloud-first architecture, they are looking … experience with Power BI. Strong understanding of SQL, Python, or PySpark. Knowledge of the Azure data platform including Azure Data Lake Storage, Azure SQL Data Warehouse, or Azure Databricks. Some of the package/role details include: Salary up to £70,000 Hybrid ...

Engineer Telecom Domain (JD) Location: Ipswich, UK Permanent Employment 5 days onsite Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/… Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort ...

Role: Consulting Data Engineer Location: Bristol , UK Hybrid 2 Day in a week at Onsite RoleType: Permanent/Full time Job Salary: Depends on experience Role Summary: As a Consulting Data Engineer, youll help design, build and maintain data pipelines and platforms that enable … unlock the value in their data. Are you comfortable working in an ambiguous environment, where you build strong working relationships, and use data to understand client problems? Are you inquisitive and comfortable with questioning and challenge constructively? Sometimes youll work with experienced engineers and data scientists ...

Engineer Telecom Domain (JD) Location: Ipswich, UK Permanent Employment 5 days onsite Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/… Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort ...

doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data … Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management ...

Data Engineer - Azure & Databricks - £70,000 Location: Hybrid, London Employment Type: Full-time About the Role: A global leader within their relevant field is looking for an experienced Data Engineer to join a global organization and help deliver innovative data solutions. You'll work … cross-functional teams to define requirements and deliver solutions Requirements: Hands-on experience with Azure Data Factory, Databricks, SQL, Data Lake, Power BI Strong skills in T-SQL and DAX Experience in ETL development, data modelling, and data governance Familiarity with ...