1 to 25 of 65 Data Lake Jobs in the UK excluding London

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not … Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »

We are searching for an experienced Senior Data Engineer someone to help deliver an ambitious and exciting data transformation programme for one of our technology clients. The position is offered on a remote basis with very occasional trips to the office (this is likely to be … Azure Data Factory and Databricks or similar. Languages - Python, Spark, Java, PySpark, Spark SQL or similar. Lakes - Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. SQL and/or data warehousing design patterns and implementation. Highly desirable skills (not … Migration, Data Governance, ETL, Databricks, Azure Data Fabric, Azure Data Factory, Azure Data, Delta Lake, Databricks Lakehouse, Python, PySpark, Spark SQL, SQL, Data Warehousing. Please note that due to a high level of applications, we can only more »

About the team The Data Architect role sits in the Data Authority team within Architecture and Software Solutions. The Architecture and Software Solutions Function is part of the Software Engineering and Complex Services Department, which sits within the Technology Business Unit. The role reports to the … Data Authority Manager dealing directly with the business to provide data centric solutions and data expertise support for business problems ranging from customer base acquisition, support to analytics, management and compliance reporting, and best practice guidance, the team is an agile working environment, key … Master Data Management In depth understanding of data management and storage systems (database, data container, data lake, data warehouse), with a focus on Microsoft Azure/Snowflake Ability to design and enforce data infrastructure policies, procedures and more »

Azure Data Architect Tourism and Hospitality industry 6 months + £(Apply online only) per day Inside IR35 Remote/London twice a week Spark, kafka, Azure, Databricks, python Leading consultancy firm are actively recruiting for an experienced Azure Data Architect expertise in designing and implementing data … Systems (GDS). The ideal candidate will have a deep understanding of Azure and Microsoft technologies, along with a proven track record in data modelling, future state architecture design, and data capability maturity analysis. This role is pivotal in shaping the data strategy and … that support both current and future business needs, ensuring scalability and performance. Technology Integration: Leverage Azure technologies, including Microsoft Fabric, Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), EventHub/Kafka/Confluent, and Synapse, to build and optimize data pipelines. Integrate more »

departments, maintaining a high standard of work. Your role will also involve continuously seeking opportunities to optimise the performance of the Data Lake and Data Warehouse to meet the evolving needs of the business. DATA ENGINEER – ESSENTIAL SKILLS: Experience with GCP (Google Cloud … Platform) Demonstrable with data catalogue solutions Working knowledge of Google BigQuery, Analytics Hub and BigLake Commercial experience with Data Lake and Data warehouse platforms TO BE CONSIDERED… Please either apply by clicking online or emailing me directly chelsea.hackett@searchability.com. By applying for this … our client in conjunction with this vacancy only. Key skills: Data Engineering, GCP, BigQuery, SQL, Data Catalogue, Data Lake, Data Warehouse, SQL more »

IT Cloud Platform Engineer, Bicep, Data Engineering, SQL, Data Lake, Part Remote IT Cloud Platform Engineer required to work for a Professional Services business based in Central London. However, this is mainly remote and you will only be expected to be in the office circa … wants to be at the forefront (or who is already) of as many of the following technologies: Data Engineering Data Lake Data Migration Bicep IaaS IaC (Infrastructure as Code) Azure Data Analytics Data Factory Data Fabric SRE …/DevOps SQL Someone who has maybe been a SQL DBA and moved into a Data Engineering role would be a good fit. The team and the environment is a really positive one to be part of and you will be encouraged (and supported) to move on to more »

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses … high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. * Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … pipeline development. * Strong understanding of data warehousing concepts and practices. * Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. * Knowledge of SQL and scripting languages like Python or Scala. * Hands-on experience with AI/ more »

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses … high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. * Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … pipeline development. * Strong understanding of data warehousing concepts and practices. * Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. * Knowledge of SQL and scripting languages like Python or Scala. * Hands-on experience with AI/ more »

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses … high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. * Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … pipeline development. * Strong understanding of data warehousing concepts and practices. * Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. * Knowledge of SQL and scripting languages like Python or Scala. * Hands-on experience with AI/ more »

Role: Data Architect Location: Birmingham Hybrid: Yes Contract Type: Permanent Salary: £62,986to £81,154 Your New Employer: Do you thrive on creating robust data strategies and architectures that enable business success? This is an exciting opportunity to join an inclusive workplace that values curiosity, autonomy … and working in the open. Hays Technology are working in partnership with Birmingham City Council to recruit a Data Architect to play a pivotal role in shaping their data landscape. You will be at the forefront of leveraging data lakes, data mastery … and data modelling to enable Birmingham City Council to build a culture where data-driven decision-making is at the heart of everything they do. This is a really exciting time to be joining the Digital and Technology Services team of Birmingham City Council, Europe's more »

Data Architect - specialising in enterprise data solutions Working with an award-winning personal line insurer renowned for being one of the UK's leading car and home insurance providers, our client, a sophisticated and dynamic organisation, seek to add to their talented team. As a Data Architect, you will be involved in, but not limited to: Supporting the Senior Data Architect in spearheading enterprise data strategies. Continual improvement of the enterprise data principles and blueprint designs. Participate in Solution Architecture Forum, helping to govern design or other projects … patterns. Experience required: Insurance/financial services domain knowledge (preferred) Expertise in at least two of these key technologies: Azure, Azure Data Lake, Databricks, Matillion, Snowflake and Power BI (must have) Analytical system data architecture and ETL design experience Hands on experience in designing and more »

are looking for A Data Engineer who will be responsible for implementing the changes and improvements required within the Data lake and the Data catalogue products. You will be delivering items ranging from large scale changes linked to business transformative programmes, to minor … Warehouse team and other departments, ensuring a high quality of work whilst always looking to improve the performance of the Data lake and Data warehouse to satisfy the ever-changing demands of the Business. The day to day work is interesting, challenging and fast … BigLake. Experience with data catalogue solutions. Experience with relational set based processing through SQL queries. Commercial experience working with Data lake and Data warehouse platforms. Data warehouse dimensional modelling. Ability to work as part of a team. Ability to work in more »

Data Architect - Hybrid Working We are currently working in partnership with one of our biggest Financial Services clients. They are looking to hire an experienced Data Architect to join the ever expanding team. The role also benefits from hybrid working. Job Role We require a Data Architect in an enterprise-wide role. Key duties involve supporting overall IT architectural governance, helping to define & drive the data strategy, and provide technical leadership regarding reference architecture & data principles. A regular part of the working day will involve project-level work: collaborating with … Skills and experience required: Insurance/financial services domain knowledge. Expertise in at least two of these key technologies: Azure, Azure Data Lake, Databricks, Matillion, Snowflake and Power BI. Event-driven architecture, including Lambda. Analytical system data architecture and ETL design experience. Hands on experience more »

a client base that includes many successful infrastructure, construction, and engineering clients. As we continue to expand, we are seeking a highly skilled Data & BI Consultant with deep expertise in Power BI and data engineering to join our dynamic team. This role is pivotal in helping … our clients harness the power of their data to drive strategic decision-making and achieve business objectives. The Role The Data & BI Consultant will act as a trusted advisor to our clients, providing expert guidance on how to leverage data for business success. This … best practices. Additional Skills (Nice to Have) Experience with Azure Data Fabric. Knowledge of other Azure services (e.g., Azure Data Lake, Azure SQL Database, Copilot, ChatGPT and Azure Machine Learning). Familiarity with cloud computing concepts and architecture. Education and Experience Bachelor’s degree in more »

Senior Data Engineer - Cloud-based (Azure or AWS) - Remote - to-£65K + benefits - Data Solutions Consultancy Services Provider Senior Data Engineer - Background: Our Client are looking for an experienced Data Engineer to be responsible for the implementation of their clients' cloud data … agnostic. Experience implementing solutions using at least one of the following technologies Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google Big Query, Alteryx, SSIS Demonstrable … understanding of data warehouse and data lake principles. Demonstrable data modelling techniques such as Kimball, Inmon or Data Vault methodologies. Demonstrable understanding of unstructured, semi-structured and structured data source types for databases, files, formats and APIs. Strong SQL more »

Data Architect - specialising in enterprise data solutions Working with an award-winning personal line insurer renowned for being one of the UK's leading car and home insurance providers, our client, a sophisticated and dynamic organisation, seek to add to their talented team. As a Data Architect, you will be involved in, but not limited to: Supporting the Senior Data Architect in spearheading enterprise data strategies. Continual improvement of the enterprise data principles and blueprint designs. Participate in Solution Architecture Forum, helping to govern design or other projects … patterns. Experience required: Insurance/financial services domain knowledge (preferred) Expertise in at least two of these key technologies: Azure, Azure Data Lake, Databricks, Matillion, Snowflake and Power BI (must have) Analytical system data architecture and ETL design experience Hands on experience in designing and more »

Data Architect A leading company seeks an experienced Data Architect to enhance their Data Platform. This role reports to the Lead Solutions Architect and collaborates with the Data Engineering and DevOps teams. Key Responsibilities Data Strategy and Governance: Develop data models, flow charts, and data lineage documentation. Manage and document the current data platform landscape. Define the technical direction and implement a robust data strategy. Set and uphold data governance policies. Data Management: Lead the design and implementation … regulations. Skills and Experience: Microsoft Azure Migration Expertise Design solutions to migrate data from traditional SQL databases to Synapse, Data Lake, and Blob storage using Data Factory. Perform a comprehensive analysis and document solution designs, migration plans, risk mitigations, and recommendations. Database Optimisation more »

Data Architect A leading company seeks an experienced Data Architect to enhance their Data Platform. This role reports to the Lead Solutions Architect and collaborates with the Data Engineering and DevOps teams. Key Responsibilities Data Strategy and Governance: Develop data models, flow charts, and data lineage documentation. Manage and document the current data platform landscape. Define the technical direction and implement a robust data strategy. Set and uphold data governance policies. Data Management: Lead the design and implementation … regulations. Skills and Experience: Microsoft Azure Migration Expertise Design solutions to migrate data from traditional SQL databases to Synapse, Data Lake, and Blob storage using Data Factory. Perform a comprehensive analysis and document solution designs, migration plans, risk mitigations, and recommendations. Database Optimisation more »

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses … data lakehouses, and AI/ML models that fuel our data-driven operations. Job Title: Azure Databricks Data Engineer Location: UK Wide Offices - Hybrid Role (predominantly remote working) Salary: £75,000 to £95,000 (Pension and Benefits & Bonus!) About The Job Your Considering: As … high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. * Develop and maintain secure data warehouses and data lakehouses: Implement data models, data more »

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses … data lakehouses, and AI/ML models that fuel our data-driven operations. Job Title: Azure Databricks Data Engineer Location: UK Wide Offices - Hybrid Role (predominantly remote working) Salary: £75,000 to £95,000 (Pension and Benefits & Bonus!) About The Job Your Considering: As … high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. * Develop and maintain secure data warehouses and data lakehouses: Implement data models, data more »

A growing Financial Services firm are looking for an experienced Data Engineer to join their team in Sunderland - they're fully up-and-running on Azure, making this an excellent role for someone to develop their skills with cutting-edge technologies. This role requires you to be in … effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well-suited to a Data Engineer or BI Developer with core competencies in Data … integration techniques Ideally experience and/or certifications with some of: Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse Analytics Excellent communication and requirements gathering skills Benefits Salary up to £65,000 depending on experience Annual salary increase based on performance more »

A growing Financial Services firm are looking for an experienced Data Engineer to join their team in Sunderland - they're fully up-and-running on Azure, making this an excellent role for someone to develop their skills with cutting-edge technologies. This role requires you to be in … effective ETL processes, and implementing data integration solutions using tools including Azure Data Factory, Azure Databricks, Azure Data Lake, and Synapse Analytics. This role would be well-suited to a Data Engineer or BI Developer with core competencies in Data … integration techniques Ideally experience and/or certifications with some of: Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Synapse Analytics Excellent communication and requirements gathering skills Benefits Salary up to £65,000 depending on experience Annual salary increase based on performance more »

Role : AWS Cloud Data Platform Solution Architect. Job Type : Fix term Contract Location: Peterborough (Hybrid) Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect. Careers …/knowledge/experience: Experience of AWS Data platform including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS Service Selection, Container design. Experience Designing DevSecOps pipelines. Experience … Pyspark. Good to have: Experience in Databricks platform. Insurance domain knowledge (Pensions & Annuity.) Understand the data platform solutions like data lake, data warehouse, data marts. AWS solution architect certifications. Rewards & Benefits: TCS is consistently voted a Top Employer in the UK more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data … tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. more »

quality EV installations across the nation. Our aim is to make the world a better place, one charge point at a time. The Data Engineer will work within … Zest’s Data team to ensure the suitability and availability of all data sources contained within the data lake through close collaboration with the IT development team. The role is also key to providing insights to business leaders through gathering requirements and presenting … processes. Key Accountabilities The role is responsible for the following: Working closely with IT development team for development and maintenance of Data Lake functionality Design and development of robust data models Build, optimize, and manage robust ETL (Extract, Transform, Load) processes. Documenting of processes for more »