26 to 50 of 354 Data Lake Jobs in England

responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks. Working alongside data architects and engineering teams, you will help deliver new data products, onboard data … external data sharing. Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth. Develop and maintain data ingestion, transformation and data product pipelines. Collaborate with data ...

design experience Experience with cloud and data technologies including Fabric, Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google BigQuery, Alteryx, SSIS or Informatica … Strong understanding of data warehouse and data lake principles Data modelling using Kimball, Inmon or Data Vault methodologies Experience with relational database platforms and advanced SQL Exposure to Python, R or Spark Awareness of AI and ML methodologies and their application ...

Help Shape the UKs Energy Future Data Engineer Opportunity with the Civil Works Alliance (CWA), Supporting Sizewell C As part of the CWA (Civil Works Alliance), you will support the building of Sizewell C. Sizewell C will be a 3.2-gigawatt power station generating low-carbon electricity …/CD & Release Management Technical Documentation Technical Azure Databricks, PySpark, Python & SQL Azure Data Factory Azure Functions Azure Data Lake/Lakehouse REST APIs & Third-Party System Integration Azure SQL Logic Apps Azure DevOps, Git & CI/CD Docker/Containers Data Quality ...

Cloud Data Architect - AWS-focusedAbout BIPBIP is an international consultancy specialising in business transformation, technology and innovation. We work with leading organisations to solve complex challenges and deliver meaningful, sustainable change.BIP xTech is our Centre of Excellence for technology consulting and digital engineering, bringing together specialists across modern … data platforms, cloud, data science, AI and emerging technologies.We are looking for a Cloud Data Architect to join our xTech team and help design and deliver modern, scalable and secure data platforms for major UK and international clients.The roleAs a Cloud Data ...

modelling, optimisation and supporting data solutions. You'll be working with Azure Databricks, Data Factory, Synapse, Data Lake, SQL and Python/PySpark. Key responsibilities: Build and enhance data pipelines across Azure and Databricks Develop ETL/ELT solutions … sources Transform and model data for use across analytics and reporting Support the ongoing development of the organisation's Data Lake and wider cloud data environment Troubleshoot pipeline and data issues, improving performance and reliability Help maintain strong standards around data ...

measures, calculations, and critical data elements. Support the migration of data and reporting assets into an Azure Data Lake environment. Build and maintain Power BI reports and dashboards. Develop reporting and analytics solutions to improve business insight and operational efficiency. Support data … measures, calculations and critical data elements. Knowledge of ETL frameworks and data integration processes. Experience with Azure Data Lake and dimensional modelling. Background in both data analytics and data engineering Hays Specialist Recruitment Limited acts as an employment agency ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

pharmaceuticals and life sciences, manufacturing, and technology, media and telecoms, with capabilities spanning strategy, transformation and operational excellence - all powered by advanced technology, data, AI and digital innovation. Clients value the company’s collaborative approach and the way its teams integrate seamlessly - all working with a shared understanding … AWS. What you will be doing Defining and implementing on premise or cloud architectures, (e.g. a cloud data warehouse, data lake or data platform) to enable digital transformation Working with clients on data warehousing, building operational ETL/ELT data ...

reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service Architecture and design concepts ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI.We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for experienced Data Architects to work on our projects with our public sector clients, helping to deliver Solirius’ services to the highest standard.The role will involve working ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … tangible impact. With strong communication skills and a consultative approach, youre comfortable engaging with clients, understanding their needs, and translating them into robust data architectures and platforms. You understand and align with Solirius Reply Values. The Role: We are looking for experienced Data Architects to work ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … tangible impact. With strong communication skills and a consultative approach, youre comfortable engaging with clients, understanding their needs, and translating them into robust data architectures and platforms. You understand and align with Solirius Reply Values. The Role: We are looking for experienced Data Architects to work ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for experienced Data Architects to work on our projects with our public sector clients, helping to deliver Solirius’ services to the highest standard. The role will involve ...

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

it. We pride ourselves on being an organisation of people who genuinely care about helping others. About the Team Data is central to Ofcom's work. We use data from a wide range of sources to understand regulated sectors and provide insight that informs critical policy … Fabric with Microsoft and Azure ecosystems. Cloud and Data Technologies Experience designing Azure-based data platforms. Strong understanding of warehousing, datalakes, ETL/ELT, integration, analytics and reporting patterns. Experience with Azure Data Factory, Databricks, Azure SQL, Azure Storage and related services. Experience with ...

stored procedures, supporting the migration to AWS Contribute to data pipelines, integrations and modern data warehouse/data lake development Work closely with business stakeholders to translate requirements into scalable technical solutions Collaborate with legacy data warehouse teams and support data … experience, including a good understanding packages and stored procedures You have experience with AWS and modern data warehouse/data lake architectures You're a confident communicator with strong stakeholder management skills - able to bridge the gap between business and technology You're comfortable taking ...

ourselves on being an organisation of people who genuinely care about helping others.About the TeamData is central to Ofcom's work. We use data from a wide range of sources to understand regulated sectors and provide insight that informs critical policy, operational and regulatory decisions. As Ofcom … operational practices.Experience integrating Fabric with Microsoft and Azure ecosystems.Cloud and Data TechnologiesExperience designing Azure-based data platforms.Strong understanding of warehousing, datalakes, ETL/ELT, integration, analytics and reporting patterns.Experience with Azure Data Factory, Databricks, Azure SQL, Azure Storage and related services.Experience with APIs ...

ourselves on being an organisation of people who genuinely care about helping others.About the TeamData is central to Ofcom's work. We use data from a wide range of sources to understand regulated sectors and provide insight that informs critical policy, operational and regulatory decisions. As Ofcom … operational practices.Experience integrating Fabric with Microsoft and Azure ecosystems.Cloud and Data TechnologiesExperience designing Azure-based data platforms.Strong understanding of warehousing, datalakes, ETL/ELT, integration, analytics and reporting patterns.Experience with Azure Data Factory, Databricks, Azure SQL, Azure Storage and related services.Experience with APIs ...

Cloud Data Engineer About the Job you are considering: We are seeking an experienced Cloud Data Engineer with expertise in AWS, Snowflake, dbt, PySpark, and SQL to design, build, and maintain scalable cloud-based data platforms and analytics solutions. The ideal candidate should have … Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … data lakes, data warehouses) and compute engine options (e.g., Spark, Databricks, Synapse Analytics, BigQuery).Implementing and optimising data lake and data warehouse solutions on cloud platforms using services such as object storage (e.g., S3, ADLS, GCS), cloud data warehouses ...

Data Architect – SC or DV Cleared Secure UK Government Programme | Contract | Inside IR35 | Hybrid Working We are supporting a high-profile UK Government programme that is strengthening and modernising its data capability across a complex, highly secure technology environment. The programme requires an experienced Data Architect to define robust data architecture, improve how information is structured and governed, and ensure that data can be used securely and effectively across operational and digital services. This is a strategically important role requiring someone who can combine strong architecture expertise with ...

transformation, and integration processes. Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments. Business Logic Development: Implement business logic, calculations, and data processing solutions using Python. Collaboration: Work closely with business stakeholders … analytical and problem-solving skills. Excellent stakeholder management and communication skills. Highly Desirable: Experience with Spark/PySpark. Familiarity with Azure Data Lake, Snowflake, or similar platforms. Knowledge of orchestration tools like Airflow or Azure Data Factory. Exposure to financial services environments. Experience supporting large ...

team you'll be working with:We are seeking a detail-oriented and capable Data Migration Engineer to join our Data & AI practice. The successful candidate will bring solid experience in data migration, ETL/ELT pipeline development, and cloud-based data … especially AWS GluePython/PySparkSQL querying and validationYAML configuration (desirable)Experience testing or supporting:ETL/ELT pipelinesData migration processesFamiliarity with:Data lake/Lakehouse concepts (e.g., Apache Iceberg)Distributed processing frameworks (e.g., Spark)Basic understanding of:ETL vs ELT approachesCloud-based data architecturesExposure ...