76 to 100 of 487 Data Lake Jobs in England

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Customer Data Business Analyst Customer Engagement Initiative (Digital Transformation Programme) Location: Reading (Hybrid – Tuesdays are anchor days) Duration: Initial 3 Months Contract Day Rate: Competitive (Inside IR35) We're looking for an experienced Customer Data Business Analyst to join a major Customer Engagement Initiative within … large-scale Digital Transformation Programme. This is a pivotal role focused on building the customer data foundations that will enable future loyalty, promotions, personalisation, customer engagement, and marketing capabilities . You'll play a key role in defining and shaping new customer data products, ensuring ...

from legacy/on-prem systems to AWS Develop and optimize data models for data warehouse/data lake (Redshift, S3) Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR) Implement data quality checks, validation, and reconciliation processes … data warehousing (Redshift, dimensional modeling) Proficiency in Python or Scala for data engineering Experience with S3-based data lake architecture (partitioning, cataloging, formats like Parquet) Experience migrating data pipelines from on-prem or other cloud platforms Understanding of data ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporarybasis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data lakes, and integration solutions. Define and maintain data standards, frameworks, and best practices. Ensure the organisation's data architecture aligns with strategic business objectives. Lead data migration and transformation initiatives. Leadership & Management Provide technical leadership and mentoring to Data Engineers ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Data Engineering Lead role in Milton Keynes Salary range: £75,000 - £85,000 per annum Lead and develop a team of data engineers Requirement for substantial experience in data engineering At The Institute of Chartered Accountants England & Wales (ICAEW), you'll be part … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands‐on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Data, AI, Solutions & Engineering (DAISE) practice is looking for an experienced Data Engineer to join the team. In DAISE, we are focused on delivering value‐adding, sustainable data capabilities, aligned to our client’s specific needs. This expertise is applied across clients … . What you will be doing Defining and implementing on premise or cloud architectures, e.g. a cloud data warehouse, data lake or data platform to enable digital transformation Working with clients on data warehousing, building operational ETL/ELT data ...

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

seeking an experienced Enterprise Data Architect to define and lead the organisation's target-state data architecture, ensuring our data landscape supports business growth, operational excellence, regulatory compliance, and future AI-driven innovation.This is a strategic role at the heart of our data … management, finance, CRM, analytics, and AI platforms. Working closely with senior technology and business leaders, you will help shape a scalable and sustainable data ecosystem that reduces integration complexity, improves data accessibility, and enables advanced analytics and predictive capabilities.What you will do As our Enterprise Data ...

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...

products including data transformation, data modelling, and reporting on both on-premises and cloud environments Build modern data lake/lakehouse architectures that support scalable, flexible data processing Enhance platform integration by leveraging domain events to enable more efficient and real … data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ...

designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 52,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core … building BI/Data Warehouse logical and physical models including normalised and dimensional models as required as well as data lake architectures Expertise in a minimum of one data modelling tool preferably Erwin and/or IBM Rational System Architect Expertise in running ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

global enterprise. Role Overview: This position is for a technical lead for data acquisition within the AI Labs/Data Lake team. We are seeking a Lead Java Software Engineer to join our Wholesale Data and Operations Technology team. This position will serve … acquisition processes and will be instrumental in shaping the architecture, implementation, and ongoing evolution of our comprehensive AI Labs/Data Lake platform. This role demands a seasoned professional who can seamlessly blend hands-on technical expertise with strategic leadership capabilities to deliver robust, scalable data ...

global enterprise. Role Overview: This position is for a technical lead for data acquisition within the AI Labs/Data Lake team. We are seeking a Lead Java Software Engineer to join our Wholesale Data and Operations Technology team. This position will serve … acquisition processes and will be instrumental in shaping the architecture, implementation, and ongoing evolution of our comprehensive AI Labs/Data Lake platform. This role demands a seasoned professional who can seamlessly blend hands‐on technical expertise with strategic leadership capabilities to deliver robust, scalable data ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly … expanding to help millions more drivers in the UK and Spain. To help fuel that growth, we need a Senior Data Engineer to join our Engineering team. This team is the beating heart of Prima. You’ll be joining over 350 engineers across software development, infrastructure, operations ...