76 to 100 of 569 Permanent Data Lake Jobs

Data Lead Reporting to: City Manager Role Purpose The Data Lead is responsible for ensuring the effective management, quality, analysis, and reporting of data across a national charity's service. The role supports operational delivery, contractual performance, continuous improvement, and strategic decision-making through … high-quality data. Working closely with service managers, frontline teams, and central performance functions, the postholder will ensure alignment with the charity's Data Governance Framework, Delivery Framework, and One Data Platform. Key Responsibilities Data Leadership Act as the local lead for data ...

create, innovate, and help transform airport travel. Together, we can reach new heights. Together, we are Cavu. About The Role The Lead Data Engineer is responsible for overseeing the architecture, development, implementation, and maintenance of our data infrastructure, ensuring its efficiency, reliability and compliance with relevant … regulations. Supporting an existing team of data scientists, BI developers and analysts, this role will help provide the glue that empowers the business to capitalise on the wide range of data assets and drive value from the insight we extract. We develop advanced and actionable data ...

launching a transformational two-year programme to strengthen our data, reporting and insight capabilities, and we’d love you to be part of it. We’re looking for a Business Data Analyst to join us on an 18-month FTC, helping us deliver improvements … data quality, reporting, visualisation and insight capabilities. You’ll join our established Data Analytics and Governance Team, helping to shape how we manage, understand and use data across Affinity Water. You’ll work closely with business and technical teams to turn requirements into effective ...

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

deliver meaningful impact beyond commercial outcomes, this is a chance to combine professional excellence with genuine social purpose. More about the team The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining PfP's data … associated tech stack Strongunderstanding of Data Mesh principles (direct experience beneficial) Technical mentoring/coaching skills Extensiveexperience with Data Lake/Warehouse solutions Strong proficiency in multiple languages with SQL and Python as must haves In-depth knowledge of queryoptimization techniques and experience in fine ...

deliver meaningful impact beyond commercial outcomes, this is a chance to combine professional excellence with genuine social purpose. More about the team The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining PfP's data … associated tech stack Strongunderstanding of Data Mesh principles (direct experience beneficial) Technical mentoring/coaching skills Extensiveexperience with Data Lake/Warehouse solutions Strong proficiency in multiple languages with SQL and Python as must haves In-depth knowledge of queryoptimization techniques and experience in fine ...

Responsibilities Design, deliver, and support Data, AI, and automation solutions, including analytics, models, dashboards, and related platforms. Own the roadmap for trusted data foundations across BIS and divisions, covering master/reference data, data quality, governance, cataloguing, traceability, and access controls. Provide … data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately ...

products including data transformation, data modelling, and reporting on both on-premises and cloud environments Build modern data lake/lakehouse architectures that support scalable, flexible data processing Enhance platform integration by leveraging domain events to enable more efficient and real … data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ...

Senior Data Engineer Department: Services Employment Type: Permanent Location: Remote, UK Description We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure. You will be responsible … Data Factory, Azure Databricks). Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus. Knowledge of data governance ...

trusted data models, reusable datasets, reporting foundations and self‐service analytical capabilities. Bring the team onto a centralized snowflake data lake, starting from scratch and ensuring best practices for data stewardship are implemented (data modelling, quality and governance, for example). … analytics solutions. Act as the senior link between Ad Sales and central data platform teams, ensuring that the Snowflake data lake, ingestion patterns and governance controls support the division's current and future BI needs. Collaborating with engineers, analysts and technical teams across the BBC. ...

trusted data models, reusable datasets, reporting foundations and self-service analytical capabilities. Bring the team onto a centralized snowflake data lake, starting from scratch and ensuring best practices for data stewardship are implemented (data modelling, quality and governance, for example). … analytics solutions. Act as the senior link between Ad Sales and central data platform teams, ensuring that the Snowflake data lake, ingestion patterns and governance controls support the division’s current and future BI needs. Collaborating with engineers, analysts and technical teams across the BBC. ...

maintain consistent quality and performance across all platform components Manage dataset operations including creation, updates, and deletion across Snowflake and AWS data lake environments Provide technical support and troubleshooting for incidents, service requests, and enhancement requests with emphasis on timely resolution and minimal platform downtime Monitor … warehouse design and management Demonstrated expertise with Snowflake platform architecture, configuration, and optimization Strong experience with AWS services including data lake storage, compute, and related data platform services Proficiency in data modeling, SQL, and ETL/ELT processes Proven experience with ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Customer Data Business Analyst Customer Engagement Initiative (Digital Transformation Programme) Location: Reading (Hybrid – Tuesdays are anchor days) Duration: Initial 3 Months Contract Day Rate: Competitive (Inside IR35) We're looking for an experienced Customer Data Business Analyst to join a major Customer Engagement Initiative within … large-scale Digital Transformation Programme. This is a pivotal role focused on building the customer data foundations that will enable future loyalty, promotions, personalisation, customer engagement, and marketing capabilities . You'll play a key role in defining and shaping new customer data products, ensuring ...

from legacy/on-prem systems to AWS Develop and optimize data models for data warehouse/data lake (Redshift, S3) Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR) Implement data quality checks, validation, and reconciliation processes … data warehousing (Redshift, dimensional modeling) Proficiency in Python or Scala for data engineering Experience with S3-based data lake architecture (partitioning, cataloging, formats like Parquet) Experience migrating data pipelines from on-prem or other cloud platforms Understanding of data ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … pipelines using Azure Data Factory, Synapse, Fabric Pipelines, or Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising ...

maintenance of data warehouses, ensuring efficient storage and retrieval. Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data. Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions. Implement data governance practices within the data warehouse and data lake environments. General Participate in cross-functional teams to provide insights and recommendations for data-related initiatives. Participate in training and development opportunities to enhance technical skills and domain knowledge. Demonstration of safe ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Data, AI, Solutions & Engineering (DAISE) practice is looking for an experienced Data Engineer to join the team. In DAISE, we are focused on delivering value‐adding, sustainable data capabilities, aligned to our client’s specific needs. This expertise is applied across clients … . What you will be doing Defining and implementing on premise or cloud architectures, e.g. a cloud data warehouse, data lake or data platform to enable digital transformation Working with clients on data warehousing, building operational ETL/ELT data ...

tomorrow’s public sector skills demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span architecture, project management, data … scalable ETL/ELT pipelines using modern tools and frameworks. Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, ADF). Data Governance: Understanding of GDPR, PII, and secure data management principles. Communication: Strong data storytelling skills ...

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...