1 to 25 of 212 Data Lake Jobs in England

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

week) Duration: Initial 6 months+ Robert Half are supporting a leading global risk consulting firm organisation on a major Finance Data Lake, Self-Service Reporting and AI Enablement programme and are seeking an experienced Enterprise Data Architect with deep Databricks expertise. This is a hands … Lineage Frameworks Experience integrating Dynamics 365 Finance & Operations (D365 F&O) into enterprise data platforms Experience delivering Finance Data Lake, Data Warehouse or Lakehouse programmes Strong stakeholder engagement and solution design capabilities Highly Desirable Previous experience working within specialist Databricks consultancies ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … best practice. Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL, Data Lake Storage or Databricks would be advantageous. Understanding of data governance, security, access control, data quality and data lifecycle ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, you’ll be responsible for providing SME guidance in traditional data architecture disciplines around data structures … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role As the Lead Data Engineer, you will be responsible for designing, developing, and maintaining modern data … development skills. Experience building and optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience ...

high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.Design and oversee the delivery of secure data warehouses and data lakehouses: Implement data … platforms with a strong understanding of data warehousing concepts and practices.Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory.Excellent problem-solving and analytical skills and strong communication and teamwork skills.Passion for data ...

responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks. Working alongside data architects and engineering teams, you will help deliver new data products, onboard data … external data sharing. Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth. Develop and maintain data ingestion, transformation and data product pipelines. Collaborate with data ...

estate rather than inherit someone else's blueprint. Day to day, you will provide authoritative direction across Microsoft Fabric, Data Lake, Databricks, Informatica MDM and Salesforce Data Cloud, working closely with the Director of Data & Analytics, delivery portfolios, the Platform Architect … Director of Data and Analytics and associated delivery teams, ensuring solutions align to enterprise standards across Azure Fabric, Data Lake, Databricks, Informatica MDM, and Salesforce Data Cloud Lead the architectural design and governance of the key technology and data programmes, bringing ...

modelling, optimisation and supporting data solutions. You'll be working with Azure Databricks, Data Factory, Synapse, Data Lake, SQL and Python/PySpark. Key responsibilities: Build and enhance data pipelines across Azure and Databricks Develop ETL/ELT solutions … sources Transform and model data for use across analytics and reporting Support the ongoing development of the organisation's Data Lake and wider cloud data environment Troubleshoot pipeline and data issues, improving performance and reliability Help maintain strong standards around data ...

Experience Essential Advanced experience of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake technologies Advanced knowledge of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake … query optimization, complex Stored procedures/views/functions) Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate. Experience of supervising/mentoring junior members of the team. Desirable Experience of NHS information ...

measures, calculations, and critical data elements. Support the migration of data and reporting assets into an Azure Data Lake environment. Build and maintain Power BI reports and dashboards. Develop reporting and analytics solutions to improve business insight and operational efficiency. Support data … measures, calculations and critical data elements. Knowledge of ETL frameworks and data integration processes. Experience with Azure Data Lake and dimensional modelling. Background in both data analytics and data engineering Hays Specialist Recruitment Limited acts as an employment agency ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts * Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: * Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts ...

accountability for end‐to‐end data architecture. Strong understanding of data modelling, data warehousing and data lake architectures (e.g. lakehouse patterns), and data integration using event driven and API led approaches. Experience designing architectures across hybrid cloud … MODCloud – ICE, ACE environments AWS data services (e.g. S3, Redshift, EKS, Kinesis) Azure data services (e.g. Data Lake, Synapse, AKS) GCP Kubernetes‐based platforms and containerised data services Telicent Understanding of NATO data standards, interoperability requirements, or multi‐national ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

Senior Azure Data Engineer 6-month Contract Cheshire Hybrid Are you an experienced Azure Data Engineer looking for the opportunity to help shape a modern enterprise data platform? We're working with a leading organisation undergoing a significant digital and data transformation … Cloud data migration experience Strong understanding of data quality, governance and production support Experience working with Azure Data Lake technologies Excellent stakeholder engagement and communication skills Desirable Experience Delta Lake Power BI optimisation Azure DevOps/CI/CD ITIL environments Experience ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for experienced Data Architects to work on our projects with our public sector clients, helping to deliver Solirius’ services to the highest standard. The role will involve ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

Cloud Data Engineer About the Job you are considering: We are seeking an experienced Cloud Data Engineer with expertise in AWS, Snowflake, dbt, PySpark, and SQL to design, build, and maintain scalable cloud-based data platforms and analytics solutions. The ideal candidate should have … Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions ...