76 to 100 of 470 Data Lake Jobs in the UK

Responsibilities Design, deliver, and support Data, AI, and automation solutions, including analytics, models, dashboards, and related platforms. Own the roadmap for trusted data foundations across BIS and divisions, covering master/reference data, data quality, governance, cataloguing, traceability, and access controls. Provide … data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately ...

Senior Data Engineer Department: Services Employment Type: Permanent Location: Remote, UK Description We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure. You will be responsible … Data Factory, Azure Databricks). Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus. Knowledge of data governance ...

Data Lead Location: Notting Hill, London. Four days in the office and one from home Reporting to: Head of AI Transformation Scope: UK and US, across every team ABOUT TRIP TRIP's mission is to create calm in the everyday chaos for our community, offering next-generation wellness … work rather than doing it by hand. Take ownership of our data pipelines, including the existing BigQuery data lake and the feeds from our sales, marketing, CRM, finance and operations systems, and plan how they move to or connect with Snowflake. Monitor pipeline ...

designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 52,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core … building BI/Data Warehouse logical and physical models including normalised and dimensional models as required as well as data lake architectures Expertise in a minimum of one data modelling tool preferably Erwin and/or IBM Rational System Architect Expertise in running ...

designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 52,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core … building BI/Data Warehouse logical and physical models including normalised and dimensional models as required as well as data lake architectures Expertise in a minimum of one data modelling tool preferably Erwin and/or IBM Rational System Architect Expertise in running ...

Data Engineer - Belfast £45,000 to 60,000 GBP Hybrid WORKING Location: Belfast, Northern Ireland - United Kingdom Type: Permanent Data Engineer Location: Belfast Salary: Up to £60,000 Department: Data & Analytics We are looking for an experienced Data Engineer to join … growing Data & Analytics function in Belfast. This is a hands-on role focused on building and maintaining reliable data pipelines, supporting data migration and developing the underlying data infrastructure that enables high-quality reporting and analytics. The ideal candidate will have around ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … pipelines using Azure Data Factory, Synapse, Fabric Pipelines, or Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising ...

using cloud-based services, focusing on Microsoft Azure technologies such as Azure Data Factory, Azure Databricks, Synapse Analytics, and Data Lake Storage. You will collaborate with clients and internal teams to understand business requirements, troubleshoot data issues, and deliver robust solutions that enhance … pipelines using Azure Data Factory and Databricks. Implement data models and analytics solutions using Synapse Analytics and Data Lake Storage. Collaborate with clients to understand their data needs and provide tailored solutions. Develop and optimise ETL/ELT processes to maintain ...

using cloud-based services, focusing on Microsoft Azure technologies such as Azure Data Factory, Azure Databricks, Synapse Analytics, and Data Lake Storage. You will collaborate with clients and internal teams to understand business requirements, troubleshoot data issues, and deliver robust solutions that enhance … pipelines using Azure Data Factory and Databricks. Implement data models and analytics solutions using Synapse Analytics and Data Lake Storage. Collaborate with clients to understand their data needs and provide tailored solutions. Develop and optimise ETL/ELT processes to maintain ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

ingestion frameworks supporting batch and streaming workloads. Integrate data from multiple sources, including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on-premise systems. Implement data quality, validation, monitoring, and governance controls across the data … expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory. Git version control and software engineering best practices. Skills ...

ingestion frameworks supporting batch and streaming workloads. Integrate data from multiple sources, including Azure SQL Database, Azure Data Lake Storage Gen2, Microsoft Fabric, APIs, SaaS platforms, and on-premise systems. Implement data quality, validation, monitoring, and governance controls across the data … expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience with Azure Data Lake Storage Gen2 and Azure Data Factory or Microsoft Fabric Data Factory. Git version control and software engineering best practices. Skills ...

## Data Solutions ManagerApply: Hybrid: London, London, United Kingdom: Full time: Posted Today: R16502**Agency:**Omd**Job Function:**Consulting**Job Subfunction:**Technology Consulting **Job Description:**The successful **Data Solutions Manager** will:* Support onboarding of new clients and projects in a standardised way, making sure that … deliver data solutions in the most efficient and quality-driven way possible.* Work with appropriate stakeholders exploring data requirements and documentation for data projects (e.g. Dashboards, automated reports)* Define/Create documentations and training content for any changes in policies, or data ...

Data Architect - AI and Data (DV Cleared) Location: UK Clearance: DV clearance required You'll work on high impact national programmes, shaping how data is governed, trusted and used across Government and Public Services. You'll be part of a strong Data … complex organisations. Strong background in data modelling and design (e.g. dimensional modelling, data vault). Experience designing Data Lake, Lakehouse and Data Mesh architectures. Strong understanding of SQL databases and familiarity with columnar and NoSQL technologies. Experience designing data ...

do. It unites us, inspires us, and challenges us to be better every day, driven by our agile, performance-focused culture. The Principal Data Architect – Commercial Effectiveness will provide strategic and technical leadership for the organisation’s data architecture, ensuring data platforms, models … integration patterns enable scalable analytics, AI, and digital use cases for the Commercial Effectiveness Value Pool. Acting as the senior architectural authority for data, this role shapes long‐term data architecture strategy while remaining closely engaged with delivery teams to ensure designs are practical, consistent ...

products including data transformation, data modelling, and reporting on both on-premises and cloud environments Build modern data lake/lakehouse architectures that support scalable, flexible data processing Enhance platform integration by leveraging domain events to enable more efficient and real … data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ...

Data Product Lead (Supply Chain & Sales Analytics) Our client is seeking an experienced Data Product Lead to drive the design and delivery of enterprise-scale analytical data assets that support reporting, analytics, and business decision-making across Supply Chain and Sales functions. This … DevOps practices including CI/CD pipelines, automated testing, and release management. Technology Environment Microsoft Azure Data Platform, Azure Data Lake, Power BI, SQL, Python/PySpark, Modern Data Engineering & DevOps Tooling Click on the apply button or reach out directly. ...

seeking an experienced Clinical Data Enablement Manager (FSP) to support and enhance clinical data operations across modern cloud-based data platforms. This is an exciting opportunity for a data professional with strong technical expertise in data engineering, ETL/… Doing As a Clinical Data Enablement Manager, you will: Support end-to-end clinical data pipelines across data lake and data warehouse environments, ensuring reliable and traceable operations. Build, enhance, monitor, maintain, and troubleshoot ETL/ELT workflows and data ...

designs, develops, and operates critical digital environments that drive performance, resilience and sovereignty, helping public and private organizations worldwide retain control over their data and infrastructures, while meeting regulatory requirements. With more than 52,000 employees serving over 4,500 clients across 54 countries, Atos helps modernize core … building BI/Data Warehouse logical and physical models including normalised and dimensional models as required as well as data lake architectures Expertise in a minimum of one data modelling tool preferably Erwin and/or IBM Rational System Architect Expertise in running ...

Purpose Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data platform, tools … engineering role, ideally within a regulated environment Knowledge of the following is required: Modern Data platform concepts; Data Lake, Lakehouse, Data Warehouse, Data Vault ETL/ELT processes and designing, building and testing data pipelines Building data ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Agency: Omd Job Function: Consulting Job Subfunction: Technology Consulting The successful Data Solutions Manager will: Support onboarding of new clients and projects in a standardised way, making sure that we can deliver data solutions in the most efficient and quality-driven way possible. Work with appropriate … stakeholders exploring data requirements and documentation for data projects (e.g. Dashboards, automated reports) Define/Create documentations and training content for any changes in policies, or data requirements for our client projects Work with Data SMEs (subject matter experts) to ensure compliance ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly … expanding to help millions more drivers in the UK and Spain. To help fuel that growth, we need a Senior Data Engineer to join our Engineering team. This team is the beating heart of Prima. You’ll be joining over 350 engineers across software development, infrastructure, operations ...

Engineer in a Data Field Strong Azure data skills, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps& Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data ...

Rate: £550 per day (Inside IR35) Sector: UK Public Sector/Government Clearance: Active SC Clearance Required Overview We are seeking an experienced Data & Analytics Architect to join a high-profile public sector programme. This role will play a key part in defining, designing and governing enterprise-scale … data architecture solutions, enabling data-driven decision making and supporting the delivery of modern digital services across government. The successful candidate will work closely with business stakeholders, technical teams, delivery leads, and data professionals to establish strategic data architectures, analytics capabilities ...