51 to 75 of 139 Data Lake Jobs in the UK

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling’s such as CI/CD pipelines and version control. The ability … will be responsible for the Design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisations architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping stakeholders ...

Data Developer Widnes, Cheshire- Hybrid Working £39,602 per annum Permanent, Full Time 37 hours per week The Data Developer plays a critical role at Halton Housing, a forward-thinking organisation managing over 7,000 homes with around 330 colleagues, where innovation and customers … engineeringsolutions with Microsoft Fabric,SQLand Python. Developing & maintaining ETL pipeline solutions in Azure Data Factory, utilising Azure Data Lake &AzureDev Ops. Providingsecondandthird linesupport for Data Team and ownallocatedsupport tickets. Monitoring the Data Warehouse load and performance. Performing routine ...

This role is responsible for designing, building, and operating robust cloud-based data platforms that support large-scale analytics and reporting. You will work across the full data lifecycle, partnering closely with technical and non-technical stakeholders to deliver reliable, secure, and scalable data … structured and unstructured data, ensuring high standards of data quality and integrity Design and implement cloud-based data lake and data warehousing architectures Create and maintain analytical data marts using dimensional modelling techniques (e.g. star and snowflake schemas) Work ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Data Developer Widnes, Cheshire - Hybrid Working £39,602 per annum Permanent, Full Time 37 hours per week The Data Developer plays a critical role at Halton Housing, a forward-thinking organisation managing over 7,000 homes with around 330 colleagues, where innovation and customers … engineering solutions with Microsoft Fabric, SQL and Python. Developing & maintaining ETL pipeline solutions in Azure Data Factory, utilising Azure Data Lake & Azure Dev Ops. Providing second and third line support for Data Team and own allocated support tickets. Monitoring the Data ...

Data Architect Up to £90,000 (Dependant on Experience) This is a hybrid position, combining the best of both worlds - working from home and spending 1-2 days a week in ourHalifaxoffice. We have an exciting opportunity to join us here atCovéa Insuranceas a Data Architect … Data Vault, Kimball, Inmon, and medallion design patterns Broad experience with cloud and on-prem Data Warehouse, Data Lake, and Lakehouse architectures Relevant cloud/data architecture certifications (Databricks, AWS, Azure) preferred Confident working with stakeholders at all levels, including partners ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground‐breaking, ultra‐secure, high performance, cloud‐based data infrastructure for the enterprise. Our proprietary … Platforms – designing modern data platforms with appropriate architecture covering Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands‐on Public Cloud experience in either ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

Senior OPERA PMS & OHIP Data Integration Specialist – Hotel – London Daily rate: £500 - £600 (inside IR35) Duration: 6 – 12 months Location: London Start: ASAP We’re looking for a unique hybrid profile, someone who understands how hotel operations behave inside OPERA PMS and can translate that into clean, reliable … Mapping & Architecture Support Create detailed source-to-target mapping documentation Map OPERA data (via OHIP) into our Data Lake/Warehouse Ensure accuracy and consistency across all business scenarios Troubleshoot discrepancies between OPERA UI and downstream data Cross-Functional Collaboration Work ...

Senior AWS Data engineer (LDW Data Warehouse Discovery) Max Supplier Rate: £483 Clearance Required: SC ACTIVE Duration: 6 months Location: Telford with 2 days/week in office IR35 Status: Inside The role falls within the Data Contract Delivery Area of the clients contract. … Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses/Data Lakes/Lake Houses using Open Source and AWS tools. Adopt DevOps Practices: Utilise DevOps methodologies and tools for continuous integration and deployment (CI/CD). ...

work to directly improve people’s lives and health Here’s your chance. This is an opportunity for a Lead BI Developer/Data Analyst to take the lead in shaping the company’s data strategy and analytics platform . This isn’t just about dashboards … dashboarding - ideally enterprise-level deployments and licensing strategy. Solid knowledge of Azure data stack : Azure Data Factory, Data Lake, Azure SQL, and data warehousing. Ability to design ETL/ELT pipelines using visual tooling to move and transform data ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

maintain Python-based ETL pipelines across extract, transform, and load stages SQL development - stored procedures, views, and complex ad hoc queries Data lake development within Azure Synapse, working to our Bronze/Silver/Gold medallion architecture Leading feature specification - working with business stakeholders to define requirements … Strong Python for data engineering - production-quality ETL code, error handling, logging, and testing Hands-on experience with cloud data lake platforms and layered architectures (medallion/Bronze–Silver–Gold or similar) - Azure Synapse, Databricks, or equivalent Experience with orchestration tooling, CI/CD pipelines ...

consultancy seeking a Microsoft BI Stack Developer to design, build, and support end-to-end business intelligence and analytics solutions using the Microsoft data and analytics ecosystem. This is initially a 3 month contract with potential to extend and will be a hybrid role based in London … data services such as: Azure SQL Database/SQL Server Azure Synapse Analytics Azure Data Factory Azure Data Lake Support ingestion, transformation, and orchestration of data pipelines (in collaboration with data engineers where applicable). Governance, Security and Performance ...

Data Engineer Hybrid (2 – 3 days per month in the office) Greater Manchester £38,000 - £40,000 DOE Only candidates within a commutable distance of Greater Manchester will be considered. About the Role Our legal client is seeking a Data Engineer to join their Data … data environment. Within this role you will architect and manage the data ecosystem, develop pipelines, oversee the data lake and enable high-performance reporting through Power BI. You’ll collaborate with Stakeholders to deliver the data roadmap, ensure a single source ...

scalable Azure-based data pipelines Build and maintain ETL workflows supporting analytics and reporting Support Azure Synapse and Azure Data Lake production environments Contribute to the migration and adoption of Microsoft Fabric Develop and optimise data models supporting business intelligence Support Power … Requirements Strong experience in Azure data engineering Advanced SQL skills including performance tuning Experience with Azure Synapse and Azure Data Lake Strong ETL development experience Experience working with Power BI Knowledge of Microsoft Fabric Experience working within Agile environments Strong communication and collaboration skills Benefits ...

people who care about building things properly, you’ll fit right in. You’ll Work With Azure Data Factory, Data Lake, Key Vault, Azure Functions Databricks, Delta Lake, Unity Catalog, PySpark, Spark SQL Medallion architecture, Lakehouse patterns, distributed compute CI/CD pipelines using … thrive in this role if you have: Strong hands‐on experience with Azure Data Services and Databricks Solid understanding of Delta Lake, Medallion architecture and Lakehouse patterns Proficiency in Python, PySpark and Spark SQL Experience building CI/CD pipelines using Azure DevOps Knowledge of data ...

Title:Data Architect Rate: £650 (Inside IR35) Duration: 6 months Location: Remote Clearance: Active SC Stages: 1 Stage Key Responsibilities Design and implement enterprise-level data architecture strategies aligned with organisational goals Develop and maintain conceptual, logical, and physical data models Define data standards, frameworks, and best practices to ensure consistency and quality Collaborate with stakeholders, including business analysts, engineers, and senior leadership, to understand data requirements Oversee data integration processes across Legacy and modern platforms Ensure compliance with data governance, security, and regulatory requirements Support ...

Coupa becomes the organisation's strategic procurement platform, there will be significant integration activity across the estate, including connections into the data lake, reporting platforms, and numerous upstream and downstream systems. This role offers the opportunity to join at the beginning of a major transformation. You will … support integration solutions, including data movement, transformation and validation activities. * Ensure Coupa is effectively integrated with the organisation's data lake and broader data architecture. * Work with APIs, exposed datasets and system interfaces to enable seamless connectivity across platforms. * Support the ongoing expansion ...

passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing … category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program ...

evolve, offering continuous opportunities for development, influence, and leadership* Serve as the primary contact for architectural aspects of IT projects* Integrate business process, data, application, technical, and information security dimensions into cohesive IT solutions* Ensure solution architectures are documented using standard templates and tooling complying with Shell … architecture (event hub, event bus, Kafka), ELK* Intermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQL* Integration experience with Confluent/Kafka, API Management, Logic Apps* Practical agile experience in both start ...

active SC clearance to be considered. Responsibilities Design, build and maintain Databricks data pipelines using Apache Spark (PySpark & Spark SQL) Implement Delta Lake/Lakehouse architectures (Bronze, Silver, Gold) Develop scalable ELT/ETL workflows for batch and streaming data Optimise performance, reliability and cost … experience as a Databricks Data Engineer Strong PySpark and SQL capability Hands-on delivery within AWS, Azure or GCP Experience with Delta Lake , data lakes and data warehouses Strong understanding of data modelling and scalable pipeline design Experience with ...

pipelines in Databricks, feeding ML models and analytics workloads. Develop and maintain scalable data architectures including Azure Data Lake, Azure SQL Data Warehouse, and Synapse Analytics. Build and maintain reliable ETL/ELT workflows, ensuring high data quality, accessibility …/CD Cloud & Big Data: Databricks, Databricks APIs, MCP, Blob Storage Data Engineering: ETL/ELT pipelines, DLT, Delta Lake Infrastructure as Code (IaC): Terraform, ARM templates, Ansible Version Control & DevOps: Git, Azure DevOps, Jenkins Experience 3+ years of experience in ML/MLOps engineering ...

Data Architect | FinTech | AI-Driven Decisioning | Up to £115,000 DOE | Hybrid (Manchester) We're working with a fast-growing FinTech that sits at the intersection of B2B finance and AI. They're building the next generation of their data platform, and they need a Data … think at an architectural level and get their hands dirty when it counts, making decisive calls, unblocking teams, and ensuring that data becomes a governed, reusable, and commercially valuable asset across the business. The Role You'll define how data is structured, accessed and leveraged across ...

summary The Data Architect is a key member of the Digital Data & Technology(DDaT) team, adding value for our patients through improving anddeveloping digital services across the Trust and wider health and caresystem. Ensure the Data Warehouse and BI teams are an effective component … ofthe Trust's DDaT target operating model, working alongside others, delivering continuous overall improvement. The Data Architect is responsible for teams delivering accurate and timely datasets and analytics to support clinical services, in line with Trust priorities. They will also pro-actively review new and emerging technologies ...