1 to 25 of 39 Permanent Data Lake Jobs in the North of England

Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing … ensuring compliance with industry standards. Deep expertise in data modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration ...

Senior Data Engineer Remote UK | Occasional Travel Senior Data Engineer | Azure | Microsoft Fabric | Data Platform | Python | SQL | Power BI | AI & Analytics 167 Solutions are partnering with a global organisation embarking on a significant data transformation programme. As investment in analytics … Environment You will work within a modern Microsoft data ecosystem including: Microsoft Azure Microsoft Fabric Power BI SQL Python Data Lake technologies API Integrations Data Warehousing ETL/ELT Frameworks Data Modelling Analytics and Reporting Platforms Essential Skills & Experience Strong commercial ...

Developer BI Developer - SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, Power BI, Fabric, Data Warehousing, Agile - Hybrid (Warrington) - £45-50k + excellent bonus + bens An experienced BI Developer is urgently required by my client with … experience of the Microsoft BI stack and Azure Services (SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric). You will be responsible for helping to build a new, best practice-based reporting solution which will ...

wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data … with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing ...

wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data … with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing ...

wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data … with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing ...

Experience Essential Advanced experience of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake technologies Advanced knowledge of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake … query optimization, complex Stored procedures/views/functions) Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate. Experience of supervising/mentoring junior members of the team. Desirable Experience of NHS information ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … vault, etc.) Data architecture frameworks and methodologies Data governance and data management Experience with Data Lake, Lakehouse, and Data Mesh architectures Strong knowledge of SQL and modern data platforms , including NoSQL and distributed systems Experience designing ...

Azure Data Engineer Manchester(Hybrid) You'll design and build scalable, automated data pipelines that bring together information from across the organisation. It's a hands-on engineering role covering everything from data ingestion to transformation, modelling and delivery, all within a modern Azure … platforms, Data modelling, Kimball Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database ...

Company NW Tech are delighted to be working with a rapidly expanding professional services organisation in their search for a Data Engineer. The Role Key responsibilities include: Design, build and maintain scalable data pipelines to ingest, process and transform structured and unstructured data from … using industry-standard tools and cloud technologies. Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies. Proficiency in working with at least one major cloud data platform Proficiency in Python for data ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, the Principal … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

About Provectus At Provectus, we architect enterprise-grade AI and data solutions that transform how organizations leverage their most valuable asset – data. We combine deep technical expertise with strategic product thinking to deliver scalable, production-ready AI systems and modern data platforms. Who We're Looking … including model versioning, monitoring, performance tracking, and continuous improvement loops. Manage Complex Data Platform Initiatives: Lead product planning for data lake/lakehouse implementations, warehouse modernizations, and cloud data platform migrations. Define data product requirements including ingestion pipelines, transformation logic, data ...

About Provectus At Provectus, we architect enterprise-grade AI and data solutions that transform how organizations leverage their most valuable asset – data. We combine deep technical expertise with strategic product thinking to deliver scalable, production-ready AI systems and modern data platforms. Who We're Looking … including model versioning, monitoring, performance tracking, and continuous improvement loops. Manage Complex Data Platform Initiatives: Lead product planning for data lake/lakehouse implementations, warehouse modernizations, and cloud data platform migrations. Define data product requirements including ingestion pipelines, transformation logic, data ...

About Provectus At Provectus, we architect enterprise-grade AI and data solutions that transform how organizations leverage their most valuable asset – data. We combine deep technical expertise with strategic product thinking to deliver scalable, production-ready AI systems and modern data platforms. Who We're Looking … including model versioning, monitoring, performance tracking, and continuous improvement loops. Manage Complex Data Platform Initiatives: Lead product planning for data lake/lakehouse implementations, warehouse modernizations, and cloud data platform migrations. Define data product requirements including ingestion pipelines, transformation logic, data ...

enjoy shaping robust data solutions and leading teams to deliver high-quality outcomes for clients? As a Senior Data Architect within our Data & AI Practice, you will play a critical role in the technical delivery of complex data solutions across our Strategic … Open Group Architecture Framework. Hands-on experience designing and delivering modern data platforms using technologies such as Azure Data Lake Gen2, Azure Synapse Analytics, Microsoft Fabric, Snowflake, Oracle, SAP or Teradata. Strong expertise in data integration and pipeline development using tools such ...

summary Data Science and clinical intelligence are revolutionising healthcare, offering opportunities for continuous clinical improvement as well as more personalised care. In this senior role, you will lead on the delivery and continued improvement of MFT's data management platform and services. We'll look … relevant experience Desirable Microsoft Data Platform Certifications Knowledge & Experience Essential Implementation of enterprise scale data warehousing and data lake solutions (1 - Limited, 3 - Substantial DWH but limited/no Caboodle, 5 - Substantial with Caboodle) Substantial NHS experience and knowledge of Acute, Community ...

hiring a Senior Data Engineer to help shape the future of data-driven transformation for our clients. At TEKenable, a multi-award-winning Microsoft partner and one of Deloitte’s Fastest 50, you’ll work with cutting-edge technologies like Microsoft Azure Synapse, Microsoft Fabric … Power BI. In this customer-facing role, you’ll collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. This role is open to applicants across Ireland and the UK but we are unable to provide visa sponsorship. ...

hiring a Senior Data Engineer to help shape the future of data-driven transformation for our clients. At TEKenable, a multi-award-winning Microsoft partner and one of Deloitte’s Fastest 50, you’ll work with cutting-edge technologies like Microsoft Azure Synapse, Microsoft Fabric … Power BI. In this customer-facing role, you’ll collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. This role is open to applicants across Ireland and the UK but we are unable to provide visa sponsorship. ...

hiring a Senior Data Engineer to help shape the future of data-driven transformation for our clients. At TEKenable, a multi-award-winning Microsoft partner and one of Deloitte’s Fastest 50, you’ll work with cutting-edge technologies like Microsoft Azure Synapse, Microsoft Fabric … Power BI. In this customer-facing role, you’ll collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. This role is open to applicants across Ireland and the UK but we are unable to provide visa sponsorship. ...

Title: Intermediate Backend Engineer (UK) Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions to enable … platforms (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes). Exposure to batch and streaming architectures and understanding of modern data lake or lakehouse patterns (e.g., Iceberg, Delta, Hudi). Knowledge of geospatial data formats, processing libraries, and coordinate systems is a plus. Strong ...

Title: Intermediate Backend Engineer (UK) Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions to enable … platforms (AWS, GCP, or Azure) and containerization tools (Docker, Kubernetes). Exposure to batch and streaming architectures and understanding of modern data lake or lakehouse patterns (e.g., Iceberg, Delta, Hudi). Knowledge of geospatial data formats, processing libraries, and coordinate systems is a plus. Strong ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...