1 to 25 of 29 Data Lake Jobs in the North of England

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Developers and other technical stakeholders to turn business and technical requirements into practical, scalable solutions. Key responsibilities Design and build scalable data lake and data warehouse solutions on AWS. Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational … cases. Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...

Azure Data Factory (ADF). Develop and optimise data solutions using Azure Synapse Analytics. Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform. Use GitLab for source control, version management, and CI/… architectures and Real Time data processing. Key Technologies Azure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake | Terraform | GitLab | Databricks | Kafka | Kafka Connect Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

authority to act as the ultimate point of technical escalation Exposure to a modern Microsoft data environment, including Azure Data Lake, Databricks, Azure SQL and Python The chance to improve data pipelines, medallion architecture, governance, quality and engineering practices Significant visibility across technology … services The ability to engage and influence a diverse range of technical and non-technical stakeholders Strong experience across Azure Data Lake, Databricks, Azure SQL and Python A good understanding of data pipelines, medallion architecture and modern data platform design Knowledge ...

CAVU Summary Lead Data Engineer Hybrid (2 days per week in the office) Permanent About CAVU For airports, for partners, for people. We are Cavu. At Cavu, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody — from the smallest … help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a key role in shaping and evolving Cavu's data platform, enabling data-driven decision making across ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

Azure-based data solutions Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric Proven experience with infrastructure-as-code using Terraform Experience building CI/CD pipelines via Azure DevOps … Industry Keywords Healthcare Insurance Enterprise Data Platform Advanced Analytics Business Intelligence Tools & Technologies Azure Data Factory Azure Data Lake Azure ML Power BI GitHub #J-18808-Ljbffr ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

About UBDS Digital UBDS Digital, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI, cyber security and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. … highly governed environments Experience with Azure data and integration technologies such as Data Factory, Synapse Analytics, Data Lake Storage, Functions, Logic Apps or API Management Experience with Azure Databricks in large-scale enterprise environments Knowledge of enterprise application and data integration ...

love making it sparkle for millions of Very customers. About the Role You’ll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation. You’ll work across multiple initiatives … decision-making. You’ll have the opportunity to influence technology choices, define engineering standards, and build solutions that will shape the future of data at Very. You’ll help drive the future of data engineering at Very by: Providing technical leadership across multiple teams and initiatives. ...

Principal Security Architect - Applications & Data Principal Security Architect - Applications and Data £80,000 to £90,000 plus great benefits including private healthcare and a company car or car allowance (Work Level 4) Manchester city centre - in this role you'll split your time between home … engineering practices Experience securing enterprise applications such as SAP, Salesforce, or Dynamics, and large-scale data platforms such as Data Lake, S3, or Databricks Knowledge of data loss prevention, data lifecycle management, and relevant regulations such as GDPR The ability ...

global healthcare and insurance organisation who are making a real difference to people's lives. We require experienced senior or mid-level Data Platform Engineers to join the AI and Data Platform teams. £70,000 - £100,000 + Bonus + Excellent Benefits Fully remote with occasional … Azure-based data solutions. * Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. * Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

RoleWe are seeking a talented Senior Software Engineer to help build and run the data services and platform behind Datalex's dynamic pricing and offer optimisation. This is a Python-first, backend and infrastructure-focused role: you will work on end-to-end solutions — from robust application code … optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue-based integration — including customer-facing ...

Anaplan’s forecasting solutions. The team is responsible for the production execution of forecasting and predictive models, the MLOps infrastructure supporting our data scientists, and the data processing services that deliver insights to enterprise customers. This role reports to the Director of Engineering for Predictive Intelligence … models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi‐cloud experience across AWS, GCP, and Azure. Background in forecasting ...

identify architectural patternsMonitor compliance of cloud resources to see if they fit industry guardrails and best practicesResearch and propose solutions for AWS data transformation, data connections, operational frameworks, and application integrationWork closely with lead architects and engineers to create and maintain architectural templates and build/… pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components).Proven ability to take research and prototype environments to enterprise‐ready architectures, balancing speed, robustness, and long‐term maintainability. Strong background in cloud ...

ManchesterGo-To-Market – Field Engineering/RemoteAre you ready to shape the future of data? Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering can't keep up. … Maia fixes that by combining 15 years of data expertise with agentic AI to eliminate the manual work that slows data teams down. Organisations like Cisco, DocuSign, and Slack are already using it to deliver real business impact, faster. We started in Manchester ...

ready to shape the future of data? Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering can’t keep up. Maia fixes that by combining 15 years … data expertise with agentic AI to eliminate the manual work that slows data teams down. Organisations like Cisco, DocuSign, and Slack are already using it to deliver real business impact, faster. We started in Manchester and now we’re global - with teams across ...

Newcastle or Leeds The Opportunity We're looking for an experienced Azure DevOps Engineer to support one of our central governnent clients Azure Data Platform team, helping to build, automate, enhance and support cloud-native platforms and DevOps capabilities across a complex Azure estate. The Role … must demonstrate hands-on experience (minimum SFIA Level 4 equivalent) across: Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Azure & DevOps Strong experience supporting and developing Azure cloud-based platforms and applications. Experience implementing and maintaining CI/CD pipelines. Azure DevOps, GitLab ...

Newcastle or Leeds The Opportunity We're looking for an experienced Azure DevOps Engineer to support one of our central governnent clients Azure Data Platform team, helping to build, automate, enhance and support cloud-native platforms and DevOps capabilities across a complex Azure estate. The Role … must demonstrate hands-on experience (minimum SFIA Level 4 equivalent) across: Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Azure & DevOps Strong experience supporting and developing Azure cloud-based platforms and applications. Experience implementing and maintaining CI/CD pipelines. Azure DevOps, GitLab ...

software engineer who enjoys building production-grade applications, backend services, APIs, developer tooling, and automation solutions that support enterprise-scale cyber security and data platforms. This is a software engineering-focused position with significant hands-on development responsibilities. It is not a traditional infrastructure, DevOps, or platform engineering … supporting production environments. Desirable Skills Experience with Kong API Gateway. Exposure to Cyber Security engineering environments. Knowledge of Databricks, Spark, or Data Lake technologies. Experience supporting Data Engineering platforms. Understanding of API security concepts including OAuth2, JWT, and mTLS. Knowledge of Site Reliability Engineering ...

Power Apps and Power Pages Creating integrations between Dynamics 365 and other business systems Working with APIs, Azure services, and cloud technologies Supporting data and reporting solutions using Microsoft tools Contributing to release management, deployments, and DevOps processes Collaborating with architects, project teams, and business stakeholders … large-scale transformation programmes Microsoft Fabric Power BI Dual Write and Dynamics integrations SharePoint integrations Microsoft Entra ID Azure Function Apps, Data Lake, or Key Vault BENEFITS Flexible working options 33 days holiday including bank holidays Holiday purchase scheme Enhanced family friendly benefits (maternity, adoption, paternity ...

sales expertise to deliver end-to-end solutions—from data acquisition and SCADA integration to enterprise-level analytics and data lake architectures. Responsibilities: Position Schneider Electric GeoSCADA as the core supervisory control solution for water, wastewater, and utility networks as well as other suitable applications. … understand operational challenges and translate them into software-driven solutions. Deliver compelling presentations and workshops showcasing the value of integrated automation and data-driven insights. Design software architectures to integrate with AVEVA software, and enable seamless data flow from device layer through to enterprise systems. Ensure ...

into robust technical solutions with clear traceability for stakeholders. Experience using architecture modelling techniques and tools to design and communicate solutions. Knowledge of data integration technologies including real-time and batch processing across multiple source systems. Experience of analytics and reporting platforms, including data warehousing, data … design secure, scalable solutions across cloud, hybrid and on-premises environments while leading architectural governance, influencing technology strategy and driving innovation across data, analytics and reporting platforms. As part of DWP Digital's Data Insights and Analytics community, you'll mentor and support other architects, helping ...