26 to 50 of 56 Data Lake Jobs in the North of England

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

edge manufacturing, turning abstract ideas into realities that transform the world for good. Your impact This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity … workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets ...

Business Intelligence Developer and Data Engineer Cheshire TBC, Permanent/Full Time Business Intelligence Developer and Data Engineer Location: Hybrid (Runcorn) with travel across the North West and Yorkshire Job type: Full-time, permanent Are you passionate about turning complex data into meaningful insight … that helps businesses make better decisions? We are recruiting on behalf of the 2M Group of Companies for a Business Intelligence Developer and Data Engineer. This is a hands-on role for someone with strong Power BI and SQL skills who can build high-quality reporting and data ...

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Why consider joining our Digital & Data community? ð Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range … solutions for some of following technologies and capabilities to ensure scalable, high-performance applications: Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

Corecom Consulting is seeking a Contract Data Engineer to transform a legacy SQL data warehouse into a modern cloud-native AWS platform. … role is Outside IR35 and hybrid, with one day per week onsite north of Leeds. You will design scalable AWS data lake and warehouse solutions and lead ETL/ELT development to deliver a robust data foundation. Key responsibilities include migrating data from ...

Business Intelligence Developer and Data Engineer Location: Hybrid (Runcorn) with travel across the North West and Yorkshire Job type: Full-time, permanent Are you passionate about turning complex data into meaningful insight that helps businesses make better decisions? We are recruiting on behalf … Group of Companies for a Business Intelligence Developer and Data Engineer. This is a hands-on role for someone with strong Power BI and SQL skills who can build high-quality reporting and data solutions, solve complex problems and work confidently across business intelligence and data ...

Company Nigel Wright Tech are pleased to be working with a North East social housing provider in their search for a Senior Data Engineer on an initial 2 year FTC. The Role Working closely with the Data Architect, you will be expected to lead the design … build and maintenance of the organisations data infrastructure ensuring their data is of the highest quality. Key responsibilities include: Lead the development and maintain data models, schemas and structures that optimise data storage Build and link datasets so that Data ...

combine strategic thinking, customer-centric service design, and agile engineering practices to accelerate innovation in a tech-driven world. Join our Digital & Data team working alongside product, design and a wide range of other experts and cross-disciplinary teams to bring ideas to life through innovative software solutions. … looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift ...

love making it sparkle for millions of Very customers. About the Role You’ll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation. You’ll work across multiple initiatives … decision-making. You’ll have the opportunity to influence technology choices, define engineering standards, and build solutions that will shape the future of data at Very. You’ll help drive the future of data engineering at Very by: Providing technical leadership across multiple teams and initiatives. ...

love making it sparkle for millions of Very customers. About the Role You'll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation. You'll work across multiple initiatives … decision-making. You'll have the opportunity to influence technology choices, define engineering standards, and build solutions that will shape the future of data at Very. You'll help drive the future of data engineering at Very by: Providing technical leadership across multiple teams and initiatives. ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business‐specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands‐on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

Principal Security Architect - Applications & Data Principal Security Architect - Applications and Data £80,000 to £90,000 plus great benefits including private healthcare and a company car or car allowance (Work Level 4) Manchester city centre - in this role you'll split your time between home … engineering practices Experience securing enterprise applications such as SAP, Salesforce, or Dynamics, and large-scale data platforms such as Data Lake, S3, or Databricks Knowledge of data loss prevention, data lifecycle management, and relevant regulations such as GDPR The ability ...

Finance Systems, Data & Analytics Manager Are you excited by the opportunity to shape how Finance uses data, technology and analytics? Would you like to lead the development of reporting solutions that improve decision-making across a complex and ambitious organisation? We are looking for a Finance … level of the business. You will take ownership of key Finance reporting platforms, including Power BI, SAP S/4HANA, Azure Data Lake and Anaplan, driving continuous improvement in data quality, governance and reporting standards. You'll also identify opportunities to leverage automation and emerging ...

global healthcare and insurance organisation who are making a real difference to people's lives. We require experienced senior or mid-level Data Platform Engineers to join the AI and Data Platform teams. £70,000 - £100,000 + Bonus + Excellent Benefits Fully remote with occasional … Azure-based data solutions. * Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. * Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

This is an exciting contract opportunity for an SC Cleared Data Engineer tojoin an experienced team delivering a crtitical public sector engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery … Skills & Experiences Proven experience designing and implementing data solutions in Azure using Databricks as a core platform. Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks. Deep understanding ...

management. They are looking for an experienced Senior Technical Product Manager to spearhead a high-profile greenfield project: building a new, synchronised enterprise data platform across the entire business. This flagship initiative will bring together fragmented data sources to power scalable, trusted digital health capabilities. … future of digital health. Strategy & Greenfield Execution: Define and execute the end-to-end strategy and roadmap for a brand-new, synchronised enterprise data platform Data Platform Development: Lead a cross-functional squad spanning engineering, data, and design to build a centralised health data ...

consistent delivery of such. Continue to drive "true" automation by converting manually triggered automation tools into robotically automated processes and/or data pipelines. Work with the IT Data Department to convert existing automations for data transfer into proper data pipelines, making … data tables available through the Data Lake. Create and maintain live reports for key metrics using Power BI, to replace Excel-based reports currently being produced both within the team and by managers across Finance Who we're looking for Process Automation Experience in office process ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Anaplan’s forecasting solutions. The team is responsible for the production execution of forecasting and predictive models, the MLOps infrastructure supporting our data scientists, and the data processing services that deliver insights to enterprise customers. This role reports to the Director of Engineering for Predictive Intelligence … models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi-cloud experience across AWS, GCP, and Azure. Background in forecasting ...

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data … platforms and pipelines, while applying best practices for automation and source control. The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering #J-18808-Ljbffr ...

ready to shape the future of data? Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering can’t keep up. Maia fixes that by combining 15 years … data expertise with agentic AI to eliminate the manual work that slows data teams down. Organisations like Cisco, DocuSign, and Slack are already using it to deliver real business impact, faster. We started in Manchester and now we’re global - with teams across ...

software engineer who enjoys building production-grade applications, backend services, APIs, developer tooling, and automation solutions that support enterprise-scale cyber security and data platforms. This is a software engineering-focused position with significant hands-on development responsibilities. It is not a traditional infrastructure, DevOps, or platform engineering … supporting production environments. Desirable Skills Experience with Kong API Gateway. Exposure to Cyber Security engineering environments. Knowledge of Databricks, Spark, or Data Lake technologies. Experience supporting Data Engineering platforms. Understanding of API security concepts including OAuth2, JWT, and mTLS. Knowledge of Site Reliability Engineering ...

month in your local Office Skills Significant Architecture experience Government/Public client experience (SC cleared or at least SC eligible) Analytics & Reporting: Data warehousing, data lakes, business intelligence (BI) and analytics technologies, design patterns, tools and best practice. Translating business requirements into technical solutions with … principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...