21 of 21 Permanent Data Lake Jobs in the North of England

Training & Experience EssentialAdvanced experience of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake technologiesAdvanced knowledge of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake … query optimization, complex Stored procedures/views/functions)Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate.Experience of supervising/mentoring junior members of the team.DesirableExperience of NHS information and data.Experience in working ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … design teams.Experience in data solution architecture, including establishing design principles, defining solution patterns, and following architecture methodologies.Expertise in Data Lake, Lakehouse, and Data Mesh architecture.Observability and FinOps (Financial Operations) expertise.Experience of establishing common data models and suitable structures to enhance ...

Experience Essential Advanced experience of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake technologies Advanced knowledge of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake … query optimization, complex Stored procedures/views/functions) Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate. Experience of supervising/mentoring junior members of the team. Desirable Experience of NHS information ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … data lakes, data warehouses) and compute engine options (e.g., Spark, Databricks, Synapse Analytics, BigQuery).Implementing and optimising data lake and data warehouse solutions on cloud platforms using services such as object storage (e.g., S3, ADLS, GCS), cloud data warehouses ...

DescriptionWhat You'll DoDesign, build, and operate reliable, secure, and observable data pipelines and curated datasets that power enterprise reporting, analytics, and AI/ML use cases.Lead AI/ML engineering as a core workstream, designing feature-ready datasets, model pipelines, and AI-ready data products … 10+ years.Azure Fabric data platform — expertise across Azure Data Factory, Synapse, Microsoft Fabric, Purview, Unity Catalogue, and Data Lake/Lakehouse architectures.Python — advanced proficiency including open-source data and ML libraries, frameworks, and production pipeline development.SQL — expert-level for data ...

exciting opportunity has arisen for a Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, the Principal … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

teams operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. PA. Bringing Ingenuity to Life. Why consider joining our Digital & Data community? ð Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range … solutions for some of following technologies and capabilities to ensure scalable, high-performance applications: Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

strategic thinking, customer-centric service design, and agile engineering practices to accelerate innovation in a tech-driven world. Why consider joining our Digital & Data community? ð Join our Digital & Data team working alongside product, design and a wide range of other experts and cross-disciplinary teams … looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … analytical skills.Proficiency in object orientated programming languages such as Python, Java, or Scala.Contributing to the solution architecture of an enterprise data lake to cater to a client's data storage needs for structured and unstructured data, to enable analytics across global clients using ...

love making it sparkle for millions of Very customers. About the RoleYou'll be one of the technical experts within the Data Enablement team, a hands-on Principal Data Engineer at the heart of our data transformation.You'll work across multiple initiatives, partnering with … decision-making. You'll have the opportunity to influence technology choices, define engineering standards, and build solutions that will shape the future of data at Very.You'll help drive the future of data engineering at Very by:Providing technical leadership across multiple teams and initiatives.Designing scalable ...

Data Engineer We're looking for an Data/Analytics Engineer to join our client's high-performing Business Intelligence team, helping to build scalable, high-quality data solutions that power reporting, dashboards and self-service analytics across the business. Working closely with … Developers and business stakeholders, you'll design and optimise ETL/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to work with ...

RoleWe are seeking a talented Senior Software Engineer to help build and run the data services and platform behind Datalex's dynamic pricing and offer optimisation. This is a Python-first, backend and infrastructure-focused role: you will work on end-to-end solutions — from robust application code … optimise data pipelines on AWS to collect, transform, and serve large datasets. Work extensively with S3 (Hive-partitioned Parquet data lake), Athena for SQL querying and analysis, DynamoDB for low-latency caching, and Kinesis/SQS for streaming and queue-based integration — including customer-facing ...

identify architectural patternsMonitor compliance of cloud resources to see if they fit industry guardrails and best practicesResearch and propose solutions for AWS data transformation, data connections, operational frameworks, and application integrationWork closely with lead architects and engineers to create and maintain architectural templates and build/… pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components).Proven ability to take research and prototype environments to enterprise‐ready architectures, balancing speed, robustness, and long‐term maintainability.Strong background in cloud security ...

identify architectural patternsMonitor compliance of cloud resources to see if they fit industry guardrails and best practicesResearch and propose solutions for AWS data transformation, data connections, operational frameworks, and application integrationWork closely with lead architects and engineers to create and maintain architectural templates and build/… pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components).Proven ability to take research and prototype environments to enterprise‐ready architectures, balancing speed, robustness, and long‐term maintainability.Strong background in cloud security ...

Data Engineering Manager (hands on) - Manchester I'm working with a hypergrowth business in Manchester who are looking for a Data Engineering Manager. They have new PE investment behind them and a major transformation project is underway. This is a hands-on leadership role sitting … centre of a significant data platform transformation. You will be running the data engineering squad, responsible for delivering the data infrastructure, pipelines, and reporting capabilities the wider business depends on. They are moving away from traditional batch processing toward a real-time, event-driven ...

ManchesterGo-To-Market – Field Engineering/RemoteAre you ready to shape the future of data Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering can’t keep up. … Maia fixes that by combining 15 years of data expertise with agentic AI to eliminate the manual work that slows data teams down. Organisations like Cisco, DocuSign, and Slack are already using it to deliver real business impact, faster.We started in Manchester ...

making it sparkle for millions of Very customers. About the RoleYou’ll be a hands-on senior engineer at the heart of our data transformation. You won’t just deliver pipelines. You’ll shape how we build them, how we scale them and how we make them better.You … work with modern cloud technologies, help evolve our data platform and influence engineering standards across the team. You’ll also support and mentor others, helping create a strong, collaborative engineering culture.The impact is real. Better data means better customer experiences, faster decisions and stronger performance across ...

infrastructure across cloud and on-premise environments. Develop scalable architectures for AI workloads, including model hosting, vector databases, orchestration layers, APIs, and data pipelines. Integrate AI platforms with business-critical systems, data platforms, collaboration tools, and operational applications. Produce and maintain architecture documentation, operational procedures … Agentic AI frameworks such as LangGraph, AutoGen, or CrewAI. AI orchestration platforms such as n8n or similar technologies. Knowledge graph technologies. Data lake and analytics platforms. Experience supporting organisation-wide AI adoption programmes. ...

sales expertise to deliver end-to-end solutions—from data acquisition and SCADA integration to enterprise-level analytics and data lake architectures. Responsibilities:Position Schneider Electric GeoSCADA as the core supervisory control solution for water, wastewater, and utility networks as well as other suitable applications.Architect … stakeholders to understand operational challenges and translate them into software-driven solutions.Deliver compelling presentations and workshops showcasing the value of integrated automation and data-driven insights. Design software architectures to integrate with AVEVA software, and enable seamless data flow from device layer through to enterprise systems.Ensure ...