11 of 11 Permanent Data Lake Jobs in Yorkshire

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Data Engineer Location: Leeds (Hybrid) Employment Type: Full-time – Permanent This role is all about turning architectural vision into robust, high-performance data systems. You’ll work closely with Data Architects and client teams to develop, optimise, and maintain platforms that handle sensitive, high-value information. At SPG, we design and deliver enterprise-grade … data platforms that directly support essential public services, including the NHS and emergency operations. One of the main goals is to build data solutions that power mission-critical services. Our projects demand precision, scalability, and security, and we need a Data Engineer with strong Azure expertise to make it happen. What You’ll Do … Engineering or similar hands-on data delivery roles. Strong experience building modern data solutions using: Azure Data Factory, Synapse Analytics, Data Lake Storage and Power BI (dataset creation, semantic modelling, DAX optimisation) Solid understanding of data modelling (conceptual, logical, and physical). Experience with performance tuning and query optimisation More ❯

Data Engineer Location: Leeds (Hybrid) Employment Type: Full-time – Permanent This role is all about turning architectural vision into robust, high-performance data systems. You’ll work closely with Data Architects and client teams to develop, optimise, and maintain platforms that handle sensitive, high-value information. At SPG, we design and deliver enterprise-grade … data platforms that directly support essential public services, including the NHS and emergency operations. One of the main goals is to build data solutions that power mission-critical services. Our projects demand precision, scalability, and security, and we need a Data Engineer with strong Azure expertise to make it happen. What You’ll Do … Engineering or similar hands-on data delivery roles. Strong experience building modern data solutions using: Azure Data Factory, Synapse Analytics, Data Lake Storage and Power BI (dataset creation, semantic modelling, DAX optimisation) Solid understanding of data modelling (conceptual, logical, and physical). Experience with performance tuning and query optimisation More ❯

Lead DevOps Engineer – Azure Data Platform 6-Month Contract Hybrid – Newcastle or Leeds £450–£500 Inside IR35 We are seeking a Lead DevOps Engineer to take ownership of our Microsoft Azure Data Platform strategy and lead a team of engineers in delivering high-quality, scalable solutions. This is a hands-on leadership role, combining technical expertise … with the ability to mentor, manage, and inspire a growing DevOps capability. Key Responsibilities: Lead and Manage a team of DevOps and Data Engineers, providing direction, mentorship, and performance support. Drive the development, support, and optimisation of solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design and oversee Infrastructure and … Skills & Experience: Proven experience leading and managing engineering teams, including mentoring and developing team members. Extensive hands-on experience with Microsoft Azure services (ADF, Synapse Analytics, Data Lake). Proficiency with Infrastructure as Code (Terraform). Strong background with CI/CD pipelines (GitLab CI preferred, Azure DevOps considered). Experience delivering cloud-based solutions in agile More ❯

Lead DevOps Engineer – Azure Data Platform 6-Month Contract Hybrid – Newcastle or Leeds £450–£500 Inside IR35 We are seeking a Lead DevOps Engineer to take ownership of our Microsoft Azure Data Platform strategy and lead a team of engineers in delivering high-quality, scalable solutions. This is a hands-on leadership role, combining technical expertise … with the ability to mentor, manage, and inspire a growing DevOps capability. Key Responsibilities: Lead and Manage a team of DevOps and Data Engineers, providing direction, mentorship, and performance support. Drive the development, support, and optimisation of solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design and oversee Infrastructure and … Skills & Experience: Proven experience leading and managing engineering teams, including mentoring and developing team members. Extensive hands-on experience with Microsoft Azure services (ADF, Synapse Analytics, Data Lake). Proficiency with Infrastructure as Code (Terraform). Strong background with CI/CD pipelines (GitLab CI preferred, Azure DevOps considered). Experience delivering cloud-based solutions in agile More ❯

ML solutions design, architecture and development and deployment of large scale machine learning or deep learning models and/or systems into production, including batch and real-time data processing. - Working knowledge of generative AI and hands-on experience in prompt engineering, deploying and hosting Large Foundational Models - Strong communication skills in English and Spanish with the ability … network, compute, storage, and virtualization experience - AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, SageMaker pipelines, Glue, LakeFormation, LLM, Bedrock, Datalake, MLOps, Model inference, Model Monitoring, Bedrock, and other ML services) - AWS Associate level certifications (e.g., Solutions Architect Associate, Machine Learning Associate) - Experience with automation and scripting (e.g., Terraform, Python) Amazon … We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our More ❯

Description As part of the Platform & AI Enablement team under GPTO Engineering, you'll report to the Sr. Director Engineering API. This team is accountable for shaping enterprise data architecture, enabling high-performance AI-driven workloads, and acting as a technical bridge between engineering and architecture. Your Impact Lead the design and delivery of platform capabilities powering enterprise … scale data processing, AI integration, and developer acceleration Partner with architects and senior engineers to set technical direction and align implementation patterns with long-term strategy Apply a product mindset to ensure platform solutions address real customer and business needs Deliver thought leadership and coding excellence across Java, React, Python, and other fit-for-purpose technologies Mentor and … technical dead-ends Contribute to technical planning, strategy, and retrospectives that shape the future of the platform Your Qualifications 12+ years of software engineering experience in enterprise-scale, data-centric, or platform environments Deep expertise in distributed data technologies such as Apache Kafka, Flink, and/or Pulsar Strong background in event-driven architectures, streaming pipelines More ❯