10 of 10 Permanent Data Lake Jobs in West Yorkshire

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Data Engineer - Greenfield AWS Role Leeds (Hybrid) £75,000-£85,000 Our client is a nationally recognised leader in their industry, operating across the UK with a strong reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support enterprise-wide … transformation and insight-driven decision-making. The Role: We are seeking a Senior Data Engineer to play a key role in the design, build, and implementation of a new enterprise data platform as the business migrates to AWS. You will work closely with architects, analysts, and data scientists to develop robust, scalable, and secure … AWS data platform. Build and optimise scalable data pipelines to ingest, transform, and manage large datasets. Help design and develop a new data lake to support analytics and reporting across the business. Champion modern data engineering practices, including automation, quality, and governance. Collaborate with cross-functional teams to translate business requirements More ❯

Data Engineer - Remote-First - UK-Based - Up to £50,000 Are you a passionate Data Engineer looking to make a real impact in a fast-growing, values-driven tech company? We're working with a leading Microsoft Cloud specialist that's renowned for its inclusive culture, commitment to excellence, and collaborative ethos. This is a fantastic … Style: Remote-first with occasional travel to client sites and company events Location: UK-based Employment Type: Permanent, Full-Time What You'll Be Doing Delivering full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric … Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems to the cloud Creating impactful dashboards and reports using Power BI Supporting and evolving data solutions post-deployment Requirements: Proven experience in Data Engineering or Data Warehouse Development Strong hands-on skills More ❯

A small and highly successful organisation in the sustainability space are seeking a Data Engineer with some Power Platform experience to join their team. They have an office space in London, though this role is remote and is therefore open to candidates across the UK. They are on a mission to help businesses to reduce their carbon emissions … Responsibilities include: Use Azure Data Factory to ingest, transform, and expose data across the platform Help centralise data into a Data Lake, ensuring it's clean, structured, and accessible Build data pipelines for LLMs and integrate tools like GPT to drive intelligent outputs Develop user-facing applications using Power … It's a broad role, with lots to get involved in! We're not expecting you to have experience with everything mentioned above - the core skills are Azure Data Factory, and having a self-starter mentality with an enthusiasm to learn new things! Benefits include: Salary up to £70,000 depending on experience 25 days annual leave plus More ❯

Lead DevOps Engineer – Azure Data Platform 6-Month Contract Hybrid – Newcastle or Leeds £450–£500 Inside IR35 We are seeking a Lead DevOps Engineer to take ownership of our Microsoft Azure Data Platform strategy and lead a team of engineers in delivering high-quality, scalable solutions. This is a hands-on leadership role, combining technical expertise … with the ability to mentor, manage, and inspire a growing DevOps capability. Key Responsibilities: Lead and Manage a team of DevOps and Data Engineers, providing direction, mentorship, and performance support. Drive the development, support, and optimisation of solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design and oversee Infrastructure and … Skills & Experience: Proven experience leading and managing engineering teams, including mentoring and developing team members. Extensive hands-on experience with Microsoft Azure services (ADF, Synapse Analytics, Data Lake). Proficiency with Infrastructure as Code (Terraform). Strong background with CI/CD pipelines (GitLab CI preferred, Azure DevOps considered). Experience delivering cloud-based solutions in agile More ❯

Lead DevOps Engineer – Azure Data Platform 6-Month Contract Hybrid – Newcastle or Leeds £450–£500 Inside IR35 We are seeking a Lead DevOps Engineer to take ownership of our Microsoft Azure Data Platform strategy and lead a team of engineers in delivering high-quality, scalable solutions. This is a hands-on leadership role, combining technical expertise … with the ability to mentor, manage, and inspire a growing DevOps capability. Key Responsibilities: Lead and Manage a team of DevOps and Data Engineers, providing direction, mentorship, and performance support. Drive the development, support, and optimisation of solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design and oversee Infrastructure and … Skills & Experience: Proven experience leading and managing engineering teams, including mentoring and developing team members. Extensive hands-on experience with Microsoft Azure services (ADF, Synapse Analytics, Data Lake). Proficiency with Infrastructure as Code (Terraform). Strong background with CI/CD pipelines (GitLab CI preferred, Azure DevOps considered). Experience delivering cloud-based solutions in agile More ❯

centralroleinalarge-scaledigitaltransformationprogramme designedtostreamlineprocesses,unlockdataaccessibility,andinvestincutting-edgeplatforms.WorkinginaFTSE250environment,youllbeshapingenterprise-widedatasolutionsthatdirectlyinfluencestrategy,operations,andgrowth. Thisisntjustaboutmanagingpipelinesitsaboutdesigningthenextgenerationofdataplatforms,solvingcomplexbusinesschallenges,andmakinghigh-qualitydatathefoundationofeverythingwedo. Whatyoullbedoing Designingandimplementingscalabledatasolutionsthatmeetenterpriseneeds. Translatingcomplexbusinessrequirementsintohigh-performingdatasystems. Supportingbestpracticesin datagovernance,securityandarchitecture . Buildingandoptimisingpipelinesacrosscloudandon-premiseenvironments. Collaboratingwithstakeholders,engineers,andanalyststodeliverintegratedsolutions. Ensuringconsistencyacrosstransactionalandanalyticaldatasystems. Contributingtothedevelopmentof datalakes,datawarehouses,anddistributedstorageenvironments . Mentoringjuniorengineers,embeddingbestpracticeacrosstheteam. Whatwerelookingfor 5+yearsexperiencein DataEngineering ,withstrongexpertisein Azuredataservicesand/orMicrosoftFabric . Proventrackrecorddesigningscalableplatformsandmanaginglargecloud-basedecosystems. Proficiencyin Python,PySpark,SQL,NoSQL andframeworkssuchas Databricks . Solidexperiencewith ETL/ELTdesign,orchestrationandoptimisation . Knowledgeof More ❯