6 of 6 Data Lake Jobs in West Yorkshire

management technical knowledge so as to be able to work across full data cycle. • Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD • Coding experience in Apache Spark, Iceberg or Python (Pandas) • Experience in change and release management. • Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: • Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB • Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) • Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. • Experience is building Data lake and building CI/CD data pipelines • A candidate is expected More ❯

a range of benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We're looking for a Senior Data Engineer to join the Asset Data & Insights value stream. You'll lead the design, development and operations of robust, scalable data pipelines using modern cloud … technologies-empowering real-time analytics, advanced BI, and data-driven decision-making across SSE Thermal. You'll need hands-on expertise with the Databricks ecosystem, a strong command of data engineering best practices, and a growth mindset that balances technical excellence with collaboration and continuous improvement. Experience in an asset-intensive or energy environment is desirable … as is familiarity with Agile product delivery and cloud-based data platforms. You Will As Senior Data Engineer, you'll architect and optimise our cloud data infrastructure-ensuring high-quality, accessible data for operational and strategic use. - Build and maintain production-grade data pipelines using Databricks (Python, PySpark, Delta Live More ❯

Senior Data Engineer A top Managed Services Provider are on the lookout for an Azure Data Engineer to join their expanding applications team. In this role, you'll support a crucial reporting project and play a key part in driving business transformation with the latest Microsoft cloud technologies. The ideal candidate will have extensive experience as … a data engineer within large organisations and enterprise platforms. This opportunity is ideal for someone who enjoys staying up-to-date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Collaborate on enterprise-level projects. Deliver hands-on … solutions to internal clients. Stay updated with technology trends and actively participate in solution delivery. Ideal Candidate: Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £60,000 + benefits Hybrid working More ❯

Data Engineer - AWS, Glue | £60,000 | Hybrid (Leeds) Permanent | Data-Driven Projects | Cloud-Native Tech Stack We're looking for a skilled Data Engineer to join a growing data team working on modern, cloud-based solutions. This is a great opportunity to take ownership of ETL pipelines and data infrastructure … Building and optimising ETL pipelines using AWS Glue Designing and managing data workflows across the AWS ecosystem Working with large-scale datasets and modern data lake architectures Collaborating with analysts, engineers, and product teams to support data needs Supporting best practices in data governance, quality, and security What We're Looking … and related services Proven track record in data engineering or ETL development Proficiency in Python or PySpark for data processing Familiarity with data lake, data warehouse, and cloud-first environments Comfortable working in agile teams and hybrid work settings Location: Hybrid - 2-3 days a week in Leeds Salary More ❯

AWS Data Engineer - IT Consultancy - Leeds - Hybrid Are you a data engineer with a passion for AWS and solving real-world business problems? I am working with a fast-growing IT consultancy based in Leeds that's delivering cutting-edge cloud and data solutions to clients across the UK. They're looking for their … next AWS Data Engineer to join the team. As an AWS Data Engineer, you'll be working on a variety of client projects, helping to design, build, and optimise scalable data pipelines and cloud-native architectures. You'll collaborate with cross-functional teams to deliver high-impact solutions that drive business value. Requirements: Experience … Python SQL & NoSQL databases CI/CD tools : GitHub Actions or CodePipeline Infrastructure as Code (Terraform is preferable) Experience building ETL/ELT pipelines Familiarity with data lake and data warehouse concepts Excellent communication and stakeholder engagement skills Benefits: Hybrid working (one day per week in Leeds office) Clear career progression in a growing consultancy More ❯