1 to 25 of 123 Permanent Data Lake Jobs in the UK excluding London

Job summary Are you a data engineer with a passion for public service? Then maybe you're looking for us! We are seeking an experienced and skilled Advanced Data Engineer to be part of a growing team that delivers on our mission of protecting and improving the health and wellbeing of the people of Wales. You … ll be involved in improving our data practices, cataloguing our data, automating our data processing, creating pipelines and developing our overall data maturity. You are an experienced data engineer with leadership, communication and collaboration skills who knows how to deliver in a fast-paced, often ambiguous environment. Working with us … engineering profession community and forge strong links with other DdaT professional communities Develop and maintain data platform components (e.g. data catalogue, data lake, warehouse, ETL frameworks) Follow best practice in data security, compliance, and the ethical use of data in accordance with standards and requirements such as GDPR More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data models Partner with the BI More ❯

Data Architect – Data & AILocation: Hybrid – Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment in … its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality data … into robust data solutions Collaborative communicator with a passion for data and innovation Technology Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines Architecture & Governance: Enterprise data models, data catalogues, metadata More ❯

Data Architect - Data & AI Location: Hybrid - Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment … in its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality … into robust data solutions Collaborative communicator with a passion for data and innovation Technology Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines Architecture & Governance: Enterprise data models, data catalogues, metadata More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … approaches and can apply data security and privacy strategy to solve business problems. You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy More ❯

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the … latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop … approaches and can apply data security and privacy strategy to solve business problems You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.) Professional Skills You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy-in More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

Harvey Nash is now inviting candidates to apply for the role of Solution Data Architect, an initial 6-month contract working inside of IR35, fully remote. This is a critical role that will lead the ongoing development of our Business Data logical model and support key strategic initiatives. Key Responsibilities Lead the ongoing development and evolution … of the Business Data logical model. Collaborate closely with teams responsible for physical model development. Support ongoing design work and delivery of inflight activities using Microsoft information architecture. Contribute to ERP implementation projects and data migration activities. Ensure data governance and compliance standards are maintained throughout all initiatives. Core Requirements Data Modelling … Server, Azure SQL Database, and other enterprise database platforms Cloud Architecture: Experience with Azure data services (Azure Data Factory, Azure Synapse, Azure Data Lake) Data Governance: Understanding of data quality, data lineage, and metadata management principles. ETL/ELT Processes: Experience designing and implementing data More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Job Title: Manager - Cloud Data Architect (AWS & Snowflake) Protiviti's UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. Our solutions range from data strategy and … governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms to lead the design and implementation of scalable, secure, and high-performance data solutions. You will play … architecture, including at least 3 years in a cloud-native environment. Proven expertise with AWS cloud services , including but not limited to: S3, Glue, Redshift, Lambda, Kinesis, Athena, Lake Formation. Strong hands-on experience with Snowflake - architecture, performance tuning, security, and data sharing features. Proficient in data modelling, data integration (ETL/ More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. JOB DESCRIPTION Tech stack While the client is keen to … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING AREAS – BRISTOL, LONDON. … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING AREAS – BRISTOL, LONDON. … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

behind database performance, resilience, and compliance, while steering the evolution from traditional systems to modern cloud-based solutions. From enterprise-scale SQL Server estates to emerging data lake technologies, this role offers both breadth and depth, with real influence across business-critical systems. What you'll be doing Lead database strategy, ensuring high availability, scalability and cost … efficiency. Drive performance tuning, optimisation and proactive monitoring for reliable services. Oversee upgrades, migrations and integrations with modern platforms (Azure, Data Lake, Fabric). Manage BAU operations: patching, security updates, backups and incident resolution. Partner with teams and providers to ensure governance, GDPR, PCI-DSS compliance and operational excellence. Support new change deployments and contribute to the … replication and DR strategies. Experience with Azure services (Data Factory, Logic Apps, Data Sync) and exposure to data lakes (Azure Data Lake, Fabric, Delta Live Tables). Understanding of Windows Server, Active Directory and infrastructure dependencies. Excellent communication skills with the ability to engage stakeholders. Familiarity with DevOps (CI/CD More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

Overview Data & Insight Managing Consultant Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always make a remarkable impact for our clients. We do this … helping them solve their most complex, ambiguous and strategic problems in new, inspiring and innovative ways. We collaborate with our clients to build remarkable digital products, together. The Data and Insight Practice in AND Consulting helps our clients to use data to make business choices based on evidence, design best in class technology AND support them … in embedding data into their strategy and ways of working. As a Data & Insight Managing Consultant, you will be working and leading on data consulting projects with AND Digital's household name clients. What you'll be doing: Creating data visions & strategies for household name businesses Driving the transformation required for data More ❯

Ready to make an impact with data? Join Thames Water as a Data Analyst in our Credit Risk Analytics team and help shape smarter, faster decisions that drive real results. What you’ll be doing as a Data Analyst You’ll turn complex data into clear, actionable insights, helping to strengthen credit … deep dives to understand trends and variances. Provide insight to support the Bad Debt Transformation programme, recommending improvements and tracking impact. Support the transition to a data lake, creating new SQL-driven reporting tools and maintaining strong data governance. Work closely with stakeholders to promote data-driven decision-making within the Income function. … and translate complex data into simple, actionable insights. Hands-on experience with Power BI and exposure to cloud data platforms like Azure Data Lake, AWS or Google Cloud. Knowledge of credit risk, utilities, or financial services is a bonus. A degree (or equivalent experience) in a data-focused subject, with skills More ❯