26 to 50 of 146 Data Lake Jobs in England

Senior Data Engineer - Burton on Trent £64-67k x1 day per week on-site (Sponsorship is not provided for this opportunity) As a Senior Data Engineer, you will lead the development and optimisation of our customers Azure-based data platform, ensuring efficient, secure, and high-performing data services. You'll design … using Data Factory, Databricks, and related services. Data Architecture: Develop and optimise scalable data models, warehouses, and lakes (Azure Synapse, Data Lake Storage). Governance & Security: Enforce compliance and data protection standards (GDPR, DPA) through robust security and governance practices. Automation: Implement CI/CD pipelines and Infrastructure as … share knowledge across teams. Skills & Experience Expert in Azure Databricks (Unity Catalog, DLT, cluster management). Strong experience with Azure Data Factory, Synapse Analytics, Data Lake Storage, Stream Analytics, Event Hubs. Proficient in Python, Scala, C#, .NET, and SQL (T-SQL). Skilled in data modelling, quality, and metadata management. Experience with CI More ❯

Data Engineer Location: Sheffield (Hybrid - 3 days per week onsite) Salary: £50,000-£60,000 depending on experience DCS Tech are searching for an experienced Data Engineer to join our clients growing team! You will play a crucial part in designing, building, and optimising the data infrastructure that underpins the organisation. Key responsibilities Design … develop, and deploy scalable, secure, and reliable data pipelines using modern cloud … and data engineering tools. Consolidate data from internal systems, APIs, and third-party sources into a unified data warehouse or data lake environment. Build and maintain robust data models to ensure accuracy, consistency, and accessibility across the organisation. Work closely with Data Analysts, Data Scientists More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for data governance, security … GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices for data governance … GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools More ❯

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent … Focused on maintaining our nimble, agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and data architecture development … . Knowledge of the relevant procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience implementing and integrating data More ❯

Senior Databricks Data Engineer 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … platforms, Lakehouse architecture, and data engineering frameworks. Required Qualifications 6+ years of experience in data engineering 3+ years of hands-on experience with Databricks, Delta Lake, and Spark (PySpark preferred). Proven track record implementing Medallion Architecture (Bronze, Silver, Gold layers) in production environments. Strong knowledge of data modeling, ETL/ELT design … and data lakehouse concepts. Proficiency in Python, SQL, and Spark optimization techniques. Experience working with cloud data platforms such as Azure Data Lake, AWS S3, or GCP BigQuery. Strong understanding of data quality frameworks, testing, and CI/CD pipelines for data workflows. Excellent communication skills and ability to More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

trends. Build and refine predictive models for credit risk and debt recovery. Provide insights to support the Bad Debt Transformation programme. Support the migration to a data lake environment, ensuring data integrity and accessibility. Create scalable, efficient SQL code and reporting frameworks. Embed analytics into strategic decision-making across the business. What you should bring …/or R for modelling and visualisation. Experience working in cross-functional teams and translating data into strategy. Familiarity with cloud platforms like Azure Data Lake, AWS, or Google Cloud. A degree (or equivalent experience) in Data Science, Mathematics, Statistics, or similar. A passion for continuous improvement and data-led transformation. … Desirable Experience Experience migrating from traditional databases to data lake architecture. Background in Utilities or Financial Services. Exposure to SAP or DM9 environments. Knowledge of machine learning techniques relevant to credit risk. Location: Hybrid - Walnut Court - SN2 8BN.Hours: 36 hours per week, Monday to Friday. What’s in it for you? Competitive starting salary of More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

support and managed services offerings, they are seeking an experienced Service Delivery Manager to join their team. Role overview Our client is looking for an experienced and talented Data Solution Architect who will help to grow our data delivery team: architecting, designing and implementing large-scale Data Platform, Business Intelligence (BI) and Analytics solutions … for our clients. The role is highly technical and requires a robust understanding and hands-on expertise of Microsoft Azure cloud technologies, data architecture and modelling concepts. The role also demands strong analytical, problem solving, and planning skills. The role requires strong communication and collaboration skills and the motivation to achieve results in a dynamic business environment. Job … a similar senior role Experience in designing and implementing Azure Data solutions using services such as: Microsoft Fabric Azure Synapse Analytics Azure Databricks Azure Data Lake Storage Gen2 Azure SQL Database Azure Data Factory Azure DevOps Azure Stream Analytics Microsoft Power BI Familiar with Azure Purview An understanding of Master Data More ❯

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Should also have knowledge of testing, agile environments and ideally finance related projects. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. More ❯

Data & Insight Managing Consultant Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always make a remarkable impact for our clients. We do this through … helping them solve their most complex, ambiguous and strategic problems in new, inspiring and innovative ways. We collaborate with our clients to build remarkable digital products, together. The Data and Insight Practice in AND Consulting helps our clients to use data to make business choices based on evidence, design best in class technology AND support them … in embedding data into their strategy and ways of working. As a Data & Insight Managing Consultant, you will be working and leading on data consulting projects with AND Digital's household name clients. What you'll be doing: Creating data visions & strategies for household name businesses Driving the transformation required for data More ❯

Are you passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation … for our client-facing products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of … scalable data pipelines • Implement ETL (Extract, Transform, Load) processes to ingest data from various sources • Ensure data quality, integrity, and reliability through thorough testing and validation Database Management • Help manage and optimise data storage solutions (e.g., SQL and NoSQL databases, data lakes) • Monitor and assist in maintaining database performance and More ❯

Senior Data Engineer Salary: Up to £70,000 I am working with a forward-thinking organisation that is modernising its data platform to support scalable analytics and business intelligence across the Group. With a strong focus on Microsoft technologies and cloud-first architecture, they are looking to bring on a Data Engineer to help … design and deliver impactful data solutions using Azure. This is a hands-on role where you will work across the full data stack, collaborating with architects, analysts, and stakeholders to build a future-ready platform that drives insight and decision-making. In this role, you will be responsible for: Building and managing data pipelines … Data Factory. Reporting experience with Power BI. Strong understanding of SQL, Python, or PySpark. Knowledge of the Azure data platform including Azure Data Lake Storage, Azure SQL Data Warehouse, or Azure Databricks. Some of the package/role details include: Salary up to £70,000 Hybrid working model twice per week More ❯

A well-established professional services business is hiring a Head of Data to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech while guiding and developing a growing team. Role … week onsite What you’ll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance, quality, and security Manage … experience as a Data Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management Excellent problem-solving skills and More ❯

Data Engineer - Azure & Databricks - £70,000 Location: Hybrid, London Employment Type: Full-time About the Role: A global leader within their relevant field is looking for an experienced Data Engineer to join a global organization and help deliver innovative data solutions. You'll work on the full data engineering and business intelligence … lifecycle, supporting analytics and AI needs across multiple business functions. Key Responsibilities: Design and implement scalable data solutions using Azure Data Services and Databricks Develop and maintain data pipelines for automated data collection and integration Create and optimize data models and transformations Build interactive dashboards and reports using Power BI … stages of processing Collaborate with cross-functional teams to define requirements and deliver solutions Requirements: Hands-on experience with Azure Data Factory, Databricks, SQL, Data Lake, Power BI Strong skills in T-SQL and DAX Experience in ETL development, data modelling, and data governance Familiarity with CI/CD pipelines and More ❯

Data Engineer - Azure & Databricks - £70,000 Location: Hybrid, London Employment Type: Full-time About the Role: A global leader within their relevant field is looking for an experienced Data Engineer to join a global organization and help deliver innovative data solutions. You'll work on the full data engineering and business intelligence … lifecycle, supporting analytics and AI needs across multiple business functions. Key Responsibilities: Design and implement scalable data solutions using Azure Data Services and Databricks Develop and maintain data pipelines for automated data collection and integration Create and optimize data models and transformations Build interactive dashboards and reports using Power BI … stages of processing Collaborate with cross-functional teams to define requirements and deliver solutions Requirements: Hands-on experience with Azure Data Factory, Databricks, SQL, Data Lake, Power BI Strong skills in T-SQL and DAX Experience in ETL development, data modelling, and data governance Familiarity with CI/CD pipelines and More ❯

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. … This opportunity is offered on a remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: Leading the design and implementation of innovative cloud … business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known for innovation and excellence. More ❯

Ready to make an impact with data and influence decisions Join Thames Water as a Data Analyst in our Credit Risk Analytics team and help shape smarter, faster strategies that deliver real results. What you will be doing as a Data Analyst You will transform complex data into clear, compelling insights that … in a way stakeholders can understand. Provide insight to support the Bad Debt Transformation programme, recommending improvements and clearly communicating impact. Support the transition to a data lake, creating SQL-driven reporting tools and ensuring strong data governance. Collaborate with stakeholders across the Income function, promoting data-driven decision-making and presenting findings … and translate complex data into simple, actionable insights. Hands-on experience with Power BI and exposure to cloud data platforms like Azure Data Lake, AWS, or Google Cloud. Experience in utilities or financial services is preferred. Knowledge of collections and credit risk is advantageous. A degree (or equivalent experience) in a data More ❯

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits Tech Stack: Azure | Databricks | Power BI | Python Are you ready to shape the future of data? We're looking for a Data Engineer to join a team that thrives on innovation and cutting-edge technology. If you love solving complex data challenges … and building scalable solutions, this is your chance to make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/CD Bonus: Python What you'll … do Design and implement scalable Azure-based data solutions Build and optimize data pipelines for integration and transformation Develop Power BI dashboards for global stakeholders Ensure data quality, governance, and security Collaborate in an Agile environment with cross-functional teams What We're Looking For Hands-on experience with Azure & Databricks Strong data More ❯

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits Tech Stack: Azure | Databricks | Power BI | Python Are you ready to shape the future of data? We're looking for a Data Engineer to join a team that thrives on innovation and cutting-edge technology. If you love solving complex data challenges … and building scalable solutions, this is your chance to make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/CD Bonus: Python What you'll … do Design and implement scalable Azure-based data solutions Build and optimize data pipelines for integration and transformation Develop Power BI dashboards for global stakeholders Ensure data quality, governance, and security Collaborate in an Agile environment with cross-functional teams What We're Looking For Hands-on experience with Azure & Databricks Strong data More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our … clients to improve the management and sharing of data across their organisations. In 2022, Aker Systems was proud to win the Scale up Business of the Year award by the British Business Excellence Awards. In 2020 Aker Systems was recognised as a One to Watch on the Sunday Times Tech Track and was also recognised at the Thames … and cloud-native solutions. Data Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either AWS/Azure/Google More ❯

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation as a trusted leader in high-value, complex projects. Today, their … you work each week. This is an organisation where world-class projects meet an environment that prioritises your well-being and career development. I'm looking for a Data Engineer who thrives on innovation and loves tackling complex data challenges. If building scalable, cloud-based solutions excites you, this is your chance to make a real … technology and stay at the forefront of the data engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design and implement scalable Azure-based data More ❯