1 to 25 of 1,009 Data Lake Jobs in England

Data Engineer required by our market leading, award winning, retail sector client based in Avonmouth. This is a hybrid role with 2 days a week onsite but with flexibility. The Data Engineer will oversee the technical aspects of Reporting & BI solutions within the Technology team, providing robust reporting capabilities to support Commercial, Operational, and Finance functions. … tools, ensuring a smooth integration between the on-prem and future cloud environments. Design and implement Azure-based data architecture, leveraging tools like Azure Data Lake, Azure Synapse Analytics, and Fabric’s data capabilities to future-proof the platform. Utilise Azure tools such as Synapse Analytics, Logic Apps, and Azure Functions to streamline … Server data warehouses, focusing on stored procedures, indexing, partitioning, and load performance. An understanding of Azure cloud tools such as Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, and Logic Apps Proficiency in writing advanced SQL queries, stored procedures, and Python scripts for data manipulation, pipeline development, and automation Experience More ❯

Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now Posted 15 days ago Permanent Competitive Senior Data Engineer - (Azure/Databricks) Axis Capital London, United Kingdom Apply now This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding … data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test and … warehousing, and real-time streaming. Knowledge of developing and processing full and incremental loads. Experience of automated loads using Databricks workflows and Jobs Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow. Strong experience with Azure Data Factory (ADF) for data integration and orchestration. Hands-on experience with Azure DevOps, including pipelines, repos More ❯

About the role North Northamptonshire Council are working to modernise their data management and visualisation processes. We are working to deliver our data analytics strategy. This role will support the design and delivery of the data warehousing, data infrastructure and (where required) the migration of existing data sources (data … role A deep understanding of data engineering principles - ideally in an Azure environment Proven experience as a Data Engineer/Specialist in data lake/warehouse and data migration projects Experience building and maintaining ETL processes Experience producing data models and understanding where to use different types of data … years + working with Azure data engineering tools e.g: Azure Data factory Azure Synapse Azure SQL Azure DataBricks Microsoft Fabric Azure data lake Exposure to other data engineering and storage tools: Snowflake AWS tools - Kinesis/Glue/Redshift Google tools - BigQuery/Looker Experience working with open datasets - ingesting data More ❯

Are you an experienced Data Engineer with in depth knowledge of both on-premises SQL data warehouses and modern Lakehouse architectures hosted on Azure? Do you enjoy bringing ideas to the table and sharing knowledge with stakeholders? If so, the Data Engineer role here at Harding+ could be perfect for you. About the role … smooth integration between the on-prem and future cloud environments. Cloud Infrastructure Design: Design and implement Azure-based data architecture, leveraging tools like Azure Data Lake, Azure Synapse Analytics, and Fabric’s data capabilities to future-proof the platform Azure Expertise: Utilize Azure tools such as Synapse Analytics, Logic Apps, and Azure Functions … applying data architecture principles to create robust, scalable solutions Azure Cloud Proficiency: Deep understanding of Azure cloud tools such as Azure Synapse Analytics, Azure Data Lake, Azure Data Factory, and Logic Apps Microsoft Fabric: Hands-on experience with Microsoft Fabric or similar modern cloud platforms, with a strong focus on data More ❯

At Dufrain , we don't just build data solutions-we shape the future of data-driven decision-making. Do you thrive on solving complex challenges and turning data into powerful insights that drive transformation? We're looking for Data Engineers who havea broad range of data engineering skills, with a … focus on Microsoft Databricks. Experience with Microsoft Fabric or Snowflake is also highly desirable. ABOUT THE ROLE As a Data Engineer, you will play a key role in delivering high-quality data solutions for our clients. This role offers the opportunity to work across a variety of technologies and contribute to the growth of our Consulting … engineering practices. Key technical competencies include: Databricks Platform Expertise : Proven experience designing and delivering data solutions using Databricks on Azure or AWS. Databricks Components : Proficient in Delta Lake, Unity Catalog, MLflow, and other core Databricks tools. Programming & Query Languages : Strong skills in SQL and Apache Spark (Scala or Python). Relational Databases : Experience with on-premises and More ❯

We are seeking a strategic and hands-on Lead Data Engineer to own the development of Aerial Direct’s cloud-native data platform. Working primarily within the Microsoft Azure ecosystem, you will be responsible for building and maintaining scalable data pipelines, optimising architecture for performance, and enabling actionable insights across the business. In addition … and evolving Aerial Direct’s Azure-based data platform, ensuring performance, security, and scalability. Design, management, and optimisation of data warehouse and data lake schemas to support downstream analytics, dashboards, and operational processes. Leading development and optimisation of ETL/ELT pipelines using Azure Data Factory, including data ingress … technical team leadership. Extensive hands-on experience with the Microsoft Azure data stack, including Azure Data Factory, Synapse Analytics, Azure SQL DB, Data Lake, Azure Storage, Key Vault, and Databricks. Demonstrated ability to optimise and extend data warehouse and data lake schemas, collaborating with stakeholders to design scalable More ❯

RLDatix is on a mission to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix we’re making healthcare safer, together. Our shared passion for meaningful … Your Time Designing and implementing efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data pipelines to detect and resolve issues, ensuring reliable data More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. About the Role: We are currently looking for a Senior Data Engineer to manage teams on client projects. Your Profile: Proven experience as a Data Engineer with a focus on Azure cloud services. Experience of managing small teams … applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and More ❯

class opportunity to help shape our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec’s new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with others passionate about solving business … problems. Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management techniques to create and optimise scalable, robust, and efficient data solutions. Implement comprehensive … Proven experience working with Azure data platform services, including Storage, ADLS Gen2, Azure Functions, Kubernetes. Background in cloud platforms and data architectures, such as Corporate DataLake, Medallion Architecture, Metadata Driven Platform, Event-driven architecture. Proven experience of ETL/ELT, including Lakehouse, Pipeline Design, Batch/Stream processing. Strong working knowledge of programming languages, including Python More ❯

Social network you want to login/join with: Senior Data Engineer, sunderland, tyne and wear col-narrow-left Client: Apexon Location: sunderland, tyne and wear, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 28.06.2025 Expiry Date: 12.08.2025 col-wide Job Description: Apexon is a digital-first technology services … in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. About the Role: We are currently looking for a Senior Data Engineer to manage teams on client projects. Your Profile: Proven experience as a Data Engineer with a focus on Azure cloud services. Experience of managing small teams … applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and More ❯

Overview Role: Senior Data Engineer and Platform Lead -Manufacturing Location: Hybrid/Remote Position: Staff Morgan Advanced Materials is a world leader in the development and production of advanced materials. We produce a wide range of specialist, high specification materials that have extraordinary attributes and properties. Despite the complexity of our technologies, our focus is simple - we supply … advanced materials that enable our customers' products to perform more efficiently, more reliably and for longer. Morgan is making a significant investment in establishing a world-class global data team, and we are excited to welcome new employees who will play a crucial role in this initiative. As part of this team, you will be instrumental in building … the future data platform that will drive the success of our enterprise. Your contributions will not only shape the foundation of our data capabilities but also help position Morgan as a leader in leveraging data to achieve strategic business goals. This is a unique opportunity to be a part of a transformative journey, where More ❯

significant decisions with confidence, provide strong foundations for the future and guide them towards their goals. Job Description Job Purpose Evelyn Partners is recruiting a skilled and experienced Data Engineer to join a growing team to deliver a large data modernisation programme. As a Data Services Data Engineer, you will be responsible … for designing, developing, and maintaining our MS SQL Server Data Warehouses and associated data feeds into and out of the warehouses, and developing on our new modern cloud data platform, requiring Snowflake, dbt and Azure Data Factory experience. Our data platform's support regulatory requirements, business intelligence & reporting needs and … GitHub. • Extensive experience in designing, building, deploying, and supporting cloud-based data products and pipelines. • Experience with Azure Storage services such as Blob Storage, Data Lake Storage, or Azure Files. • Hands-on experience designing and developing data pipelines using Azure Data Factory. • Experience of data warehouse design and implementation More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP More ❯

their unique goals and ambitions. Role Summary The purpose of the MI/BI & Insight Manager is to effectively lead and co-ordinate a team of MI Analysts, Data Analysts and BI Developers to generate, analyse and present information for key operational and business activities in order to deliver insightful analysis and reporting to support Business Managers. And … policies, procedures, legislative and regulatory requirements, while providing exceptional internal customer service and driving business growth. Play a key role in the development of the roadmap for the data platform and reporting solutions. Act as key curator of data within the team, being responsible for the processes of collection, governance, storage, security and accessibility of all … Cloud Computing platforms (ADLS Gen2), Microsoft Stack (Synapse, DataBricks, Fabric, Profisee), Azure Service Bus, Power BI, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App service, Azure ML is a plus Languages: Python, SQL, T-SQL, SSIS DB: Azure SQL Database, Cosmos DB, NoSQL, Methodologies: Agile, DevOps must have Concepts: ELT/ More ❯

We are seeking a skilled and proactive Azure Data Engineer to join our Data team. This role is critical in design input and development to managing and optimising our data infrastructure using Microsoft Azure. The role will play a key part in enabling data-driven decision-making by developing robust data pipelines, ensuring data integrity, and supporting analytics and reporting functions. This role is perfect for a driven Azure Data Engineer who thrives on solving complex data challenges and contributing to the success of a forward-thinking law firm. Roles and Responsibilities Data Infrastructure Development • Build and maintain scalable data pipelines as defined by our Senior Data Architectures on Azure. • Develop and manage ingestion, transform, and process data pipelines from various sources with tools such as Tray.io, Azure Data Factory. • Implement data lakes and data warehouses using Azure Synapse Analytics, Azure Data Fabric or similar tools. More ❯

Peaple Talent has partnered with a global digital engineering consultancy who are recruiting for a Lead Data Engineer on a permanent basis based out of their Sunderland office. You will have a great understanding of technology consultancy services along with fantastic communication and stakeholder engagement skills as this role will be client facing. Skills and experience: Proven experience … as a Lead Data Engineer with a focus on Azure cloud services. Experience of managing small teams whilst also being hands-on. Strong database fundamentals including SQL/TSQL, performance and schema design. Experience architecting and building data … applications using Azure, specifically a Data Warehouse and/or Data Lake. Technologies : Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and More ❯

Senior Manager at Tenth Revolution Group - Helping organisations across the UK hire the best Cloud Talent. Azure Data Engineer - £70,000 - Home based with occasional client visits. Locations: London, Edinburgh, Manchester About Us: We are a leading data consultancy, dedicated to empowering businesses with cutting-edge data solutions. Our focus is on AI readiness … data literacy, real-time reporting, and complex data management projects, including mergers and acquisitions. By fostering a culture of innovation and problem-solving, we help organizations unlock the full potential of their data. The Role: We are looking for a Senior Data Engineer to join our dynamic and growing team. In this role, you … will work closely with clients to design and implement high-performance data solutions, primarily leveraging Microsoft Azure technologies. You will be instrumental in guiding businesses through their data transformation journeys, helping them make informed, data-driven decisions. Key Responsibilities: Develop and implement data engineering solutions using tools like Azure Data More ❯

support EQ’s transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines … cloud-based data pipelines and architectures Strong expertise in Microsoft Fabric and Databricks, including data pipeline development, data warehousing, and data lake management Proficiency in Python, SQL, Scala, or Java Experience with data processing frameworks such as Apache Spark, Apache Beam, or Azure Data Factory Strong understanding … including Azure and or AWS Strong collaboration and communication skills, with the ability to work effectively with cross-functional teams Experience with Azure Synapse Analytics, Azure Data Lake Storage, or other Azure data services Experience with agile development methodologies and version control systems such as Git Certification in Microsoft Azure, Databricks, or other relevant technologies More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the right price. But, it’s the people inside and outside our business that power us. They make us stand … Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. You’ll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. You’ll build physical data More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services. At Dufrain we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and … efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. Our Data Engineers play a pivotal role in supporting clients navigate the complexities of data management, analytics, and strategy. OUR DATA ENGINEERS Possess a broad range of data engineering skills, with a focus on Microsoft SQL … or Snowflake is also desirable. Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team More ❯

Senior Data Engineer- Middlesbrough Contract type: Permanent Start date: TBC Salary: Competitive Salary + benefits We are the leading provider of infrastructure services. At Altrad, we transform our nation's critical infrastructure to operate safely and sustainably. With over 11,000 talented people, we provide the full spectrum of critical engineering and construction services for industries both onshore … a mature reporting environment that is aligned with the Microsoft application stack and works using the Agile Scrum Development methodology. Activities include: Various Integration activity (ETL) using Azure Data Factory, SSRS and C#. Connecting multiple data sources to our Datawarehouse and integration into the Altrad data model. Data Modelling activity is SQL … related role. Experience with SQL Management Server, SSRS, SSIS and other related systems. Experience with Microsoft Azure stack and related technology such as ADF, Logic Apps, Data Lake, Data Bricks, Power Query etc. Experience in Low code MS related technologies, SharePoint, Nintex, Power Apps, Power Bi etc. ETL related experience using SSIS, ADF or similar More ❯