176 to 200 of 1,065 Data Lake Jobs in England

About Us : Role Description : As a Senior Lead within Engineering, you'll design and implement functionalities focusing on Data Engineering tasks. You'll work with semi-structured data to ingest and distribute it on a Microsoft Fabric-based platform, modernizing data products and distribution channels. You'll drive the software development lifecycle for continuous … Relevant experience in Data Platforms within the Financial Services industry, and familiarity with Azure PaaS/SaaS offerings like Fabric, Synapse, Purview, ADF, and Data Lake Storage. Proven experience as a data engineer or similar role, focusing on cloud distributed data processing platforms like Spark and open table formats like Delta … or Iceberg. Strong experience with Azure services such as Synapse Analytics, Data Factory, Data Lake, Databricks, and others. Proficiency in Spark, SQL, and programming languages like Python, Scala, or Java. Experience in building Lakehouse architectures using open-source table formats and tools like Jupyter Notebook. Understanding of security best practices, including Azure Key Vault, IAM More ❯

Metyis is growing! We are looking for a Data Engineering Associate with 3-4 years of experience to join our Data and Analytics team in London. Who we are Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions … We are Metyis. Partners for Impact. What we offer Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change. Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing international and diverse … business challenges in a range of domains. Collect functional and non-functional requirements, consider technical environments, business constraints, and enterprise organizations. Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs More ❯

Social network you want to login/join with: Data Engineering Manager - ID40916, oxfordshire col-narrow-left Client: Humand Talent Location: oxfordshire, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 27.05.2025 Expiry Date: 11.07.2025 col-wide Job Description: We’re looking for an experienced Data Engineering Manager … to lead a team in designing and building cutting-edge data solutions, driving the strategy for a fast-growing, innovative company. If you're passionate about building scalable data platforms, optimising pipelines, and empowering teams to leverage data effectively, this could be your next big move! What You’ll Do: ? Lead and mentor a … team of data engineers, fostering a high-performance culture ? Design, build, and optimise data pipelines and platforms to support business insights ? Work with modern cloud-based data technologies to ensure scalability and efficiency ? Collaborate with cross-functional teams to drive data-driven decision-making ? Ensure best practices in data governance More ❯

Social network you want to login/join with: Data Engineering Manager - ID40916, oxford district col-narrow-left Client: Humand Talent Location: oxford district, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 5 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: We’re looking for an experienced Data Engineering Manager to lead a team in designing and building cutting-edge data solutions, driving the strategy for a fast-growing, innovative company. If you're passionate about building scalable data platforms, optimising pipelines, and empowering teams to leverage data effectively, this could be your next big move! What You’ll Do … Lead and mentor a team of data engineers, fostering a high-performance culture ? Design, build, and optimise data pipelines and platforms to support business insights ? Work with modern cloud-based data technologies to ensure scalability and efficiency ? Collaborate with cross-functional teams to drive data-driven decision-making ? Ensure best practices in More ❯

Senior Data Engineer Permanent Up to 75k Middlesbrough (Circa 3 times per week) Overview A leading organisation in the industrial services sector is seeking a talented and experienced Data Engineer to support and develop cutting-edge data solutions. This role focuses on data integration, modelling, transformation, and master data management … with a strong emphasis on Microsoft and Azure technologies. The company operates in a fast-paced environment using Agile methodologies and CI/CD processes to deliver data-driven insights across the business. Key Responsibilities Design, develop, and support scalable data solutions that integrate multiple systems and sources. Implement and manage master data solutions … maintain clear documentation. Technical Skills & Qualifications Proven experience in a Data Engineer role. Expertise in Microsoft and Azure technologies: SQL Server, ADF, Logic Apps, Data Lake, Power Query, Fabric, Function Apps, Power Automate, Spark, Databricks, SSIS. Strong understanding of data modelling techniques including Normalisation and Kimball methodologies. Proficient in SQL, and experience with More ❯

Senior Data Engineer Permanent Up to £75k Middlesbrough (Circa 3 times per week) Overview A leading organisation in the industrial services sector is seeking a talented and experienced Data Engineer to support and develop cutting-edge data solutions. This role focuses on data integration, modelling, transformation, and master data management … with a strong emphasis on Microsoft and Azure technologies. The company operates in a fast-paced environment using Agile methodologies and CI/CD processes to deliver data-driven insights across the business. Key Responsibilities Design, develop, and support scalable data solutions that integrate multiple systems and sources. Implement and manage master data solutions … maintain clear documentation. Technical Skills & Qualifications Proven experience in a Data Engineer role. Expertise in Microsoft and Azure technologies: SQL Server, ADF, Logic Apps, Data Lake, Power Query, Fabric, Function Apps, Power Automate, Spark, Databricks, SSIS. Strong understanding of data modelling techniques including Normalisation and Kimball methodologies. Proficient in SQL, and experience with More ❯

Senior Data Engineer Permanent Up to 75k Middlesbrough (Circa 3 times per week) Overview A leading organisation in the industrial services sector is seeking a talented and experienced Data Engineer to support and develop cutting-edge data solutions. This role focuses on data integration, modelling, transformation, and master data management … with a strong emphasis on Microsoft and Azure technologies. The company operates in a fast-paced environment using Agile methodologies and CI/CD processes to deliver data-driven insights across the business. Key Responsibilities Design, develop, and support scalable data solutions that integrate multiple systems and sources. Implement and manage master data solutions … maintain clear documentation. Technical Skills & Qualifications Proven experience in a Data Engineer role. Expertise in Microsoft and Azure technologies: SQL Server, ADF, Logic Apps, Data Lake, Power Query, Fabric, Function Apps, Power Automate, Spark, Databricks, SSIS. Strong understanding of data modelling techniques including Normalisation and Kimball methodologies. Proficient in SQL, and experience with More ❯

Are you an experienced data architect looking to take the lead in delivering cutting-edge cloud-based data solutions? This is an opportunity to join a dynamic, remote-first architectural team, working on innovative data platforms for high-profile clients across multiple industries. Key Responsibilities: Lead cross-functional teams of Data Engineers … Architects, Business Analysts, and QA Analysts. Design and implement modern data solutions, leveraging cloud technologies and best-in-class data platforms. Drive architectural strategy for data processing, storage, and visualisation in an Agile environment. Engage with stakeholders, ensuring technical excellence and alignment with business objectives. Skills & Experience Required: Proven experience as a Lead Data Solutions Architect, delivering complex data solutions. Strong background in data streaming and event-driven architectures (Kafka, Confluent). Expertise in architecting data lakes/lakehouses with platforms such as Databricks and Unity Catalog. Proficiency in cloud-based data architecture (AWS, Azure, GCP, Snowflake). Understanding of Data Mesh More ❯

About Workato Workato transforms technology complexity into business opportunity. As the leader in enterprise orchestration, Workato helps businesses globally streamline operations by connecting data, processes, applications, and experiences. Its AI-powered platform enables teams to navigate complex workflows in real-time, driving efficiency and agility. Trusted by a community of 400,000 global customers, Workato empowers organizations of … ranked us the #1 best company for remote workers As Director Product Manager, you will define and execute the strategy to establish Workato as the enterprise leader in data orchestration. Your goal is to build a unified platform that seamlessly orchestrates data pipelines for ETL, ELT, and Reverse ETL (data activation) —eliminating the need … for fragmented tools and enabling enterprises to move data efficiently across their ecosystem. What You’ll Do Leadership in Enterprise Data Orchestration Develop and execute the product strategy for a unified data orchestration platform supporting ETL, ELT, and Reverse ETL (data activation) across SaaS, data warehouses, data lakes More ❯

Senior Engineering Manager - Data Platform 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager - Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform - encompassing experimentation frameworks, event … ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities Partner with cross-functional stakeholders in Product … Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1-2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and efficient analytics and machine learning workflows. Promote More ❯

Senior Engineering Manager – Data Platform Tech Stack Knowledge - Databricks, Kafka, AWS 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager – Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform — encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities … Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1–2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and More ❯

Senior Engineering Manager – Data Platform Tech Stack Knowledge - Databricks, Kafka, AWS 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager – Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform — encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities … Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1–2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

FULLY REMOTE DATA ENGINEER POSITION: UK BASED APPLICANTS ONLY/WE DO NOT PROVIDE VISAS Talent Hero is a speed and quality driven recruiting agency, dedicated to placing the best UK GB remote professionals in remote positions in U.S.A US businesses . Candidates who apply through Talent Hero, once vetted, we contact hundreds of USA businesses to place … you in a role with the right pay and responsibilities. And you stay in our data base for when you look for a job in the future! This role is an excellent opportunity for skilled professionals who are keen to make a substantial impact in a rapidly evolving environment. If you possess a strong background in data … a rare opportunity to turn down. You will have the chance to work on diverse projects, collaborate with talented individuals, and play a key role in ensuring that data-driven objectives are accomplished. We are looking for Data Engineers who value creativity, problem-solving, and a commitment to excellence. Responsibilities Design, develop, and maintain scalable data More ❯

We are looking for an experienced Data Engineer to join our data team. You will be responsible for designing, building, optimising and supporting the data-driven solutions within our products and across the organisation. You should have in-depth knowledge of SQL databases (Microsoft or Postgres), and be familiar with dimensional modelling, star schema … and artificial intelligence into our product suite, so familiarity or an interest in these areas will be a benefit. In this role, you should have a background in data and business analysis, with an architectural understanding to solve 'data questions' (e.g. storage, access, governance). You will collaborate with Data Scientists, Infrastructure Engineers and … in the UK Any of the following would be beneficial for this role: ◦ Knowledge of NoSQL databases ◦ Knowledge of Microsoft Azure cloud tools: Power BI, Fabric, Data Lake, Data Factory ◦ Knowledge of Python and Linux scripting ◦ Knowledge of DataOps principles, including CI/CD ◦ Familiarity with Docker, Kubernetes, and cloud services (Azure ideally) ◦ An interest More ❯

Job Title: Data Engineer - Azure Local Government Inside IR35 Location: Central London (Hybrid - 1-2 days on-site per week) Rate: £500/day (Inside IR35) Contract: 6 months (initial) Start: ASAP/on notice Salt's Public Sector team is proud to be partnered with a forward-thinking Local Government organisation in Central London, currently delivering a … large-scale corporate data programme. We're seeking an experienced Data Engineer with a strong background in Microsoft Azure and Power BI to play a key role in leading the council's Modern Data Platform and supporting improved data-driven decision-making across services. The Role: As a Data Engineer … -driven decision making Key Skills & Experience: Proven experience delivering data engineering solutions in Microsoft Azure (e.g. Data Factory, Synapse, Azure SQL, Data Lake) Strong proficiency in Power BI , including DAX, data modelling, and deployment Experience designing and implementing data warehouses and star schema models Background in building scalable More ❯

get a real taste of who we are and what we love doing: https://www.youtube.com/watch?v=H-AhWeqsvds The role As an accomplished Lead Data Engineer, you will be responsible for leading all data analytics development on projects and the strategic Data Warehouse, mentoring of other BI Developers, and working … cube design, data quality assessments, data migration ETL and optimisation of data within the target platforms. Designing and developing the Data Lake & Warehouse technical components. This includes data modelling, ETL processing and optimisation of the platform. Designing and developing advanced analytics using PowerBI, other business intelligence tools, artificial intelligence … Platform experience gained in previous roles, and strong knowledge of data product development & management best practices. Primary technical skills required: T-SQL, Azure Data Lake, Azure Synapse Analytics, Apache Spark/PySpark, Azure Data Factory, and Power BI. Azure Analysis Services is a nice to have. Extensive experience developing SQL relational databases More ❯

Senior Data Engineer | High Performing Systematic Hedge Fund Senior Data Engineer | High Performing Systematic Hedge Fund This range is provided by Selby Jennings. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Selby Jennings We are seeking a … skilled senior data engineer to join a dynamic team in London responsible for building a global and scalable data lakehouse which will be used by multiple trading desks at the fund. This role offers the opportunity to work with cutting-edge technologies and collaborate with multiple trading teams to drive data-driven decision-making. … data libraries and cloud software development kits (APIs). Optimise performance, data storage and retrieval processes for efficiency and scalability. Ensure the data lake and Online Analytical Processing DB (OLAP - Redshift or similar) is able to handle large volumes and highly concurrent data acess. Ensure data quality, security, and More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … agile team. Experience working in a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding of clinical trials, GCP, and More ❯

Total Care, this rental model allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also support other areas of the business with their data needs as well as … optimization. Experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. Proficient in scripting languages such More ❯

Senior Data Analyst - 12 month Fixed Term Contract Senior Data Analyst - 12 month Fixed Term Contract Direct message the job poster from Modern Networks Ltd Who are we? Modern Networks Limited is a leading provider of managed IT services, specialising in delivering reliable, scalable, and secure IT solutions tailored to the needs of commercial properties, science … parks, and SMEs. Our comprehensive services include IT support, broadband connectivity, telephone systems, and proactive cybersecurity protection. Modern Networks ensures business continuity through data backup and disaster recovery solutions, optimises performance by managing IT infrastructure, and enhances communications by monitoring and optimising network performance. They also help businesses achieve and maintain compliance with industry regulations and data protection laws. What's the role? We’re looking for a highly skilled Senior Data Analyst with strong data processing capabilities and a proven track record of translating complex data into meaningful insights. As a Senior Data Analyst, you will play a critical role in shaping and implementing the strategy More ❯

Job Description: The Food & Nutrition Data Architect will be a key driver in transforming the Food & Nutrition (F&N) business segment. Working closely with partners, you will be responsible for data solution design, including Analytics, Visualization, Dashboards, and Operations. You will bring thought leadership in your domain and collaborate with cross-functional teams to implement innovative … data solutions that enhance customer experience, drive revenue, and maintain a competitive edge in the digital marketplace. Moving towards One Enterprise Data Platform for Food is a strategic Mars Food & Nutrition goal. We aim to harness data and insights to solve critical business problems and simplify the global data and analytics user … experience, unlocking growth and operational excellence. What are we looking for? Hands-on experience designing scalable, greenfield data platforms in cloud environments using Azure D&A stack, Databricks, and Azure Open AI. Proficiency in coding (Python, PL/SQL, Shell Script), relational and non-relational databases, ETL tools (e.g., Informatica), and scalable data platforms. Knowledge of More ❯

systems. Produce architecture and design artifacts for complex applications, ensuring design constraints are met through software development. Gather, analyze, synthesize, and develop visualizations and reports from large, diverse data sets to improve software applications and systems. Identify hidden problems and patterns in data proactively, using insights to improve coding hygiene and system architecture. Contribute to software … engineering communities of practice and explore emerging technologies. Promote a team culture of diversity, equity, inclusion, and respect. Build and maintain scalable data pipelines for batch and near real-time processing. Optimize data workflows for performance, cost, and reliability. Required qualifications, capabilities, and skills Formal training or certification in software engineering concepts, with advanced experience in … skills in Python and SQL. Understanding of ETL best practices, data partitioning, and schema evolution. Experience with data modeling, large-scale datasets, data lake architecture, and data warehousing. Preferred qualifications, capabilities, and skills Experience with AWS services like EC2, S3, IAM, CloudWatch. Experience with Infrastructure as Code tools such as Terraform. More ❯