101 to 125 of 510 Data Lake Jobs

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to … power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT … and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving theirdeliveryin a secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle andAmazon Web Services (AWS) are usedin FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load ETL and Extract Load and Transform ELT ) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that aligns with data architecture and engineering best practice. Develop data assets and products that assist Power Business Intelligence (BI) colleagues to More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving theirdeliveryin a secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle andAmazon Web Services (AWS) are usedin FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load ETL and Extract Load and Transform ELT ) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that aligns with data architecture and engineering best practice. Develop data assets and products that assist Power Business Intelligence (BI) colleagues to More ❯

Description As a Data Solutions Architect you'll work closely with key stakeholders to map out their data/insights requirements and develop roadmaps and design architecture which you'll communicate effectively to the project teams, implementation teams and end-users - leading top quality solutions design and delivery. Requirements Strong experience as a Cloud data … more of the following architectural frameworks (TOGAF, ZACHMAN, FEAF) Cloud Experience: AWS or GCP preferred, particularly around migrations and cloud architecture Good technical knowledge and understanding of big data frameworks like Hadoop, Cloudera etc. Deep technical knowledge of database development, design and migration Experience of deployment in cloud using Terraform or CloudFormation Automation or Scripting experience using languages … achieve target states successfully. Familiar with common architectural patterns and able to define and customise them for different use cases. Develop data models and Data Lake designs around stated use cases to capture KPIs and data transformations. Identify relevant AWS services - on Amazon EMR, Redshift, Athena, Glue, Lambda, to design an architecture that More ❯

We are seeking a skilled Data Engineer to join our Data & Analytics team. In this role, you will design and build robust, scalable data pipelines and well-structured data models to support advanced analytics and Power BI dashboards. You will work with sales data from our stores and deliver high … quality, reliable datasets for business stakeholders. Responsibilities: Design, develop, and maintain efficient and scalable data pipelines to ingest, transform, and load sales data. Build and optimize data models to power Power BI dashboards and analytics use cases. Collaborate with analysts, data scientists, and business teams to understand data requirements and translate them … and SQL for data transformation and development. Experience with Spark (especially PySpark) for distributed data processing. Strong working knowledge of Databricks, Azure Data Lake, and Azure Data Factory. Experience implementing Unity Catalog for data governance and cataloging. Familiarity with Terraform for infrastructure automation. Solid experience working with GitHub in More ❯

Role Description : As a Senior Lead within Software Engineering, you'll design and implement functionalities, focusing on Data Engineering tasks. You'll be working with semi-structured data to ingest and distribute it on a Microsoft Fabric-based platform, modernizing data products and distribution channels. You'll drive the software development lifecycle for continuous … experience: Depending on seniority relevant experience in Data Platforms (in Financial Services industry), Azure's PaaS/SaaS offerings (Fabric, Synapse, Purview, ADF, Azure Data Lake Storage etc.) Proven experience as a data engineer or similar role, with a focus on cloud distributed data processing platform for spark, and modern open … table concept like delta/iceberg. Strong experience with Azure: Synapse Analytics, Data Factory, Data Lake, Databricks, Microsoft Purview, Monitor, SQL Database, SQL Managed Instance, Stream Analytics, Cosmos DB, Storage Services, ADLS, Azure Functions, Log Analytics, Serverless Architecture, ARM Templates. Strong proficiency in Spark, SQL, and Python/scala/Java. Experience in building Lakehouse More ❯

Services Job ID: Amazon EU SARL (UK Branch) Locations considered: London, Paris, Madrid, Milan, Munich, Berlin Are you interested in building data warehouse and data lake solutions to shape the analytical backbone of the EU Heavy Bulky & Services team? We are hiring a Business Intelligence Engineer to scale up our data projects to … the next level. This position requires experience in building Business Intelligence solutions, paired with bringing a hands-on data engineering mentality. We seek individuals that enjoy to collaborate across stakeholders and that bring excellent statistical and analytical abilities to the team. Heavy Bulky & Services is a growing Amazon business, designed to enable Customers to enjoy website browsing, product … will have contributed to the evolution of their team's analytical practices. Experience of developing automated analytical solutions is preferred. Key job responsibilities - Design, develop and implement scalable data solutions, automate processes and accelerate analytics. - Collaborate with other Business Intelligence Engineers on a WW scope and implement data pipelines to automate manual solutions. - Develop analytics: deep More ❯

Lead Data Scientist/Data Analyst Kalman & Company is seeking a highly motivated, performance-driven individual with strong data analysis experience to work closely with our Department of Defense (DoD) client in the Northern VA area. Successful candidates will have excellent communication, quantitative, research, and analytical skills and the capability to lead, or principally … in financial management, logistics, engineering, and/or program management domains are also preferred. As part of our team, you'll help our Government clients make well-informed, data-driven decisions on some of the most impactful challenges facing the DoD. On-site support will be required as needed in the Quantico, VA and Stafford, VA areas. A … dynamic and fast-paced workplace. The analyst position will include, but is not limited to, the following capabilities: Essential Job Functions: Architect, design, code, and implement next-generation data analytics using best practices in the latest technologies. Develop solutions to enable metadata/rules engine-driven data analytics application leveraging open source and/or cloud More ❯

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer with a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks … solutions within the Azure ecosystem. Responsibilities: Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables. Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions. Drive best practices for data engineering. Help clients realise the potential of data science, machine learning, and scaled data … requirements refinements, and work estimation. Skills & Experiences: Proven experience designing and implementing data solutions in Azure using Databricks as a core platform. Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks. Deep understanding of lakehouse architecture, with a More ❯

been turning down headhunters for years. Whatever your priorities work/life balance, career progression, sustainability, volunteering youll find like-minded people driving change at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure and Databricks ? Do you … optimising for performance, scalability, and security. Collaborate with business stakeholders, data engineers, and analytics teams to ensure solutions are fit for purpose. Implement and optimise Databricks Delta Lake, Medallion Architecture, and Lakehouse patterns for structured and semi-structured data. Ensure best practices in Azure networking, security, and federated data access . Key Skills & Experience 5+ … years of experience in data architecture, solution architecture, or cloud data engineering roles. Strong expertise in Azure data services , including: Azure Databricks (Delta Lake, Unity Catalog, MLflow) Azure Event Hub and Azure Data Explorer for real-time and streaming data pipelines Azure Storage (ADLS Gen2, Blob Storage) for scalable More ❯

IT issues. We bring the innovation, passion, and agility of the commercial sector to meet the unique challenges of this competitive space. Karthik Consulting is seeking Senior Strategic Data Specialists with the below skillset. Senior Strategic Data Specialist Fulltime with Karthik Consulting Location: National Capital Region Clearance: TS/SCI required Job Description: Senior Strategic Data … Specialist Position Description Purpose: The Air Force ISR Digital Infrastructure Transformation paves the way for intelligence analysts to harness the latest technological advancements securely. It is orchestrated through Data and Analytics, Sense Making/Automation, Augmentation and AI (AAA), Networks, Hybrid and Multi-Cloud, Enterprise Services, and cybersecurity capabilities. This structure allows integration, synchronization, and coordination with the … cloud platforms (AWS, Azure, GCP) and their data services, including storage, compute, analytics, and security offerings. Familiarity with cloud-based data warehousing, data lake solutions, and cloud migration strategies. • Understanding of the Intelligence Community (IC): Knowledge of IC data standards, policies, and practices would be highly valuable. • Data Integration More ❯

Senior Data Engineer Hybrid 3 days per week in the office Base salary up to £70,000 My client a financial services institution are seeking a dynamic Senior Data Engineer to help shape the future of data engineering in an evolving and innovative organisation. As part of their data engineering capability the … Senior Data Engineer will be responsible for inspiring and assisting the Data Engineering team in designing, developing and testing quality data engineering solutions, which will be delivered through domain orientated multi-disciplined data product teams My client are in phase of Data transformation whilst transforming the way they work as … vault). Strong Data related programming skills SQL/Python/Spark/Scala. Database technologies in relation to Data Warehousing/Data Lake/Lake housing patterns and relevant experience when handling structured and non-structured data Machine Learning - Experience of industrialising and scaling machine learning models. Experience with More ❯

Data Engineer Amersham – Hybrid £45,000 - £50,000 VIQU have partnered with a UK retail company who are looking to recruit a Data Engineer to play a critical part in the leveraging of data to drive insights, optimise business performance and support decision making. Key Responsibilities of the Data Engineer: Develop, maintain … Build and refine automated data processes ensuring data accuracy and availability for reporting and analysis. Support the rollout of an Azure-based data lake, working alongside external partners and internal stakeholders. Design and implement scalable ETL packages using Microsoft tools such as SSIS and SSRS. Produce and enhance interactive reports and dashboards, facilitating … ETL pipeline creation, and SSRS for report development. Experience with Power BI for data visualisation. Familiarity with Azure data services such as Data Lake, Data Factory, and Synapse Analytics is an advantage. Ability to work with diverse data sources and formats Strong communication skills with the ability to collaborate More ❯

for a hands-on, highly skilled individual who can set direction and bring technical leadership to a growing team. You'll be managing a cloud-based data lake, designing reusable data assets, and fostering a data-first culture in a dynamic and impactful environment. Key Responsibilities Act as Technical Lead for the central … Data Services team, ensuring delivery of high-quality, scalable data pipelines. Manage and evolve the organisations AWS-based data lake and catalogue. Champion and embed best practices in data ownership, reusability, and governance. Contribute to the organisation's Data Centre of Excellence and provide strategic input on data … data assets. Key Requirements Essential: Demonstrable experience leading the delivery of robust and reusable data pipelines using AWS technologies such as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such More ❯

for a hands-on, highly skilled individual who can set direction and bring technical leadership to a growing team. You'll be managing a cloud-based data lake, designing reusable data assets, and fostering a data-first culture in a dynamic and impactful environment. Key Responsibilities Act as Technical Lead for the central … Data Services team, ensuring delivery of high-quality, scalable data pipelines. Manage and evolve the organisations AWS-based data lake and catalogue. Champion and embed best practices in data ownership, reusability, and governance. Contribute to the organisation's Data Centre of Excellence and provide strategic input on data … value of data assets. Key Requirements Essential: Demonstrable experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such More ❯

for a hands-on, highly skilled individual who can set direction and bring technical leadership to a growing team. You'll be managing a cloud-based data lake, designing reusable data assets, and fostering a data-first culture in a dynamic and impactful environment. Key Responsibilities Act as Technical Lead for the central … Data Services team, ensuring delivery of high-quality, scalable data pipelines. Manage and evolve the organisations AWS-based data lake and catalogue. Champion and embed best practices in data ownership, reusability, and governance. Contribute to the organisation's Data Centre of Excellence and provide strategic input on data … value of data assets. Key Requirements Essential: Demonstrable experience leading the delivery of robust and reusable data pipelines usingAWS technologiessuch as S3, Glue, Lambda, and Lake Formation. Proficiency in Terraform, GitHub, and VS Code for pipeline deployment. Proven leadership in developing high-performing data teams. Strong SQL and familiarity with analytics tools such More ❯

Metyis is growing! We are looking for a Data Engineering Associate with 3-4 years of experience to join our Data and Analytics team in London. Who we are Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering Big Data, Digital Commerce, Marketing & Design solutions … best version of yourself. We are Metyis. Partners for Impact. What we offer Interact with senior stakeholders at our clients regularly to drive impactful business change. Work with Data Scientists to manage data throughout its lifecycle - acquisition, exploration, cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing, international, and diverse team. What you … to solve concrete business challenges across various domains. Gather functional and non-functional requirements, considering technical environments, business constraints, and organizational needs. Support clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £60,000 + benefits Hybrid working More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data … you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Familiar with Cloud security, performance optimisation and monitoring More ❯

Career Opportunities: Data Architect - Affinity Reply (10503) Requisition ID 10503 - Posted - Years of Experience: 2+ - Consulting - Location: UK Affinity Reply is a leading UK-based architecture consultancy focused on optimizing IT/Business alignment and minimizing the costs of business and technology change. We foster trusted client relationships and ensure successful outcomes through a proactive and insightful approach. … To meet growing client demands, we seek exceptional individuals passionate about digital transformation and delivering outstanding results. Role Overview: We are seeking a seasoned Data Architect to join our team, partnering with leading financial services clients. You will leverage your deep understanding of the financial industry and data architecture expertise to design and implement innovative solutions … that enable clients to harness their data as a strategic asset. Your responsibilities include assessing client data needs, designing data architectures, developing roadmaps aligned with business and data strategies, and translating business requirements into technical solutions that comply with regulatory standards. Essential Skills & Experience: Strong understanding of the Financial Services Industry and More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on … Microsoft Azure. Designing and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data … you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Platform engineering - Terraform Familiar with Cloud security, performance More ❯

Career Opportunities: Data Architect - Affinity Reply (10503) Requisition ID 10503 - Posted - Years of Experience: 2+ - Consulting - Location: UK Affinity Reply is a leading UK-based architecture consultancy focused on optimizing IT/Business alignment and minimizing the costs of business and technology change. We foster trusted client relationships and ensure successful outcomes through a proactive and insightful approach. … To meet growing client demands, we seek exceptional individuals passionate about digital transformation and delivering outstanding results. Role Overview: We are seeking a seasoned Data Architect to join our team, partnering with leading financial services clients. You will leverage your deep understanding of the financial industry and data architecture expertise to design and implement innovative solutions … that enable clients to harness their data as a strategic asset. Your responsibilities include assessing client data needs, designing data architectures, developing roadmaps aligned with business and data strategies, and translating business requirements into technical solutions that comply with regulatory standards. Essential Skills & Experience: Strong understanding of the Financial Services Industry and More ❯

Data Engineer Azure - DBT - Midlands - Rapid Growth Scale-Up About the Company Join a fast-growing Data Analytics software house that is shaking up the analytics market. In just 5 years, they've grown from a startup to £11M turnover and offices across the UK and internationally. Helping clients rapidly achieve actionable insights from their data, they have outpaced the market. From their background as an Azure house, they've built an innovative data platform that allows data ingestion from any source and can work with any data warehouse. The Role As a customer-facing Azure Data Engineer, you'll work with clients to deliver tailored … latest Microsoft Fabric technology Essential Skills: DBT experience – (required) Strong Python programming skills Microsoft Azure/Synapse background (Data Factory, Azure SQL DB, Azure Data Lake, SSIS, SSAS, SSRS). Experience with Microsoft Fabric (preferred but not essential) Power BI or similar visualisation tools Willingness to work in a multi-cloud environment as they continue More ❯

We are working with a well-established national charity currently investing in its digital and data landscape to support continued growth and impact. This is a key opportunity to join as their Enterprise Data Architect , helping shape the data architecture and governance that underpins critical decision-making and service delivery. Location: Hybrid - Minimum one … central London office Contract: Permanent, Full Time (37.5 hours per week, Mon-Fri, with occasional out-of-hours) Salary: Competitive + Excellent Benefits Package The Role As Enterprise Data Architect, you will lead the design, implementation, and management of the organisation’s data architecture, ensuring consistency, security, and scalability across systems. This strategic role combines high … level planning with hands-on execution to ensure data is effectively captured, structured, governed, and leveraged across the charity. You will also line manage a Power BI Developer and work collaboratively with key stakeholders across IT, data, and operational functions. Key Responsibilities Define and implement data management policies and frameworks, including classification, governance, retention More ❯