276 to 300 of 1,192 Data Lake Jobs in the UK

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

Job Description Description: We are actively seeking a Data Engineer responsible for designing, building, and maintaining infrastructure that supports data storage, processing, and retrieval. The role involves working with large data sets and developing data pipelines to transfer data from source systems to data warehouses, data lakes, and other storage and processing systems. The Data Engineer will collaborate with stakeholders to address data-related technical issues and support their data infrastructure needs during the development, maintenance, and sustainment of the KR data architecture and data-driven solutions. Note: Due to federal security clearance requirements … managing or testing API Gateway tools and Rest APIs. Knowledge of traditional databases like Oracle, MySQL, etc., and modern data management technologies such as Data Lake, Data Fabric, and Data Mesh. Experience with creating DevSecOps pipelines using CI/CD tools and GitLab. Excellent technical documentation and communication skills. Strong interpersonal More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: The job you're considering The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Hybrid working: The places that you … Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and AWS tools. Adopt DevOps Practices: Utilize DevOps methodologies and tools for continuous integration and deployment (CI/CD), infrastructure as code (IaC), and automation More ❯

Role Overview We have an exciting opportunity for a Data Architect to join our growing Data & AI team. The successful applicant will work alongside our architects and consultants to deliver high-quality data solutions to help our customers become more successful in becoming a data-guided organisation. The Data Architect … Designing cloud-based data platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage. Building conceptual, logical and physical data models optimised for analytical use cases. … Security and Compliance. Strong experience in Data Warehouse methodologies. Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI. Strong experience in SQL. Good understanding of Azure infrastructure (Subscriptions/Resource Groups, Virtual More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

London – Senior Data Engineer, Consultant Ekimetrics UK Job Description About Ekimetrics Ekimetrics is a leader in data science and AI-powered solutions. Since 2006, we’ve pioneered the use of AI and data science applied to unified marketing performance, measurement and holistic business optimization aligned with sustainability goals. Our goal: Combine high-impact AI … role will be part of a global Data Engineering & Architecture team which helps keep data science projects operational across business lines (e.g., data lake implementation, data strategies, data transformation, advance machine learning), actively contributes to the transformation of our clients’ infrastructure and organisation, and democratises data-driven … Proactively support the Managers in building high-end client materials and commercial proposals Be the subject matter expert, advising and building solutions, in the contexts of PoC, Datalab or Datalake Have an innovative mindset to implement complex algorithms in a Big Data environment Engineering lead and mentoring; contribute to the development of Data Engineers through knowledge More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing large-scale data pipelines, ensuring … data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities … Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data manipulation, transformation, and automation tasks. Collaborate with data More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing large-scale data pipelines, ensuring … data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities … Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data manipulation, transformation, and automation tasks. Collaborate with data More ❯

Job Description My client, based in the London area, is currently looking to recruit an experienced AWS Databricks Data Architect to join their team. They are a leader within the consulting space and are experiencing growth, backed by a large multi-equity firm aiming to strengthen their financial position. The company anticipates year-on-year growth, enabling them … recent implementations of Gen AI. Your role will include: Designing and implementing effective architectural solutions around AWS serverless technologies (S3, Lambda, Athena, Kafka) and Databricks, including Data Lake and Data Warehousing. Assessing database implementation procedures to ensure GDPR and data compliance. Guiding and influencing technology teams and stakeholders on solution options, benefits, and … EKS, Terraform. Strong knowledge of data modeling and Kinesis. Understanding of SQL and database management. Hands-on experience with Data Warehouse and Data Lake technologies, preferably on AWS. Benefits include: Hybrid work (2 days in London) 28 days holiday plus bank holidays Private medical health insurance Pension scheme And more... This is an More ❯

maintaining and optimising our current data solution as well as advancing it to the next level. We have created an initial gem of a Data Lake and Lakehouse (Azure Data Lake, ADF, Databricks, Airflow, DBT) to enable Business Intelligence and Data Analytics (Superset, RStudio Connect). Our Data Lake is fully metadata driven, cost efficient, documented, and reproducible. We need our one-source-of-truth to be reliable and of high quality for both internal and external reporting and insight generation. But it is just the start – we will need best practice solutions around how we share data and insight back to our … innovation in your solutions as we grow. Main responsibilities: Take ownership of the centralisation of different data sources into our Lakehouse (Databricks on Azure Data Lake) and its architecture. Be responsible for the reliability and quality of data in the Data Lake (including anomaly detection, data quality checks More ❯

My client is based in the London area are currently looking to recruit for an experienced AWS Databricks Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data Architect to join their team. They … the market. Your role will include: Responsible for designing and implementing effective Architectural solutions around the AWS Severless Technologies (S3, Lambda, Athena, Kafka) and Databricks including Data Lake and Data Warehousing. Assess database implementation procedures to ensure they comply with GDPR and data compliance. Guide, influence and challenge the technology teams and stakeholders … Terraform, Excellent understanding of Data Modelling & Kinesis An understanding of SQL/database management. Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around AWS. My client is providing access to; Hybrid 2 days (London), 28 Days Holiday, Plus Bank Holiday Private Medical Health Pension Scheme And More... This role More ❯

Social network you want to login/join with: Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change. Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing international and diverse … business challenges in a range of domains. Collect functional and non-functional requirements, consider technical environments, business constraints, and enterprise organizations. Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs … web services, training and scoring machine learning models. Collaborate closely with partners, strategy consultants, and data scientists in a flat and agile organization where personal initiative is highly valued. Share data engineering knowledge by giving technical training. Guide and mentor team members. What you will bring 3-4 years of experience in data engineering. More ❯

Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet data requirements. Optimize data … services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong problem-solving and analytical skills. Experience More ❯

Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet data requirements. Optimize data … services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong problem-solving and analytical skills. Experience More ❯

Senior Data Engineer Location: Remote, Birmingham (UK) Salary: £60,000 to £70,000 per annum (Negotiable) Type: Permanent, Full-Time Experience Level: Senior Management Industry: IT Focus: Data Analysis & Business Intelligence About the Role: We are seeking a Senior Data Engineer to join an Azure-native data team. The role involves maintaining … and enhancing the data platform, working on … data integration, ETL pipelines, analytics, and AI initiatives. Responsibilities: Designing, building, and optimising Azure Data Factory pipelines. Working with SQL Server, Azure Data Lake, and Power BI. Integrating machine learning and AI models into data processes. Collaborating in an Agile Scrum environment using Azure DevOps. Mentoring team members and sharing knowledge. More ❯

Social network you want to login/join with: We're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact central government programmes. This is a fully remote role , but active SC clearance is essential . Applicants without current SC clearance cannot … be considered. As a senior member of the Data Engineering team, you'll play a pivotal role in designing high-quality data pipelines, guiding delivery teams, and collaborating with cross-functional experts to solve complex data challenges. You'll champion engineering best practices and bring thought leadership to technical planning, client engagement, and innovation. … stakeholders to translate requirements into solutions Promoting engineering standards and contributing to internal capability building You'll Need: Active SC Clearance Proven experience with Microsoft Azure (Data Lake, Synapse, Purview) Strong understanding of secure data handling, DevOps, and compliance Experience with structured and unstructured data sources (e.g., Azure SQL, MongoDB) Familiarity with Power More ❯

Senior Data Engineer - SC Cleared Remote (UK-based) £75,000 - 85,000 + Benefits Full-Time | Central Government Projects We're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact central government programmes. This is a fully remote role , but … active SC clearance is essential . Applicants without current SC clearance cannot be considered. As a senior member of the Data Engineering team, you'll play a pivotal role in designing high-quality data pipelines, guiding delivery teams, and collaborating with cross-functional experts to solve complex data challenges. You'll champion engineering best … stakeholders to translate requirements into solutions Promoting engineering standards and contributing to internal capability building You'll Need: Active SC Clearance Proven experience with Microsoft Azure (Data Lake, Synapse, Purview) Strong understanding of secure data handling, DevOps, and compliance Experience with structured and unstructured data sources (e.g., Azure SQL, MongoDB) Familiarity with Power More ❯

Title: Director, Data Cloud Architecture Location: London Reporting to: Sr. Director, Architecture WHO WE ARE Choreograph is WPP’s global data products and technology company. We’re on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We work with agencies and clients … to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We’re endlessly curious. Our team of thinkers, builders, creators and problem solvers are over 1,000 strong, across … markets around the world. WHO WE ARE LOOKING FOR We are seeking a seasoned and visionary Director, Data & Cloud Architecture to lead the design, strategy, and implementation of our data and cloud infrastructure. In this leadership role, you will be responsible for architecting scalable, secure, and high-performing cloud and data ecosystems that align More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

Job Description An exciting opportunity has arisen for an experienced data engineering leader to drive innovation and build a best-in-class data infrastructure at a leading private markets firm. This role will lead a high-performing team in designing and scaling data platforms, with a strong emphasis on Azure Databricks , to enhance investment … decision-making and operational efficiency. The Role As Head of Data Engineering , you will be responsible for shaping and executing the firm’s data strategy, working closely with stakeholders across technology, investment, and transformation teams. Your expertise in data architecture, cloud platforms, and engineering best practices will be instrumental in building scalable, high-performance … engineering, data architecture, or analytics, ideally within investment management, financial services, or private markets. Strong expertise in Azure cloud services, Synapse, Databricks, Spark, and data lake architectures. Deep understanding of ETL/ELT processes, data modeling, and high-performance data warehousing. Experience managing large-scale data platforms and optimizing More ❯

core platform for data engineering and analytics. Develop and optimise data models, ETL/ELT pipelines, and data processing frameworks using Databricks, Delta Lake, and other Azure data services. Ensure data solutions align with business objectives, regulatory requirements, and best practices in data governance, security, and compliance. … data architectures to technical and non-technical stakeholders. Expertise in data modelling (conceptual, logical, and physical). Data warehousing and data lake architecture for high-performance analytics. ETL/ELT pipeline development and optimisation to support large-scale data processing. Data integration across structured and unstructured sources … management and governance to maintain data quality and lineage. Deep expertise in Microsoft Azure cloud services, particularly for data analytics and engineering Databricks, including Delta Lake architecture, optimisation, and advanced data processing. Our Benefits Hybrid working – 2 days in the office and 3 days working from home 25 days annual leave, rising to More ❯