26 to 50 of 276 Data Lake Jobs in the UK

building a high-impact team in Northern Ireland. The Role: You'll build robust backend services in Go that power both the data platform (data lake, pipelines, model serving) and product-facing APIs . You'll collaborate with Data Science (leaders, DS, ML engineers, data engineers) to standardize tooling, operationalize models … and real-time/batch inference * Help standardize frameworks, libraries, and best practices across DS/Eng (packaging, environments, CI/CD, testing) * Contribute to the data lake/data platform foundations (catalog, lineage, governance, access patterns) Backend APIs & Services * Build and evolve gRPC/REST APIs powering customer-facing features and internal platforms * Implement … analytics (Parquet/Arrow) Career Paths (we're hiring multiple profiles): * Go Backend (API-first): Own product APIs, performance, reliability. * Go Platform (ML-first): Focus on data lake, pipelines, model serving. * Hybrid: Split time across APIs and ML platform enablement. * Growth routes to Senior or Tech Lead as the NI team scales. Why Join: * Shape a greenfield More ❯

Join us in shaping the future of sustainable housing. We're building a cutting-edge regional data platform that unites retrofit programme data from local authorities, contractors, and IoT telemetry to drive smarter decisions and demonstrate … real-world impact. As a Data Engineer, you'll design and develop scalable data pipelines and dimensional models on an enterprise-grade data lake, enabling high-quality, insight-rich datasets and APIs. Your work will power dashboards and reporting tools that help partners track outcomes, measure value, and accelerate carbon reduction. If you … re passionate about data, innovation, and making a tangible difference, we want to hear from you! Please note, this is a fixed term contract for a period of 12 months. What you will be doing. Design and develop Extract, Transform and Load (ETL) pipeline processes to automate the access to source data, quality check and increase More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data Services … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Data Services Manager, Must live within 2 hours of London or Berkshire and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Financial service background mandatory. Expanding financial services client are looking … for a Data Services Manager to join their team. The role will suit a candidate who has been a manager for a couple of years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent … Focused on maintaining our nimble, agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and data architecture development … . Knowledge of the relevant procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience implementing and integrating data More ❯

Data Scientist Data Scientist Initial 6-month contract £475 to £500 per day Outside IR35 Remote Working (+ occasional site visits) The Opportunity ISR are supporting a major UK Government Agency seeking an experienced Data Scientist to help shape and expand their data and analytics capabilities. You’ll play a key role … in designing and delivering advanced data models, integrating new sources of information and applying modern AI and machine learning techniques to solve real-world challenges. This role is ideal for someone who thrives at the intersection of data science, analytics, and public sector transformation, helping to deliver better outcomes for the general public through data … understanding of statistical modelling and machine learning. Experience with Azure Machine Learning (AML), Azure Data Factory, and the broader Azure data ecosystem (Data Lake, Synapse, Analysis Services). Expertise in Natural Language Processing, clustering algorithms, text embeddings, LangChain and LLM deployment. Strong knowledge of data visualisation tools such as Power BI More ❯

as Mulesoft Expertise in Integration patterns involving files(using FTP, SFTP, MoveIT), MQ, CDC, Message Bus, Hub & Spoke, Pub/Sub Experience in implementation of Security standards for Data in Transit & Rest such as TLS/… SSL, Data Encryption Knowledge in MQ & AMQ concepts such as RabbitMQ & Oracle MQ Expertise Knowledge in Data Management workflow & integration such as Data Lake, ETL , Data Ingestion, Sharding, Data Stream, Data Catalogue, Data Cleansing, Data Analytics, Batch, Scheduling Implementation knowledge on principles such … as ACID, SOLID, OWASP Knowledge on UK GDPR, PII, PCI-DSS data standards Implementation of designs related to Batch processing patterns involving Talend, Databricks, Snowflake or similar Experience of running GDPR related projects involving Data Sourcing, Validations, Integration, Data Disposition, Auditing & Reporting Ability to treat Data as an Asset and Architect & provide More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. JOB DESCRIPTION Tech stack While the client is keen to … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING AREAS – MANCHESTER, BRISTOL. … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING AREAS – MANCHESTER, LONDON. … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

Data Engineer - Azure/GCP, Data Lake, Snowflake Up to £700 per day (Inside IR35) London/Hybrid (1-2 days per week hybrid working) 6 months I am currently working with an instantly recognisable, high profile client who urgently require a Data Engineer with expertise in Azure/GCP and Data Lakes to join a major transformation programme, whilst expanding Data sources and identifying more Data sources to help produce more metrics to drive Data capability across the entire organisation, helping bridge the gap between Data Engineering and Security. Key Requirements: Proven experience as a Data Engineer in a … large, complex, regulated organisation Expertise with Cloud Platforms (Azure and GCP preferred) Previous experience of working with Data Lakes Demonstrable experience of ingesting, extracting and analysing Data from diverse sources Ability to create a centralised and standardised view from using Data from across multiple Business/Market Units across the entire organisation Understanding of More ❯

Data Services Manager Remote (UK-based) | Quarterly travel to London £85,000 + benefits Permanent | Full-time About the Role My client are seeking an experienced Data Services Manager to lead a high-performing data engineering function within a fast-paced financial services organisation. Reporting to the Senior Data Services Manager, you … ll drive the design, delivery, and continuous improvement of data solutions that underpin strategic decision-making and regulatory compliance. You'll manage and mentor Data Engineers, ensuring scalable, high-quality data products and operational excellence across both on-premise and cloud platforms. Key Responsibilities Lead, coach, and develop a team of Data … data solutions. Provide technical leadership across the Microsoft and Azure Data Platform (SQL Server, Power BI, Azure Data Factory, Databricks, Data Lake). Champion Data Governance , Data Quality , and Data Management best practices. Collaborate with business and technology teams to align data solutions More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Principal Data Engineer - hyrbid (Leeds) - £70k-£80k Are you an experienced Azure Data Engineer looking to make an impact in an established financial insitution. We are seeking a hands-on professional to join a high-performing team tasked with building and enhancing a modern Azure data platform, with an expertise in Databricks. About the … architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to … outputs. Opportunity to transition into a leadership role, supporting the development of junior team members. Key Skills & Experience: 5+ years of experience in Azure (ADF, Data Lake, Synapse). Strong SQL skills for data integration and reporting. Experience with Power BI for visualization and analytics. Familiarity with Python (preferred but not currently in use More ❯

Overview Data & Insight Managing Consultant Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always make a remarkable impact for our clients. We do this … helping them solve their most complex, ambiguous and strategic problems in new, inspiring and innovative ways. We collaborate with our clients to build remarkable digital products, together. The Data and Insight Practice in AND Consulting helps our clients to use data to make business choices based on evidence, design best in class technology and support them … in embedding data into their strategy and ways of working. As a Data & Insight Managing Consultant, you will be working and leading on data consulting projects with AND Digital's household name clients. Responsibilities Creating data visions & strategies for household name businesses Driving the transformation required for data-focussed ways More ❯

Contract Role Remote Working £600 - £700, Inside IR35 We're partnering with a Global IT Partner who are looking for a Databricks Solution Architect to provide guidance on data architecture and design and optimise Databricks solutions. As a Databricks Solution Architect, you will be responsible for: Lead end-to-end architecture of data lakes to Azure … focus on Databricks Provide technical leadership on Databricks Design and implement data pipelines in Azure Databricks, optimizing for performance, cost, and scalability Advise of data lake migration, data modelling and pipeline optimisation Refactor and modernize existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to … on building scalable data pipelines Expertise in Azure Databricks (7+years) including building and managing ETL pipelines using PySpark or Scala (essential) Solid understanding of Apache Spark, Delta Lake, and distributed data processing concepts Hands-on experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics Proficiency More ❯

Data Engineer Join the Team Powering the Future of Data at Vivedia Location: Sheffield - Hybrid (3 days per week) Salary : £50,000 to £60,000 depending on experience Department: Data Team At Vivedia , data isn’t just numbers — it’s the engine driving every decision, every innovation, and every customer experience. We … re growing, and we’re looking for a Data Engineer who’s ready to build the foundations of a smarter, more connected future. Why You’ll Love This Role You’ll play a pivotal role in designing, building, and optimizing the data systems that power our business. From robust pipelines to scalable platforms, your work will … help every team at Vivedia unlock insights, drive performance, and make data-driven decisions that matter. This is your chance to shape the future of our data ecosystem — and see your impact ripple across an entire organisation. What You’ll Do Build the backbone of our data universe Design, develop, and deploy scalable, secure More ❯

Senior Data Engineer - Greenfield AWS Role Leeds (Hybrid) £75,000-£85,000 Our client is a nationally recognised leader in their industry, operating across the UK with a strong reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support enterprise-wide … transformation and insight-driven decision-making. The Role: We are seeking a Senior Data Engineer to play a key role in the design, build, and implementation of a new enterprise data platform as the business migrates to AWS. You will work closely with architects, analysts, and data scientists to develop robust, scalable, and secure … AWS data platform. Build and optimise scalable data pipelines to ingest, transform, and manage large datasets. Help design and develop a new data lake to support analytics and reporting across the business. Champion modern data engineering practices, including automation, quality, and governance. Collaborate with cross-functional teams to translate business requirements More ❯

Midlands (Full time onsite) We are currently working with a community services provider, who require a Senior BI Manager/BI Architect with a strong understanding of Azure Data and Data Engineering tools. Reporting into the CTI as a key member of the clients newly formed Data Engineering team, you will lead the design … client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. You will be responsible for strategic & technical Leadership and will help shape and evolve the BI and … required Excellent experience in BI architecture/management and team leadership Deep expertise in Azure BI architecture and cloud services Extensive hands-on experience with Azure Fabric, SQL warehousing, DataLakes, Databricks Track record in MI/BI product development using Agile and Waterfall methods Experience managing cross-functional teams and sprint activities The role will be full time on-site More ❯

Senior Data Engineer Would you like to ensure the successful delivery of the Data Platform and Software Innovations? Do you enjoy creating a collaborative and customer-focused working environment? About Team: LexisNexis Intellectual Property, which serves customers in more than 150 countries with 11,300 employees worldwide, is part of RELX, a global provider of information … based analytics and decision tools for professional and business customers. About Role: As a Senior Data Engineer at LexisNexis Intellectual Property (LNIP), you will play a key role in delivering high-quality, scalable data solutions that power our Strategic Data Platform - the backbone for products like PatentSight+ and other analytics offerings. In this role … event-driven systems , or data sharing platforms like Databricks Delta Sharing Solid understanding of distributed data processing, ETL/ELT workflows, and data lake/lakehouse architectures Experience with cloud platforms (e.g., AWS, Azure, GCP) and modern data tooling A track record of mentoring or coaching other engineers Strong communication and More ❯

Data Engineering Consultant - Home-based - £40-55k Please note - you must be based in the UK with the unrestricted right to work in the UK to be eligible for this role, this organisation is not able to offer sponsorship. Whilst this is a home-based role, you will be required to travel to London on a monthly … Design and implement ETL/ELT pipelines using Microsoft Fabric, Azure Synapse, or Databricks - experience with at least one of these platforms is essential. Build scalable data lake solutions using medallion architecture principles. Migrate legacy on-premises data systems (SQL Server, SSIS, SSAS, SSRS) to cloud-based platforms. Create insightful dashboards and reports using Power … Warehouse Development. Hands-on expertise with Microsoft Fabric, Azure Synapse, or Databricks. Strong SQL and Python skills, including stored procedures and notebooks. Knowledge of data lake design and large-scale data integration. Familiarity with Power BI, MDX/DAX, and data warehousing concepts. Certifications such as DP-600, DP-700, or More ❯

days per week onsite) We are currently working with a leading services provider, who require a Senior BI Manager/BI Architect with a strong understanding of Azure Data and Data Engineering tools. Working as a key member of a newly formed Data Engineering team, you will lead the design, development, and ongoing enhancement … client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. This role would suit a hands on BI Architect who is looking to progress into a "Head … rapid career growth! Skills & experience required: Excellent experience in BI architecture Deep expertise in Azure BI architecture and Cloud services Extensive hands-on experience with Azure Fabric, SQL warehousing, DataLakes, Databricks Track record in MI/BI product development using Agile and Waterfall methods Desirable - Experience managing cross-functional teams and sprint activities Benefits: Generous and achievable bonus scheme More ❯

Job Title: Staff Data Engineer Location: London, Hybrid Salary: c.£140,000 + bonus + share options Why Apply? This is a unique opportunity to take a leading role in shaping the data strategy of a fast growing Insurtech scale-up. The role combines hands on technical work with strategic influence, allowing you to develop both … systems and people. You'll lead a small but high impact team, work across multiple business functions, and help deliver a modern, scalable data platform that drives business decisions. Responsibilities: Lead, mentor, and develop a high performing team of Data Engineers, fostering a culture of learning and excellence. Define and execute the data engineering … a fast-paced environment. Strong communication and stakeholder management skills, able to translate technical concepts into business value. Experience with real-time data processing, Data Lake or Data Mesh architectures is a plus. Curiosity about AI and its practical application to improve data workflows. What's in it for me? Competitive More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role, you’ll play a key part in designing and developing scalable data … football world—including performance insights for some of the most well-known footballers in the industry . This is the perfect environment for those passionate about leveraging advanced data engineering to drive real-world results in sports analytics. Key Responsibilities Architect, design, build, test, and maintain scalable and high-performance data pipelines Ensure all systems adhere … predictive insights Collaborate with data scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL More ❯