151 to 175 of 328 Data Lake Jobs in the UK

Data Engineer - PowerBI Inside IR35 Fully Remote £350-£400 per day Initial 2 month contract with chance of extension We are looking for an experienced and solutions-focused Data Engineer with strong Power BI expertise. The role includes leading the delivery of scalable, high-quality data pipelines and analytics platforms that power business intelligence … autonomy in contributing to architectural decisions and engineering standards, with a key focus on Power BI implementation, DAX development, and dashboard optimisation. It suits someone capable of owning data engineering and reporting workstreams, mentoring junior staff, and aligning technical output with strategic business goals. Your Responsibilities · Design, develop, and maintain production-grade data pipelines that support … Strong programming skills in Python. · Exposure to orchestration tools (Airflow, dbt, Dataform) and integration with Power BI. · Experience with Azure-based data services (Azure Data Lake, Synapse, Data Factory) and their integration with Power BI. · Knowledge of data modelling techniques including star/snowflake schema design for BI solutions. · Understanding of More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

the Kraken technology platform, designed from the ground up for the energy sector, and covering everything from billing to managing customer interactions. We are looking for an experienced data leader to lead the data analysts & scientists supporting our operational teams, enabling them to extract key actionable insights from the Kraken platform, and help the teams to … software engineering best practices to design, test, and deploy our data platform and services using the below technologies: Python as our main programming language Databricks as our datalake platform Kubernetes for data services and task orchestration Terraform for infrastructure Streamlit for data applications Airflow purely for job scheduling and tracking Circle CI for continuous … deployment Parquet and Delta file formats on S3 for data lake storage Spark for data processing DBT for data modelling SparkSQL for analytics Why else you'll love it here Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we More ❯

Location: London, England, United Kingdom Join Axon and be a Force for Good. Design, build, and maintain scalable, secure, and efficient data pipelines using modern data tools and cloud-native technologies Work with a variety of data sources-structured, semi-structured, unstructured-to support diverse analytics and operational workloads Ensure data quality … and consistency by incorporating automated testing, data validation, and monitoring mechanisms Drive best practices around data engineering, including testing, observability, security, and documentation Troubleshoot and resolve issues in production environments to ensure data integrity and platform reliability What you bring: 5+ years of professional experience in data engineering roles, preferably for a … effective use of AI tooling in your development process A growth mindset and eagerness to work in a fast-paced, mission-driven environment Good understanding of data lake architecture, medallion architecture, and data warehouse concepts. Good understanding of cloud architectures and technologies, including Docker and Kubernetes Good data modelling skills, and experience applying More ❯

Build the future of the AI Data Cloud. Join the Snowflake team. We are looking for data experts who have a strong background in building data platforms and love to use their skills to supercharge data teams. Our team helps customers on their data journey with Snowflake, which is very … fast becoming the central data platform for companies big and small. That means you will work on some of the most challenging data projects you can find, in a post-sales capacity. We are hiring a range of seniority levels, though we do not currently hire people without relevant experience. During the interview process, we will … career levels. What we are offering: We help each other to stay on top of the game and up-to-date with the latest features in the Snowflake Data Cloud. Snowflake had the biggest software IPO of all times and we continue to grow at a rapid pace, which means there is ample opportunity to change the future More ❯

building robust DW/BI solutions with a focus on statistical and advanced analytics is essential. The role involves close collaboration with Architects and Business Analysts to define data requirements, create Source-to-Target mappings, and design ETL pipelines based on business documentation. Insurance domain experience is a plus.(Commercial/Speciality Insurance) Lead ETL and reporting design … Guide offshore teams in developing optimized, high-quality code deliverables. Contribute to detailed design, architecture, and implementation artifacts, including ETL development, testing support, and deployment. Collaborate regularly with Data Architects, Data Modelers, and Testing teams to ensure seamless delivery. Diagnose customer issues, design innovative solutions, and support deployment to ensure client satisfaction. Maintain high standards of … MSBI (SSIS) Nice to Have: Experience or familiarity is beneficial. SQL & Data Lakes Mandatory: Strong proficiency in SQL and solid hands-on experience with Data Lake architecture. Strong SQL skills, including complex query writing In-depth knowledge of Data Lakes and related modules Fair understanding of data modeling concepts and data More ❯

Data Architect Location: Hybrid - London (2-3 days onsite) Type: Permanent Industry: Data Consultancy Salary: Competitive + Benefits The Opportunity Our client, a growing data consultancy with deep expertise in the Microsoft Azure ecosystem, is looking for a Data Architect to join their high-performing team. This role is both strategic and … hands-on, focused on designing modern, scalable, and secure data platforms for enterprise clients. You'll play a key role in shaping data architecture across the full Azure stack- including Azure Databricks and Azure Data Factory (ADF) -and will guide engineering teams in delivering robust, future-proof solutions using … lakehouse and medallion architecture principles . Key Responsibilities Design end-to-end data architectures using Azure services, including Azure Databricks, ADF, Synapse Analytics , and Data Lake Storage Define scalable data models and implement architectural patterns such as lakehouse and medallion Lead technical solution design during client engagements, from discovery to delivery Establish and More ❯

Data Architect Location: Hybrid - London (2-3 days onsite) Type: Permanent Industry: Data Consultancy Salary: Competitive + Benefits The Opportunity Our client, a growing data consultancy with deep expertise in the Microsoft Azure ecosystem, is looking for a Data Architect to join their high-performing team. This role is both strategic and … hands-on, focused on designing modern, scalable, and secure data platforms for enterprise clients. You'll play a key role in shaping data architecture across the full Azure stack- including Azure Databricks and Azure Data Factory (ADF) -and will guide engineering teams in delivering robust, future-proof solutions using … lakehouse and medallion architecture principles . Key Responsibilities Design end-to-end data architectures using Azure services, including Azure Databricks, ADF, Synapse Analytics , and Data Lake Storage Define scalable data models and implement architectural patterns such as lakehouse and medallion Lead technical solution design during client engagements, from discovery to delivery Establish and More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools. * Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment. * Monitor production ML systems for performance, data … performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL. * Prepare and preprocess large datasets to ensure data quality and readiness for ML modelling and analytics workflows. 4. Software Engineering & Collaboration * Write clean, maintainable, and More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools.* Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment.* Monitor production ML systems for performance, data … performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure data quality and readiness for ML modelling and analytics workflows. 4. Software Engineering & Collaboration * Write clean, maintainable, and More ❯

Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting through … cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance Tuning : Partitioning, caching, Spark job optimization Cloud Architecture : Infrastructure-as-code, monitoring, automation Finance Domain More ❯

Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting through … cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance Tuning : Partitioning, caching, Spark job optimization Cloud Architecture : Infrastructure-as-code, monitoring, automation Finance Domain More ❯

Data Engineer- Outside Ir35 - £500 daily rate- Manchester - 6 Month Role Overview: We're seeking an experienced Contract Data Engineer with a strong background in Databricks and cloud data platforms to support a high-impact data transformation programme. This hybrid role requires 2 days per week onsite in our Manchester office (non … negotiable) , with the remainder remote. You'll join a fast-paced, delivery-focused data team responsible for building and optimising scalable, production-grade data pipelines and infrastructure. Key Responsibilities: Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark Ingest, transform, and manage large volumes of data from diverse sources … based projects Strong hands-on skills with Databricks , Apache Spark , and Python or Scala Proficient in SQL and working with large-scale data environments Experience with Delta Lake , Azure Data Lake , or similar technologies Familiarity with version control, CI/CD, and infrastructure-as-code tools Ability to deliver independently in a contractor capacity More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

s how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams … to ensure seamless data flow and accessibility, supporting data-driven decision-making. Our systems are designed to handle large volumes of data, maintain quality and integrity, and provide robust APIs for fast, ergonomic data retrieval. About the Role In this role you will: Collaborate with cross-functional teams to deliver data … trading Experience with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more More ❯

Head of Data Engineering | High-Growth InsurTech London - Hybrid (Once per week in office)Up to £120,000 (Maybe £130,000) + Bonus + Share Options Are you a data leader who loves building high-performing teams and scalable platforms? I'm hiring for a Head of Data Engineering at a rapidly growing InsurTech … insurance works-making it simpler, fairer, and more personalised. This is a hands-on leadership role where you'll set the strategy, guide architecture, and empower a talented data engineering team to deliver world-class data systems in a fast-paced, product-led environment. Why This Role Stands Out Competitive salary + company share options Hybrid … ideas into business impact Passion for developing talent and fostering a culture of learning and ownership Nice to Have Experience with Data Mesh or Data Lake architectures Familiarity with Kubernetes , Docker, and real-time streaming (Kafka, Kinesis) Exposure to ML engineering pipelines or MLOps Interested? If you're ready to lead a team at the More ❯

of educational apps for children ages 2 to 7. Our products are among the top 15 in the preschool apps category globally. We're looking for a skilled Data Engineer to design and maintain robust data infrastructure and pipelines, driving data accessibility and reliability across our platform. Working format: full-time, remote. Schedule: Monday … to Friday (the working day is 8+1 hours). Responsibilities: Design, develop, and maintain data pipelines using Apache Airflow . Create and support data storage systems (Data Lakes/Data Warehouses) based on AWS (S3, Redshift, Glue, Athena, etc.). Integrate data from various sources, including mobile apps , third-party … APIs , and internal services . Ensure data quality, consistency, and availability . Support analysts: build user-friendly data marts and contribute to schema and data model design. Set up pipeline monitoring , alerting , and logging . Participate in architectural decisions and technology selection . Optimize existing data storage systems and complex SQL queries More ❯

Data Solutions Architect £90000-115000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solution Architect £90,000 - £115,000 + Bonus London - Hybrid - Permanent A global leader in IT Solutions and Consulting is seeking a Lead Data Solution Architect to join their dynamic, remote-first architectural team. You … will lead the design and delivery of innovative cloud-based data solutions for enterprise clients across various sectors. Working alongside talented Data Engineers, Business Analysts, and QA Analysts, you'll drive architectural best practices and deliver high-quality data solutions. This is an opportunity to own technical delivery, influence client architecture, and work with … Architect , leading end-to-end delivery of complex data solutions. Extensive expertise in data architecture design , including event-driven architectures (Kafka) and Data Lake/Lakehouse platforms . Hands-on experience with cloud platforms like AWS, Azure, GCP, or Snowflake. Strong knowledge of data governance, compliance, and security standards (GDPR, CCPA More ❯

responsible for designing and managing BI and analytics solutions for the companies product suite. It would suit someone who has worked as a BI Developer, SQL Developer or Data Engineer, who has an understanding of data security and integrity. A key part of the role will be SQL development, and will also involve building and maintaining … a data warehouse. You will probably have experience across the following: Designing and building BI solutions … Writing and optimizing SQL queries Data warehousing A good understanding of data security ETL processes Experience with Azure and related tools (Fabric, Data Lake, Data Factory etc.) would be beneficial but not essential. The company operate a hybrid working policy and you would normally need to be in the office a More ❯

responsible for designing and managing BI and analytics solutions for the companies product suite. It would suit someone who has worked as a BI Developer, SQL Developer or Data Engineer, who has an understanding of data security and integrity. A key part of the role will be SQL development, and will also involve building and maintaining … a data warehouse. You will probably have experience across the following: Designing and building BI solutions … Writing and optimizing SQL queries Data warehousing A good understanding of data security ETL processes Experience with Azure and related tools (Fabric, Data Lake, Data Factory etc.) would be beneficial but not essential. The company operate a hybrid working policy and you would normally need to be in the office a More ❯

Headof Data Nottingham £69,572 - £73,720 per annum Are you ready to shape the future of data at NCHA? Were excited to introduce a brand-new opportunity for a Head of Dataa strategic role for someone passionate about data, analytics, and driving transformational change. The Role As our Head of Data, youll lead the strategic direction of data and analytics across the NCHA Group. Youll be responsible for developing and delivering a comprehensive data strategy that supports dynamic live reporting and predictive analysis, moving beyond static historical KPIs. Youll manage and inspire our Information & Intelligence team of 8, ensuring robust data governance and … integrity, while building strong relationships with senior stakeholders to align data services with business priorities. Youll also guide architecture decisions for data platforms, manage key third-party partnerships, and ensure accurate reporting to internal and external stakeholders. Your main duties include but are not limited to: Leading the development and implementation of NCHAs data More ❯

depending on your location) and home working (expectation is 2 days in the office) Permanent Full time, 37 hours per week Do you have prior experience of Enterprise Data Engineering, dimensional modelling? Do you have experience of working within an Agile environment or are keen to work in one? Do you like to always explore, learn, challenge yourself … and are a good team player? If you can answer yes to the above we have an exciting opportunity for you with our expanding team! The Data and Digital Services team will transform the way data and digital services are provided in Anglian Water, moving from an order-taker service to a trusted, informed partner. The … self-service capabilities by default. As an ETL Developer, develop, test and/or quality assure extracts of data from corporate systems into the Data Lake As a Semantic Layer Developer, develop, test and/or quality assure semantic models As a Report Developer, develop, test and/or quality assure reports, visualisations and dashboards More ❯