126 to 150 of 154 Data Lake Jobs in the UK

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. … Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. ...

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. … Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. ...

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. … Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. ...

Data Engineer (Hybrid) Bristol – Spark, S3, Redshift, Lambda, EMR, Glue Avanti Recruitment is working with a rapidly growing technology business in Bristol to recruit a talented AWS Data Engineer to join their team. You will help build and evolve their AWS cloud-based data infrastructure. You’ll work with large datasets and a modern AWS stack, designing scalable pipelines and delivering reliable data to teams across the organisation. In this role, you will develop and maintain ETL and ELT workflows using Apache Spark, Python and AWS Glue, while architecting solutions ...

Developer to their in-house development team. In this role, you will be responsible for designing, developing, and maintaining BI solutions that transform data into actionable insights. As a Power BI Developer, you will be expected to have strong experience in data modelling, DAX, and visualization … Experience: Experience delivering enterprise-grade Power BI SQL Databases Data Visualisation, Power Query, DAX Azure SQL, Microsoft Fabric, Synapse, Data Lake would be desirable Understanding of ETL processes and Data Modelling Excellent analytical skills GIT/Azure DevOps Relevant professional certifications would ...

RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data loads. Build and manage containerised environments using Docker for consistent development, testing ...

RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data loads. Build and manage containerised environments using Docker for consistent development, testing ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

Nvidia, Kleiner Perkins, Google and top founders and operators including Stripe, Datadog, Miro, Webflow, and Facebook. What you'll do at Synthesia: The Data team manages the complete lifecycle of data for researchers - from sourcing and large-scale processing to delivering datasets that power our models. … engineering, and ML infrastructure rather than being a traditional research position. You'll build the world's best human-centric data lake by collaborating closely with our model training teams. By understanding their requirements, you'll extract new features and annotations that elevate our datasets. ...

passionate about unlocking the power of data to drive innovation and transform businesses? Join our dynamic team as a Senior Data Engineer, where you'll lead the charge in crafting innovative solutions that leverage data for real-world impact. Collaborate with a team that … training and development opportunities. What you'll be doing: Collaborating on business requirements, low-level designs, and technical specifications. Developing, testing, and deploying data integration and reporting processes. Mentoring and supporting junior colleagues, while promoting best practices. Driving issue resolution during testing and deployment phases. Sharing experiences ...

Love payroll? Obsessed with data? This is your moment! At GXO , we’re looking for a Payroll MI Analyst to join us on a 9-month fixed-term contract. You’ll dive into data reporting, exception analysis, and process improvements—helping us standardise and streamline … Access. If you have knowledge of Java or Python knowledge this would be big tick for us! Familiarity of working with data lake/warehouse(s) with VBA knowledge to remove manual activity Strong analytical and project management skills with the ability to identify and resolve problems ...

Client Join a high-growth technology organisation based in the heart of Newcastle upon Tyne , where expert teams design, manage, and optimise critical data platforms. Our client has been recognised by The Sunday Times as one of the UK's Best Places to Work , reflecting a culture built … business teams to improve database design, stored procedures, and queries Support cloud-based data solutions including Azure SQL Server, Data Lake, and related storage technologies Apply technical judgement to deliver solutions that improve reliability, efficiency, and scalability Contribute to a culture of continuous improvement ...

supports our IoT and analytics platforms. You'll be responsible for ensuring that our systems are scalable, secure, and reliable , working closely with data, software, and DevOps teams to deliver a smooth, automated environment for deployment and monitoring. This role suits an engineer who thrives on automation, cloud … dynamic environment Desirable Experience • Exposure to IoT data ingestion and stream processing (MQTT, Kafka, Kinesis, etc.) • Familiarity with data lake/analytics environments (S3, Athena, Snowflake, BigQuery) • Experience with security frameworks (CIS Benchmarks, NIST, SOC2) • Previous work in regulated industries (water, utilities, energy, or environmental ...

Data Engineering Team Lead - Remote - Databricks - Azure - 80k Join a Leading Microsoft Consultancy Driving Data Innovation I'm working with a well-established Microsoft Partner with an incredible project pipeline, rapid growth, and a reputation for delivering Tech for Good. They're working on cutting-edge … projects using emerging technologies like Microsoft Fabric and Azure Databricks. We're looking for a Data engineering team lead who combines hands-on technical expertise with leadership skills to mentor a talented team and deliver exceptional solutions for our clients. What You'll Do Lead and mentor ...

Data Engineering Team Lead - Remote - Databricks - Azure - 80k Join a Leading Microsoft Consultancy Driving Data Innovation I'm working with a well-established Microsoft Partner with an incredible project pipeline, rapid growth, and a reputation for delivering Tech for Good. They're working on cutting-edge … projects using emerging technologies like Microsoft Fabric and Azure Databricks. We're looking for a Data engineering team lead who combines hands-on technical expertise with leadership skills to mentor a talented team and deliver exceptional solutions for our clients. What You'll Do Lead and mentor ...

Type: Permanent Salary: £45 - 52k + Benefits Overview A forward-thinking organisation is looking for a skilled SQL Database Administrator to join its Data Services team. This is a hands-on role focused on maintaining, securing, and optimising both on-premise and cloud-based data environments. … working with a modern tech stack, contributing to transformation projects, and helping shape the future of data infrastructure. The Role You'll be responsible for the day-to-day management of SQL Server and Azure-based data systems, supporting ETL processes, and driving improvements across data ...

supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies, artifact management, automated testing, and environmental promotion … Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD. Proficient in scripting with Python, Bash, or PowerShell ...

ready to blend expert Microsoft Stack engineering with a mission that truly matters? Barnardo's is embarking on an ambitious, long-term Digital, Data, and Technology (DDaT) strategy focused on automation, integration, and AI. As a key Integration and Application Engineer , you will be pivotal in building … AzureCLI . Microsoft Stack Mastery: Expert knowledge of the full Microsoft Stack, including Power Platform (Power Automate, Power Apps, CoPilot), Azure (Data Lake, Synapse), and M365 (Office, SharePoint) . Integration Skills: Proven ability to design, build, and manage APIs and link external APIs (Azure AD Applications ...

Financial Crime Data Analyst Location: London Northampton, Glasgow UK Duration: 6 months Overview We are seeking a highly skilled and motivated Data Analyst to join our team, focusing on the analysis of large and complex datasets related to payments and sanctions . The ideal candidate will … possess a strong technical foundation, a keen eye for detail, and the ability to translate data into actionable insights crucial for compliance and business operations. Required Skills and Experience Professional experience as a Data Analyst Expert proficiency in SQL for querying, aggregating, and analyzing large datasets. ...

Salesforce, SAP, Microsoft Dynamics, or Oracle working across sales, service and marketing. Proven expertise in delivering complex CRM integrations with external systems (Data Lakes, ERP, analytical platforms, and messaging systems) Experience with commerce platforms (such as Salesforce commerce cloud, Adobe commerce, etc ) and integration platforms (such as Mulesoft ...

ITIL 4 UK Public Sector deals Familiarity with: AI(Ops), Intelligent Automation, Lean and Analytics Experience with tooling for Discovery, Monitoring and Patching Data lakes Modern Catalog Management ServiceNow, SMAX or Remedy is a plus UK Security Clearance: At least ...

business. With a strong commitment to Microsoft Azure technologies and a cloud-first approach, this is an exciting opportunity to shape how data is transformed into meaningful information for decision-making. As a Senior Business Intelligence Developer, you will work across the full BI stack, designing and implementing … robust reporting solutions and ETL processes that ensure data accuracy and reliability. You will collaborate with architects, analysts and stakeholders to deliver high-quality insights that support strategic growth. In this role, you will be responsible for: Developing and maintaining Power BI dashboards and reports to provide actionable ...

Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow, PyTorch, and Keras. … Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees, Random Forest, Gradient ...

Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow, PyTorch, and Keras. … Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees, Random Forest, Gradient ...