51 to 75 of 144 Data Lake Jobs in the UK excluding London

Senior Databricks Data Engineer (Mid Level roles also available), £50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. … In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Databricks Data Engineer (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. … In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Lead Data Engineer, £ 70000 - 80000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Expanding SaaS product company are looking for a Lead Data Engineer as they continue to grow. In this hands-on role you will be part of the team responsible … for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data Architects to determine technical delivery and functionality. Design data solutions … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL. Experience of data warehousing and data lake solutions. Good knowledge of ETL processes and tools. Knowledge of databricks. This is an excellent opportunity to join a company as it continues to grow and expand its data More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … agile team. Experience working in a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding of clinical trials, GCP, and More ❯

About the Role We are seeking an enthusiastic and detail-oriented Data Analyst on a 12 month contract to join our energetic Data Team within a successful Financial Services business. This is a pivotal role in shaping the digital future of our organisation. You will work closely with business users and take ownership of mining, organising … and analysing data from both existing and new sources to support strategic planning and decision-making. Working closely with a small team of UK-based Data Analysts and IT experts (both in-house and from our central functions in Germany). Your work will directly influence business operations, customer experience, and innovation across departments. This role … Team in Germany to resolve cross-border data issues. Explore and apply new data sources and techniques to enhance our data lake and analytics capabilities. Promote the use of data-driven insights across departments. What we're looking for: Required: Education & Experience: Degree in Computer Science or equivalent professional More ❯

Job Title: Senior Data Engineer Location: Warwick, Hybrid - 2 days per week onsite Remuneration: Up to £650 per day Contract Details: Fixed Term Contract (6 months) Working Pattern: Full Time Join a leading organisation dedicated to connecting people to the energy they use safely, reliably, and efficiently! We're on the lookout for a talented Senior Data Engineer to elevate our data capabilities and drive our projects forward. If you're passionate about data engineering and thrive in a dynamic environment, we want to hear from you! Responsibilities: Lead the design, development, and maintenance of large-scale data systems, including data warehouses, data lakes, and … data pipelines. Create and manage ETL processes using tools like Matillion for seamless data integration. Develop and maintain data warehouse objects such as tables, views, and security roles in Snowflake. Extract data from various sources, ensuring accuracy and consistency throughout the process. Transform and cleanse data, implementing data More ❯

About the role: We're looking for a hands-on Data Engineer to join us on a 12-month max-term contract and play a key role in supporting and scaling our growing data infrastructure. In this role, you'll be responsible for building and maintaining scalable ETL/ELT pipelines using Databricks and modern cloud … to temporarily support our business intelligence needs, developing and maintaining reports and dashboards in ThoughtSpot (or a similar BI platform). You'll collaborate closely with our Lead Data Engineer, who will provide architectural guidance and help drive the strategic direction of our data transformation initiatives. This role is a great fit for a data … best work. Key Responsibilities: Data Engineering Build, maintain, and optimize robust ETL/ELT pipelines using Databricks. Contribute to the design and implementation of data lake and data warehouse architecture. Translate business requirements into reliable and scalable data solutions. Collaborate with the Lead Data Engineer on data More ❯

to Skip to Content Link Select how often (in days) to receive an alert: Date: 5 Aug 2025 Location: Edinburgh, GB Company: Royal London Group Job Title: Senior Data Engineer Contract Type: Permanent Working style: Hybrid 50% home/office based Overview: We have a fantastic opportunity for a Senior Data Engineer to join the Core … Data Engineering team in our Data & AI Office. The successful candidate can be based at our Edinburgh, Glasgow, or Alderley Edge office locations, offering a hybrid working model. This role involves managing data and technical assets to support analytics, data science, and machine learning projects that drive business insights and decision-making. … About the role: The Data Engineers in the Core Data Engineering Team work collaboratively with their peers in the wider team - the Data Modelling and QA Testing teams, to transform raw data into modelled, curated data assets for use by stakeholders in teams performing BI, analytics, and data More ❯

throughout MO, allowing the organisation to maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing … and peer review of ETL code in Oracle ODI Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing, and governance Contributing to technical … improve interactions with our customers and business partners. This could be data transfer from third parties, ETL into the data warehouse or data lake, providing insights and metrics, or improving performance or processes. This is a dynamic team, with data engineers and analysts working closely alongside members of the business in More ❯

throughout MO, allowing the organisation to maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing … and peer review of ETL code in Oracle ODI Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing, and governance Contributing to technical … improve interactions with our customers and business partners. This could be data transfer from third parties, ETL into the data warehouse or data lake, providing insights and metrics, or improving performance or processes. This is a dynamic team, with data engineers and analysts working closely alongside members of the business in More ❯

As a part of the client solutions team at Verisk Maplecroft you will be a part of the team charged with using technology to create, collate and deliver data analytics and intelligence to our clients in a geospatial context. We are primarily a Python/Django house with an Angular front end. We recently moved to AWS for … new workflows, pipelines, features and tools that give our clients the information they need to make the right decisions to create a more sustainable and resilient world. Geospatial data forms are a significant component of the data structures used within Verisk Maplecroft, and with an increasing availability of geospatial data in the modern era … and experience of geoservers, spatial projections, raster and vector manipulation within python and usage of GDAL Experience with AWS and data management tools, including data lake, data warehouse ETL, SQL based storage and PostgreSQL. Ability to design and implement data pipelines and data-related solutions, ideally within a cloud More ❯

with a flexible, student-powered workforce. The platform enables partnersfrom local pubs to multinational chainsto optimise staffing in real-time, enhancing efficiency and profitability. The Role As a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Building and Maintaining Data Pipelines: Design and implement scalable … ETL processes to integrate data into our mobile and web applications, as well as internal dashboards. Data Architecture Design: Develop and optimise data storage, retrieval, and processing systems to ensure efficiency and scalability. Collaboration: Work closely with data scientists, software engineers, and internal stakeholders to understand data needs and deliver … solutions that drive data-driven decisions. Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What Youll Bring Technical Expertise: Proficiency in Python and SQL; experience with data processing frameworks such as Airflow, Spark, or TensorFlow. Data Engineering Fundamentals: Strong understanding of data architecture, data More ❯

Our legal & regulatory client in Birmingham are looking for a Data Governance Lead to join their team. Overview of role: You will be supporting the organisation’s approach to increasing their levels of data maturity. You must demonstrate your ability to own and steer the enterprise-wide data governance programme to enable decisions to … be interested: Inclusive and innovative culture/Continuous improvement environment Recognised as one of the very best places to work in 2025 Experience Required: Significant experience in leading data governance, data management, or risk roles Strong understanding of data governance principles and best … practise Proven track record rolling out data quality frameworks and governance policies Familiarity with modern data platforms (Cloud data warehouse, Data Lake, ETL/ELT, catalogues, lineage, and quality tooling). Deep Knowledge of introducing and applying DAMA-DMBOK, ISO, DCAM, or equivalent frameworks Strategic thinking & systems orientation Data More ❯

Data Engineer Join a Trailblazing Team in Clinical Research Data ManagementStep into a role that places you at the cutting edge of clinical trials, leveraging Electronic Health Record (EHR) data to revolutionise patient care and research. Based in the innovative Manchester Science Park, this position offers the chance to be part of a world … is usually on Tuesdays and Thursdays but can be subject to change. Strong benefits package This role focuses on the development, performance, management, and troubleshooting of ETL processes, data pipelines, and data infrastructure. The successful candidate will ensure the effective and reliable operation of these systems, adopting new tools and technologies to stay ahead of industry … database testing; unit, performance, stress, security.- Experience in agile teams and highly regulated industries.- Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks.- Data science experience using R, Stata, or Python.- Familiarity with Atlassian tools; JIRA, Confluence, BitBucket.- Understanding of clinical trials, GCP, and GxP.Personal Attributes:- Strong collaboration More ❯

Haywards Heath, Home Office (Remote) or Manchester Salary: £55,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an excellent service. And that's … Lead Finance Solutions Developer 1st Central are on the lookout for a technically strong and analytically minded Lead Finance Solutions Developer who can bridge the gap between finance, data engineering, and actuarial analytics. If you're passionate about delivering high-quality, scalable data solutions to support business-critical decisions, and you enjoy working across multidisciplinary teams … related field. Strong SQL and data modelling skills; experience with relational databases. Skilled in working with cloud platforms (e.g., AWS, Azure, or GCP) and data lake environments. Experience with actuarial models, principles, and data structures (e.g., Actuarial reserving techniques, cashflow projections under Solvency II and IFRS 17) life tables, claims triangles, policy reserves More ❯

As a Data Engineer, you will design, build, and maintain data pipelines and solutions to support business needs. This role involves leveraging your technical expertise to enable data-driven decision-making. Client Details Data Engineer - Surrey - Hybrid Our client is a well-established organisation undergoing a significant digital and data transformation. With a focus on innovation and technology, they are investing in building modern, cloud-based data capabilities to drive smarter decision-making, improve customer experience, and support future growth. This is an exciting time to join a business that is placing data at the heart of its strategy and creating opportunities for impactful … work across the organisation Description Data Engineer - Surrey - Hybrid As the Data Engineer you will help design, build, and scale a modern Azure-based data platform. This is your chance to play a key role in shaping how data is used to drive smarter decisions and real business impact. Develop, maintain, and More ❯

the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and … and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all. Overview The Data Security Team team is looking for a Senior Information Security Engineer to drive several key initiatives associated with data protection and related cutting edge technology. The ideal … to: o Relational Databases such as SQL Server, Oracle DB, IBM DB o Non-Relational Databases such as MongoDB, Redis o Data Warehouse and Data Lake tools such as Snowflake, Hadoop o File servers, NAS, Isilon, Cloud Drives • Ability to work collaboratively with key stakeholders (Data & Analytics group, Data Strategy & Management More ❯

Join Barclays as a Digital Customer Data Engineer, where you'll be leading the development for a new shared data platform that is transforming how individuals/organisations interact with the bank. Your role involves using the latest data and AI engineering skills to deliver a digital capability. As part of our team, you … ll also benefit from being part of a vast professional network, collaborating with industry mentors and experts. To be successful you should have experience with: Modern data engineering practices, inc. event-driven and data lake. Digital platform development, inc. experience developing colleague and customer facing applications. Banking software development. Deep technical awareness of cloud and data technology, such as Kafka, Data Bricks, microservices, API. Some other highly valued skills may include: Technical design: Analysis and documentation of system characteristics, inc. designing solutions to meet multi-faceted non-functional requirements. Communication Skills: Ability to clearly convey project goals to senior leadership, updates, and technical details to stakeholders at all levels, including non-technical More ❯

Senior Data Engineer Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest … of science and software. What youll be doing: Following a successful product launch and securing Series A funding, theyre scaling fast and now looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the … design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through More ❯

Data Architect (Databricks SME) Location - Derby (1/2 days a month) Type - Contract (End of the year - likely to extend) Role Overview: I'm looking for a Databricks Specialist with strong experience in the Azure ecosystem to help design, build, and optimise a scalable data platform. This role combines hands-on development with architecture, governance … high-performing and secure environment. The role reports to a project delivery lead and works closely with internal technical teams. Key Responsibilities: Design and implement Databricks Lakehouse architecture (Delta Lake, Unity Catalog, etc.) Develop ETL/ELT pipelines using Spark, Python, SQL, and Databricks workflows Integrate with Azure services and BI tools (e.g., Power BI) Optimise performance and support … CI/CD and MLOps pipelines Enable knowledge transfer through code reviews, training, and reusable templates Key Skill s: In-depth experience with Databricks (Delta Lake, Unity Catalog, Lakehouse architecture). Strong knowledge of Azure services (e.g. Data Lake, Data Factory, Synapse). Solid hands-on skills in Spark, Python, PySpark, and SQL. Understanding More ❯

Simpson Associates transforms raw data into actionable insights that drive positive change. Our Microsoft data expertise, our specialist sector knowledge, plus our innovative and trusted advice and guidance are just some of the reasons clients choose to work with us. Our mission is to help purpose-led organisations from within the public and private sectors to … harness data as a lever for change and enable them to realise business value more quickly. We provide the full range of services to support organisations on their data transformation journey. From advisory support and data strategy, to developing Data & AI solutions, right through to providing a range of managed services. We … key data science models and how they relate to achieving business benefits. Advantageous Qualifications and Skills Microsoft Azure expertise including the use of DevOps, Data Lake, Azure Functions, Power BI. Experience in project delivery and consultancy. Prince 2 Agile or similar. Experience in Blue Light, NHS, Local Government or Social Housing sectors. Experience with MLOps More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

Data Architect Location: Hybrid - London (2-3 days onsite) Type: Permanent Industry: Data Consultancy Salary: Competitive + Benefits The Opportunity Our client, a growing data consultancy with deep expertise in the Microsoft Azure ecosystem, is looking for a Data Architect to join their high-performing team. This role is both strategic and … hands-on, focused on designing modern, scalable, and secure data platforms for enterprise clients. You'll play a key role in shaping data architecture across the full Azure stack- including Azure Databricks and Azure Data Factory (ADF) -and will guide engineering teams in delivering robust, future-proof solutions using … lakehouse and medallion architecture principles . Key Responsibilities Design end-to-end data architectures using Azure services, including Azure Databricks, ADF, Synapse Analytics , and Data Lake Storage Define scalable data models and implement architectural patterns such as lakehouse and medallion Lead technical solution design during client engagements, from discovery to delivery Establish and More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools.* Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment.* Monitor production ML systems for performance, data … performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure data quality and readiness for ML modelling and analytics workflows. 4. Software Engineering & Collaboration * Write clean, maintainable, and More ❯

Data Engineer- Outside Ir35 - £500 daily rate- Manchester - 6 Month Role Overview: We're seeking an experienced Contract Data Engineer with a strong background in Databricks and cloud data platforms to support a high-impact data transformation programme. This hybrid role requires 2 days per week onsite in our Manchester office (non … negotiable) , with the remainder remote. You'll join a fast-paced, delivery-focused data team responsible for building and optimising scalable, production-grade data pipelines and infrastructure. Key Responsibilities: Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark Ingest, transform, and manage large volumes of data from diverse sources … based projects Strong hands-on skills with Databricks , Apache Spark , and Python or Scala Proficient in SQL and working with large-scale data environments Experience with Delta Lake , Azure Data Lake , or similar technologies Familiarity with version control, CI/CD, and infrastructure-as-code tools Ability to deliver independently in a contractor capacity More ❯