126 to 150 of 152 Data Lake Jobs in the UK excluding London

Contract Data Engineer - Global Bank Location: Hybrid (London or Edinburgh preferred)?? Duration: 6-12 months? Day Rate: Competitive via Umbrella A leading global bank is seeking a skilled Data Engineer to join its next-generation data and AI transformation programme. This contract role offers the chance to work on high-impact initiatives, including powering … intelligent chatbots and AI-driven analytics across the organisation. Key Responsibilities: Design, build, and maintain scalable ETL data pipelines to support AI, chatbot, and analytics use cases. Collaborate with data scientists, ML engineers, and product teams to deliver clean, reliable data for model training and real-time inference. Enable chatbot platforms by integrating structured … and unstructured data sources for conversational AI applications. Develop and maintain Tableau dashboards to support data storytelling and operational insights. Optimise data workflows across cloud and on-prem environments, ensuring performance and reliability. Skills & Experience: Strong experience in ETL pipeline development using tools like Apache Airflow, Informatica, or similar. Advanced SQL skills and experience More ❯

Head of Data Engineering - Azure & Databricks - Hybrid - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a real impact. This is a hybrid role, requiring two days per week in the office, with flexibility around location. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. What's on Offer: Competitive salary up to £100,000. Hybrid working More ❯

get the chance to work with likeminded people on an innovative project. You'll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you'll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: No up-to-date CV required. More ❯

next level in the exciting world of finance? Our client, a leading organisation in the financial sector, is seeking a talented Microsoft SQL DBA to join their dynamic Data Services team. This is an incredible opportunity to make a significant impact on data environments, drive transformation, and innovate within a supportive and flexible work culture! Position … Salary: £45,000 - £52,000Working Pattern: Full TimeLocation: Leicester/Hybrid Working Available Job Purpose: You will be at the heart of maintaining and evolving my client's data environments, both traditional MS SQL Server and cutting-edge Azure Data Services. You'll manage system security, support data delivery projects, and engage in transformative … initiatives that shape the future of data. Key Responsibilities: Oversee daily management and maintenance of data systems. Ensure robust data system security and patching. Support the team in producing Data and ETL services. Conduct data analysis, design, and remediation activities. Engage in transformation activities and champion change agendas. Identify and propose enhancements More ❯

skills in Python , SQL , and optionally Java/Scala Hands-on experience with Palantir Foundry tools , including: Code Repositories, Pipeline Builder, Code Workbook Ontology Management, Contour, Solution Designer, Data Lineage Data Health, Data Connections, Egress Policies Experience in end-to-end solution development , from planning to scaling Strong understanding of data architecture … including data lakes, warehousing, schema design, and performance optimization Excellent communication and stakeholder management skills Ability to work in fast-paced, ambiguous environments and learn new tools quickly Package for the Palantir Forward Deployed Engineer, Palantir FDE Paying up to £1300 per day More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

Location: Leicester | Hybrid Working Available Type: Permanent Salary: £45 - 52k + Benefits Overview A forward-thinking organisation is looking for a skilled SQL Database Administrator to join its Data Services team. This is a hands-on role focused on maintaining, securing, and optimising both on-premise and cloud-based data environments. You'll be working with … a modern tech stack, contributing to transformation projects, and helping shape the future of data infrastructure. The Role You'll be responsible for the day-to-day management of SQL Server and Azure-based data systems, supporting ETL processes, and driving improvements across data platforms. This is a great opportunity for someone who enjoys … solving problems, improving systems, and working collaboratively across teams. Key Responsibilities Maintain and manage SQL Server and Azure data environments Ensure data system security, patching, and performance tuning Support ETL services and data operations Analyse and remediate legacy data structures Contribute to transformation and change initiatives Identify opportunities to improve data More ❯

and ideally paying around 80k (may be room for flexibility). You will design, develop, and manage Power BI datasets, reports, and dashboards, build high-performance, user-friendly data models and translate business needs into comprehensive technical specifications for BI solutions. … Experience required; Experience in reporting, data analytics, business intelligence. Advanced proficiency in Power BI including DAX, Power Query (M), and dataflows. Experience with Azure Data Lake, Azure Synapse Analytics, or SQL Server Interviews can be arranged immediately with an ideal view of getting started in November. If you are available or becoming so, please apply … are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: roberthalf.com/gb/en/privacy-notice. More ❯

world-class solutions from our base in the heart of Newcastle City Centre. If you thrive in a fast-paced, intellectually stimulating environment and are passionate about technology, data, and solving complex problems, this could be the right opportunity for you. Our Culture As part of a new and growing business, you'll help shape our culture from … who enjoy solving complex technical challenges and driving improvement. About the DBA Team Our Database Administration team is responsible for maintaining the reliability, performance, and robustness of our data platforms. We're looking for someone who: Has a broad interest in technology and enjoys solving a wide range of technical issues. Takes pride in maintaining high productivity, reliability … with developers and business teams to improve SQL Server performance and usage. Work with cloud-based data technologies such as Azure SQL Server and Data Lake . Required Qualifications & Experience Minimum 2:1 degree in Computer Science or a related field, ideally from a Russell Group university . Minimum AAB at A-level (or equivalent More ❯

Your new company Step into a forward-thinking organisation at the forefront of digital transformation. With a newly launched Technology, Digital and Data strategy, this values-led public sector organisation is building a modern, event-driven cloud ecosystem from the ground up. The mission? To deliver seamless, secure, and scalable digital services that make a real difference in … mentoring colleagues and promoting best practices across the organisation. What you'll need to succeed Strong expertise in Microsoft Azure services (Functions, APIM, Event Hub, SQL, Data Lake) Solid understanding of CI/CD methodologies and automated deployment practices Proficiency in scripting (PowerShell or Python) Knowledge of cloud security and FinOps principles Familiarity with git and gitflow More ❯

Your new company Step into a forward-thinking organisation at the forefront of digital transformation. With a newly launched Technology, Digital and Data strategy, this values-led public sector organisation is building a modern, event-driven cloud ecosystem from the ground up. The mission? To deliver seamless, secure, and scalable digital services that make a real difference in … mentoring colleagues and promoting best practices across the organisation. What you'll need to succeed Strong expertise in Microsoft Azure services (Functions, APIM, Event Hub, SQL, Data Lake) Solid understanding of CI/CD methodologies and automated deployment practices Proficiency in scripting (PowerShell or Python) Knowledge of cloud security and FinOps principles Familiarity with git and gitflow More ❯

NoSQL database modelsExperience with CI/CD, Git, and configuration management tools Nice-to-haves include cloud/database certifications, experience in security & compliance audits , and exposure to data lakes or real-time analytics . What’s in it for you Salary in the region of £40,000 – £50,000 The chance to join a growing technology business More ❯

Tools Latest versions of .Net (up to version 8) Angular Azure Dev Ops for Pipeline management GIT Blazor MongoDB Microservice architecture Fully hosted in Azure including Service Fabric, WebApps, Datalake, Storage, EventHub, App Insights, DataBricks SignalR CI/CD Agile Principles Requirements Essential: Proven professional experience in software development. Experience working within a cross-functional delivery team Experience supporting software More ❯

Job Title: Airflow/AWS Data Engineer Location: Manchester Area (3 days per week in the office) Rate: Up to £400 per day inside IR35 Start Date: 03/11/2025 Contract Length: Until 31st December 2025 Job Type: Contract Company Introduction: An exciting opportunity has become available with one of our sector-leading financial services clients. … They are seeking a talented AWS DevOps/Data Engineer to join their growing data engineering function. This role will play a key part in designing, deploying, and maintaining modern cloud infrastructure and data pipelines, with a focus on Airflow, AWS, and data platform automation. Key Responsibilities: Deploy and manage cloud infrastructure … across Astronomer Airflow and AccelData environments. Facilitate integration between vendor products and core systems, including data lakes, storage, and compute services. Establish and enforce best practices for cloud security, scalability, and performance. Configure and maintain vendor product deployments, ensuring reliability and optimized performance. Ensure high availability and fault tolerance for Airflow clusters. Implement and manage monitoring, alerting, and More ❯

identity management. Experience with Copilot Studio and building custom Copilot agents or plugins. Familiarity with REST APIs, JSON, OAuth, and integration patterns with enterprise systems (e.g., CRM, ERP, data lakes). Understanding of prompt engineering, grounding techniques, and responsible AI principles. Soft Skills: Strong communication and stakeholder engagement skills, with the ability to explain complex technical concepts to More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

Define and socialise target state architectures across Azure/AWS/GCP (networking, identity, landing zones, operations). Deliver reference architectures and reusable patterns for containerised, serverless, and data workloads. Establish/extend Cloud Landing Zones (policy, guardrails, RBAC, tagging, network segmentation). Lead migration and modernisation (re‐host/re‐platform/re‐factor) for priority applications. … as applicable). Key Responsibilities Architecture & Design Produce HLDs/LLDs, diagrams, ADRs, non‐functional requirements, and traceability to business goals. Select and justify cloud services (compute, storage, data, AI/ML, integration). Define multi‐cloud connectivity (hub‐and‐spoke, transit gateways, ExpressRoute/Direct Connect/Cloud Interconnect, SD‐WAN). Design identity and access (Azure … guardrails (CIS benchmarks), cloud security posture management (Defender for Cloud, AWS Security Hub, GCP SCC). Vaulting and KMS (AWS KMS, Azure Key Vault, GCP KMS), key rotation, data classification & encryption. Threat modelling, zero trust patterns, vulnerability management, incident runbooks. Data & Integration Reference architectures for streaming/batch (Kafka/MSK, Event Hubs, Pub/Sub More ❯

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of 5 years of experience in solution architecture and design governance, ideally in financial … services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder More ❯

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of 5 years of experience in solution architecture and design governance, ideally in financial … services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be preferred. Experience with AWS Glue or AWS Athena would be advantageous. Confident stakeholder More ❯