76 to 100 of 112 Data Lake Jobs in England

Cleared Technical Architect – Data Platforms Truenorth are currently working with a leading technology consultancy on a Technical Architect (Data Platforms) opportunity, supporting the design and evolution of large-scale, cloud-based data platforms across a range of high-impact programmes. This role is ideal … time). Proficiency in Infrastructure as Code (Terraform). Experience with GitHub-based workflows and CI/CD pipelines. Experience with data lake and lakehouse architectures. Strong understanding of: Data ingestion patterns Data transformation and curation layers Data access and productisation ...

summary We are seeking to recruit a Senior Data Scientist - Analytics Lead to help shape the future of data-driven decision-making across our organisation. This is an exciting opportunity for someone who wants to use advanced analytics, machine learning and AI to make a real … operational and strategic challenges. Drive innovation in our analytical tools and processes, helping us make the most of our EPR, Azure Data Lake, and emerging machine-learning technologies. Champion high-quality analysis by ensuring our work is accurate, accessible and impactful, and by helping create a culture ...

Role – Azure Data Engineer Technology – MS Fabric, Azure, PowerBI Location – Leeds, UK Job Description Today, the corporate landscape is dynamic, and the world ahead is full of possibilities! None of the amazing things we do at Infosys would be possible without an equally amazing culture, the environment where … high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 ...

companies globally – with offices in New York, London, Madrid and Singapore. We are at an early and exciting stage of embedding AI and data capabilities across the firm. This hire is central to that effort. The Role: We are looking for a commercially minded AI and data … into the business in a practical, considered way Data Infrastructure and Reporting Help maintain and extend our Snowflake-based data lake, supporting data quality and accessibility across the business Build and maintain Power BI dashboards and reports that drive commercial decision-making across ...

Cleared Technical Architect – Data Platforms Please note this role is based in either London or Manchester and you must have Active - or very recently lapsed - SC Clearance to be considered for this role. We are currently working with a leading technology consultancy on a Technical Architect (Data … time). Proficiency in Infrastructure as Code (Terraform). Experience with GitHub-based workflows and CI/CD pipelines. Experience with data lake and lakehouse architectures. Strong understanding of: Data ingestion patterns Data transformation and curation layers Data access and productisation ...

Head of Platform Services Role Purpose Lead the data platform services function within Data Operations, accountable for the reliability, stability, performance, evolution and cost-efficiency of core Big Data services including Hadoop, Kubernetes, S3-based storage. Provide technical leadership on platform standards, security hardening … build and run services safely and at pace. Key Accountabilities Provide strategic leadership for Big Data platform capabilities (e.g., data lake, analytics enablement, data tooling). Provide automation through standard onboarding patterns, governed data access, and optimised workload performance and capacity ...

engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory … Services and Databricks in enterprise environments. Proven delivery experience within the Lloyd's of London or London Market insurance sector Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns and data modelling. Strong Python, PySpark and Spark SQL capability Solid understanding of data governance Proven ...

Entry-level Data & AI Consultant role for individuals looking to build a career in data engineering and AI. You will work on real client projects, supporting the design and delivery of data pipelines, models, dashboards, and AI-driven solutions. This is not a passive … Support development of Power BI dashboards Assist in AI use cases (automation, simple models, insights) Work within Azure-based environments (Databricks, Data Lake, etc.) Test, validate, and document solutions Training Possible promotion within the organisation Moving onto a higher level apprenticeship Apprenticeship Standard Data technician ...

Principal Data Engineer Location: Remote Salary: Up to £95,000 Sponsorship: Not available VIQU have partnered with a nationally recognised organisation that has recently completed a full migration from on-premise infrastructure to Google Cloud Platform (GCP) and is now building a modern, domain-oriented Data … essential) Strong SQL and Python expertise Experience building cloud-native data platforms end-to-end Strong background in Data Lake/Warehouse architecture Proven experience implementing CI/CD and infrastructure as code Confidence to challenge stakeholders and influence technical direction Candidates without strong, proven ...

Senior AWS Data Engineer - SC Cleared Rate: Up to £475 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically a couple of days per month) in Telford or Hove Security Clearance: Active SC Clearance required Role … Overview We are seeking an experienced Senior AWS Data Engineer to support a large-scale central government data transformation programme . The role sits within a major data delivery area that provides data and analytics solutions aligned to critical business priorities, including ...

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients … senior, hands-on Data Engineer role. As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose ...

Senior ML/MLOps Engineer (MLflow) | Databricks | Azure) About Optima Partners We’re an advanced data & business consultancy helping major consumer brands transform through data-driven customer strategy, design, and engineering. Our clients include leading UK and global brands across financial services, retail, and more. Join … workflows Build scalable data & ML pipelines in Databricks (Delta, DLT, Jobs) Design and maintain Azure data architectures (Data Lake, Synapse, SQL DW) Create robust CI/CD pipelines for ML + data using Azure DevOps, Git, Jenkins Automate infrastructure with Terraform ...

candidate will be part of the team transforming from a traditional SQL team to a modern hybrid cloud platform bringing together the best data, analytical and reporting tools to deliver new and enhance existing products and support our users. You will work with Finance, Product, Warehouse, Marketing … skills. Essential Skills DataBricks or similar and Azure Data Factory Languages: SQL, Python Data Platform: Azure data lake and SQL Server RDBMS ETL: SQL Server Integration Services and ADF Experienced in effectively working in a collaborative manner in a large, fast paced environment ...

Senior Data Engineer | Manchester (Hybrid) | Digital Transformation Consultancy Location : Manchester (Hybrid - 3 days a week) Package : £55k-£70k + Benefits Python | Cloud (AWS/Azure/GCP) | Kafka | Airflow | PostgreSQL | Observability This client builds mission‐critical digital platforms that make the UK smarter, safer, greener and healthier. They … growing digital transformation consultancy delivering enterprise‐scale data services across public and regulated sectors — civil defence, healthcare, environment and land asset management. This is a hands‐on Senior Data Engineer role where you’ll design, build and operate resilient data platforms and pipelines ...

Contract AI & Data/Jr Forward Deployed Engineer | Up to £500.00 Outside IR35 | 3 months (rolling) | Hybrid Monthly (UK) A fast-growing UK-based FinTech scale-up is looking for 2x Contract AI & Data Engineers to join their financial analytics platform team. Haven't held … PyTorch) Background in data engineering, analytics engineering, or similar Desirables: ETL/ELT pipeline experience Microsoft Fabric/Data Lake knowledge BI tools (e.g. Power BI, Tableau) Financial services or payments experience On Offer: £500.00 per day Outside IR35 3-month contract (rolling) Hybrid monthly ...

Data Engineer – Azure - Databricks/Fabric - Remote – up to £65,000 I’m currently supporting one of the UK's fastest-growing Microsoft data consultancies as they continue to scale their team. If you're a Data Engineer who wants to work on modern … this could be a great fit. What You’ll Be Doing In this role, you’ll be central to designing and delivering modern data solutions for a range of clients: Architect and deliver scalable data solutions using Databricks, Synapse, and Microsoft Fabric Build and optimise ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high quality services … reliable data products at scale. You ll work closely with cross functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands on role suited to someone who enjoys ownership, technical depth, and influencing ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high‑quality services … reliable data products at scale. You’ll work closely with cross‑functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands‑on role suited to someone who enjoys ownership, technical depth, and influencing ...

Data & Insights Manager £60,000 – £65,000 Hybrid - Bridgwater, Somerset 3 days/week This is a rare opportunity to step into a leadership role at the intersection of data strategy and real-world impact. You’ll shape how an organisation thinks, decides, and grows - turning … complex data into clear direction for executive and board-level stakeholders. Reporting into the Head of IT, you’ll lead the Data & Insights function - owning the strategy, the team, and the output. You’ll partner closely with Finance, Operations, Marketing, HR, and the Executive Leadership Team ...

love making systems work brilliantly for the people who use them, this is your kind of role. As a Systems & Data Analyst, youll help our teams get the right information at the right time, support them in using our systems confidently, and champion improvements that make everyday tasks … easier and smarter. Youll be hands-on with everything from system configuration to data reporting, all while helping us build a stronger, more connected digital foundation for the future. Here's what Manager Jane has to say about why she thinks this is a great role ...

full remote working for the right SC-cleared lead. About Our Client A major technology delivery partner running complex, multi-workstream cloud and data programmes for secure UK clients in regulated and government-adjacent sectors. Established track record on Azure-led modernisation at national scale, with a mature … Lead Architect Active UK Security Clearance (SC or higher) - this is a hard requirement and non-negotiable. Expert-level Azure across Data Lake, Synapse, Databricks, Key Vault, DevOps and Networking, with strong experience orchestrating large-scale data processing. Proven track record leading multi-workstream technical ...

grow across the Defence sector. We are looking for a motivated, curious, and technically minded Full Stack Engineer to help us scale our data and analytics capabilities across the UK and international markets. In this role, you will contribute to the design, development and maintenance of the data … sustainable development. As a Full Stack Engineer, you will: • Design, develop, automatically test and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. • Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). • Develop ...

deterministic and observable decision pipelines Architect integrations with external risk/compliance vendors such as: LexisNexis Ekata AML engines Sanctions screening services Define: Data mapping strategies Orchestration patterns Fallback and resilience patterns Reduce lock-in while preserving regulatory robustness Design cloud-native, horizontally scalable risk services … event-based data persistence strategies Support: Batch AML monitoring Regulatory reporting Merchants Transactions Case management Ensure compatibility with enterprise data lake and analytics platforms Act as trusted adviser to Risk leadership Influence roadmap prioritization and capability sequencing Mentor engineers and domain architects Drive architecture standards ...

financial markets environment. This role combines hands-on development with ownership of critical systems, supporting core operations while contributing to a broader data platform transformation. What you’ll be doing: Supporting and enhancing existing back-office trading applications Designing and building backend solutions … C#/.NET Working closely with stakeholders across trading, risk, and operations Contributing to data platform initiatives (Azure Data Lake/Databricks) Maintaining and improving performance of production systems What we’re looking for: 5–10 years’ experience as a C#/.NET Engineer (backend ...

tech defence client are looking for a motivated, curious and technically minded Full Stack Engineer to help us scale data and analytics capabilities across the UK and international markets. In this role, you will contribute to the design, development and maintenance of the data pipelines, platforms … sustainable development. As a Full Stack Engineer, you will: • Design, develop, automatically test and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. • Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). • Develop ...