51 to 75 of 280 Data Lake Jobs in the UK excluding London

maintenance of data warehouses, ensuring efficient storage and retrieval. Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data. Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions. Implement data governance practices within the data warehouse and data lake environments. General Participate in cross-functional teams to provide insights and recommendations for data-related initiatives. Participate in training and development opportunities to enhance technical skills and domain knowledge. Demonstration of safe ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporarybasis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data lakes, and integration solutions. Define and maintain data standards, frameworks, and best practices. Ensure the organisation's data architecture aligns with strategic business objectives. Lead data migration and transformation initiatives. Leadership & Management Provide technical leadership and mentoring to Data Engineers ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Data Engineering Lead role in Milton Keynes Salary range: £75,000 - £85,000 per annum Lead and develop a team of data engineers Requirement for substantial experience in data engineering At The Institute of Chartered Accountants England & Wales (ICAEW), you'll be part … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands‐on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

tomorrow’s public sector skills demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span architecture, project management, data … scalable ETL/ELT pipelines using modern tools and frameworks. Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, ADF). Data Governance: Understanding of GDPR, PII, and secure data management principles. Communication: Strong data storytelling skills ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

seeking an experienced Enterprise Data Architect to define and lead the organisation's target-state data architecture, ensuring our data landscape supports business growth, operational excellence, regulatory compliance, and future AI-driven innovation.This is a strategic role at the heart of our data … management, finance, CRM, analytics, and AI platforms. Working closely with senior technology and business leaders, you will help shape a scalable and sustainable data ecosystem that reduces integration complexity, improves data accessibility, and enables advanced analytics and predictive capabilities.What you will do As our Enterprise Data ...

all. We make it, store it, move it, sell it, and mend it. Join a team at the heart of Centrica's data transformation journey, building the data products and platforms that power insight, customer experiences and business decision-making across the organisation. As a Data Engineer, you will design and develop scalable data solutions that underpin strategic assets such as Centrica's Single Customer View and Property View, enabling trusted, governed and accessible data for analytics, operational processes, customer engagement, AI and digital use cases across the business. ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

Type: Permanent Location: United Kingdom Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Data Engineer We have an exciting role for you Data Engineer ! Careers at TCS: It means more TCS is a purpose-led transformation company … maintain Azure-based data pipelines and ETL solutions. Work with Azure Data Factory, Databricks, Synapse, and Data Lake to support data integration, migration, and analytics requirements. Collaborate with stakeholders to understand business needs, troubleshoot data issues, and ensure secure ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineering Lead to join our team in Milton Keynes on a permanent basis. This role offers a salary of £75,000 - £85,000 per annum … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

Blood and Transplant (NHSBT) is a unique organisation that works to save and improve lives every day. Are you a skilled data engineering professional who thrives on transforming complex data into powerful insights that support vital services? This is an exciting opportunity to join NHS Blood … Server Tools. Experience with MS Azure technologies such as Azure Data Factory, Synapse Analytics, Databricks, Azure SQL, Azure Data Lake Storage etc. Knowledge of data modelling, architectural principles and big data tools. Experience in diagnosing and troubleshooting complex data ...

realized as secure and robust solutions. Apply AI tools and techniques to improve Solution Architecture practices - including accelerating requirements analysis, pattern identification, data modeling, and architecture documentation. Ensure full conformance with firm-wide, CIB, and sub-Line of Business (sub-LOB) architecture patterns and standards, participating in architecture … Persistence, Data Streaming, Data Quality and Metadata Management. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Demonstrated ...

opportunity to discuss your flexible working requirements during the interview process, and at offer stage. We’re reshaping our Digital, Technology and Data function for the future, creating new opportunities, strengthening our capability, and building clearer, more resilient ways of working so we can deliver even better services … with Power BI or Strategy Experience with working within the MS Azure Cloud data platform (Data Factory, Data Lake and Databricks) Strong SQL skills with experience of Microsoft SQL Server Management Studio or equivalent Experience working on data warehouse projects ...

Location-Basildon, UK -5 days from Office JD: Mandatory Skills : AWS Lambda, Datalake house Architecture, ETL Concepts Overview We are seeking a talented and experienced to join the Data Solutions domain in EMEA In this role you will design build Data Lakehouse Engineer and optimize scalable … flows and ELT/ETL patterns Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and Lakehouse layers Implement and uphold data governance security lineage and compliance best practices throughout the data lifecycle Monitor troubleshoot ...

market infrastructure. Our purpose is to provide clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data, through responsible and innovative solutions. Through our people and technology, we connect clients to superior liquidity and data solutions. The Group … role will also work on other Surveillance data initiatives such as persisting Surveillance Alerts in the firm’s data lake for analytics purposes. Role Responsibilities Design, build, maintain and optimise end-to-end data pipelines and workflows between the source data ...

Data Architect Salary: Up to £78,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 06/10/26 Shape Brighter Futures with Wesleyan Established … collaboration, innovation, and integrity,we’dlove to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

market infrastructure. Our purpose is to provide clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data, through responsible and innovative solutions. Through our people and technology, we connect clients to superior liquidity and data solutions. The Group … role will also work on other Surveillance data initiatives such as persisting Surveillance Alerts in the firm's data lake for analytics purposes. Role Responsibilities Design, build, maintain and optimise end-to-end data pipelines and workflows between the source data ...

market infrastructure. Our purpose is to provide clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data, through responsible and innovative solutions. Through our people and technology, we connect clients to superior liquidity and data solutions. The Group … role will also work on other Surveillance data initiatives such as persisting Surveillance Alerts in the firm's data lake for analytics purposes. Role Responsibilities Design, build, maintain and optimise end-to-end data pipelines and workflows between the source data ...

Data Architect Salary: Up to £78,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 06/10/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we’d love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

Data Architect/Lead Data Engineer - Databricks Worcester | Hybrid working £70,000 - £80,000 plus bonus and benefits Permanent We are recruiting for a newly created Data Architect position within an established technology-led organisation based in Worcester. This is a hands-on role … operating purely at a strategic level. Ideally, your experience will include several of the following: Strong commercial experience with Databricks Unity Catalog, notebooks, Delta Lake or Delta Live Tables Data lakehouse and medallion architecture Advanced data modelling, including relational, dimensional, Data Vault ...

client is currently recruiting for a Senior Data Engineer to join their team. The Senior Data Engineer will be responsible for designing, developing, and maintaining both legacy and modern cloud-based data platforms and pipelines that enable efficient data collection, processing … maintain timely data availability Contribute to the design, build, and optimisation of data architectures, models, warehouses, and data lake solutions that support reporting, analytics, and AI initiatives. Ensure solutions meet performance, scalability, and reliability standards across legacy and modern cloud platforms. Monitor ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … cloud-native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/CD delivery practices Understanding of data lake, data warehouse and modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience ...

pipelines using Azure DevOps or GitHub Actions. Working with Azure data services , including Data Factory, Storage/Data Lake and emerging AI services. Improving platform reliability, monitoring and observability. Troubleshooting infrastructure and platform issues. Working closely with engineers, architects and data …/CD tooling. Experience with Azure data services such as Data Factory and Azure Storage/Data Lake . Scripting experience with Python, PowerShell or Bash . A genuine interest in automation, self-service and DevOps . A relevant HashiCorp Terraform certification would ...