26 to 50 of 142 Data Lake Jobs in the UK excluding London

relatively low maturity Azure environment. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint … Design, build and maintain data migration and ingestion pipelines within Azure. Support the setup and development of the Azure Data Lake environment. Build integrations between source systems, Azure Data Lake and Databricks. Develop and manage pipelines using Azure Data Factory ...

Enterprise Data Architect Department: CSG - Operations Hub (Data/Intelligence/Support) Employment Type: Permanent Location: Birmingham Description We are seeking an experienced Enterprise Data Architect to define and lead the organisation's target-state data architecture, ensuring our data … landscape supports business growth, operational excellence, regulatory compliance, and future AI-driven innovation. This is a strategic role at the heart of our data transformation journey. You will be responsible for designing the frameworks, standards, and technology architecture that connect core business systems across case management, finance ...

create, innovate, and help transform airport travel. Together, we can reach new heights. Together, we are Cavu. About The Role The Lead Data Engineer is responsible for overseeing the architecture, development, implementation, and maintenance of our data infrastructure, ensuring its efficiency, reliability and compliance with relevant … regulations. Supporting an existing team of data scientists, BI developers and analysts, this role will help provide the glue that empowers the business to capitalise on the wide range of data assets and drive value from the insight we extract. We develop advanced and actionable data ...

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

Responsibilities Design, deliver, and support Data, AI, and automation solutions, including analytics, models, dashboards, and related platforms. Own the roadmap for trusted data foundations across BIS and divisions, covering master/reference data, data quality, governance, cataloguing, traceability, and access controls. Provide … data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this ...

Data Engineer - Belfast £45,000 to 60,000 GBP Hybrid WORKING Location: Belfast, Northern Ireland - United Kingdom Type: Permanent Data Engineer Location: Belfast Salary: Up to £60,000 Department: Data & Analytics We are looking for an experienced Data Engineer to join … growing Data & Analytics function in Belfast. This is a hands-on role focused on building and maintaining reliable data pipelines, supporting data migration and developing the underlying data infrastructure that enables high-quality reporting and analytics. The ideal candidate will have around ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … pipelines using Azure Data Factory, Synapse, Fabric Pipelines, or Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising ...

maintenance of data warehouses, ensuring efficient storage and retrieval. Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data. Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions. Implement data governance practices within the data warehouse and data lake environments. General Participate in cross-functional teams to provide insights and recommendations for data-related initiatives. Participate in training and development opportunities to enhance technical skills and domain knowledge. Demonstration of safe ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporarybasis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data lakes, and integration solutions. Define and maintain data standards, frameworks, and best practices. Ensure the organisation's data architecture aligns with strategic business objectives. Lead data migration and transformation initiatives. Leadership & Management Provide technical leadership and mentoring to Data Engineers ...

real business value. You'll play a key role in expanding our Microsoft Fabric capability, supporting the evolution of our enterprise data lake, and helping prepare EWR for the next generation of AI-powered decision making. What you’ll be doing Working closely with our Azure Data … Create engaging and insightful Power BI dashboards that support operational and strategic decision making. Help develop and mature EWR's enterprise data lake, ensuring data is governed, accessible and AI-ready. Support the development of Fabric Data Agents , Microsoft Foundry solutions ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

realized as secure and robust solutions. Apply AI tools and techniques to improve Solution Architecture practices — including accelerating requirements analysis, pattern identification, data modeling, and architecture documentation. Ensure full conformance with firm-wide, CIB, and sub-Line of Business (sub-LOB) architecture patterns and standards, participating in architecture … Persistence, Data Streaming, Data Quality and Metadata Management. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Demonstrated ...

realized as secure and robust solutions. Apply AI tools and techniques to improve Solution Architecture practices - including accelerating requirements analysis, pattern identification, data modeling, and architecture documentation. Ensure full conformance with firm-wide, CIB, and sub-Line of Business (sub-LOB) architecture patterns and standards, participating in architecture … Persistence, Data Streaming, Data Quality and Metadata Management. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Demonstrated ...

market infrastructure. Our purpose is to provide clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data, through responsible and innovative solutions. Through our people and technology, we connect clients to superior liquidity and data solutions. The Group … role will also work on other Surveillance data initiatives such as persisting Surveillance Alerts in the firm’s data lake for analytics purposes. Role Responsibilities Design, build, maintain and optimise end-to-end data pipelines and workflows between the source data ...

client is a geospatial and data technology company. Join the Growth Story at our client Our client operates at the heart of the UKs most sensitive and high-profile operations. Our approach is entirely mission-focused, enabling customers to see more, decide faster, and act with confidence across … cloud-native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/CD delivery practices Understanding of data lake, data warehouse and modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience ...

client is currently recruiting for a Senior Data Engineer to join their team. The Senior Data Engineer will be responsible for designing, developing, and maintaining both legacy and modern cloud-based data platforms and pipelines that enable efficient data collection, processing … maintain timely data availability Contribute to the design, build, and optimisation of data architectures, models, warehouses, and data lake solutions that support reporting, analytics, and AI initiatives. Ensure solutions meet performance, scalability, and reliability standards across legacy and modern cloud platforms. Monitor ...

Project Data Architect Salary: Up to £80,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 05/11/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we'd love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC …/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME ...

driven by continuous improvement with a focus on great results for our customers. About the role We are looking for an experienced Data Engineer to join our Applications and DevOps team based at our Head Office on the Gateshead Quayside. As a Data Engineer … services. Experience building and maintaining data pipelines, lakehouses, and data transformations using Microsoft Fabric, Azure Data Lake, Azure Synapse, or related Azure services. Knowledge of CI/CD pipelines, version control, and DevOps practices related to data engineering. Proficiency ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...