1 to 25 of 171 Data Lake Jobs in the UK

PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer, Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data Warehouse, Azure Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI … Data Engineer, Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data Warehouse, Azure Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer, Azure fundamentals, Fabric ...

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data warehouse ...

using Azure Data Factory and related services Develop data solutions using Azure Synapse Analytics, Azure SQL, and Data Lake Implement data modelling solutions for analytics and reporting Ensure data quality, reliability, and performance across data systems Collaborate … Data Engineer in an Azure environment Hands-on expertise with: Azure Data Factory Azure Synapse Analytics Azure Data Lake (Gen2) Azure SQL/SQL Server Advanced SQL skills Experience with Python or Scala for data processing Solid understanding of data ...

pipelines and data integration workflows using Microsoft Azure services such as Data Factory, Synapse Analytics, Data Lake, Databricks, and related technologies. Implement and support Microsoft Fabric solutions, including dataflows, data warehouses, and real-time analytics features. Develop and maintain … EXPECTATIONS IN THE ROLE Strong hands-on experience with Microsoft Azure data services (Data Factory, Synapse Analytics, Data Lake, Databricks). Direct experience delivering solutions using Microsoft Fabric. Advanced SQL skills and experience with data modelling, transformation, and integration. Familiarity with ...

Business Data Analyst with Data Quality & MDM experience Contract: initial contract until June 2026 IR35 Status: Inside IR35 Location: Remote with travel to the office every 6 - 8 weeks We are seeking an experienced Business Data Analyst with Data Quality …/or SAP MDG is highly desirable, OR similar enterprise data tools Exposure to data lake technologies (Azure Datalake), ETL, Databricks, PowerBI Exceptional documentation and stakeholder communication skills Detail-oriented with a focus on accuracy and compliance Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree ...

Edinburgh/Hybrid Were looking for a TechnicalBusiness Analysts to join a forward-thinking team working alongside cross-functional software and data engineers. You will help define the roadmap for implementing our clients data strategy, taking in streams from across their product suite and beyond Main … integrations and databases) Have hands-on experience in projects relating to data solutions (data delivery/management, data lake, system integration, data migration, data warehousing experience with cloud-based data platforms) Data Modelling (e.g. ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies (event hub). Version control (Git), Agile Delivery, and DevOps ...

Data Officer - Financial Services (London) Permanent | Full Time | Hybrid (2-3 days in office) Senior Manager or Manager level (depending on experience) An established international financial institution is seeking a Data Officer to join its London operation. This newly created role sits within the Risk function … with close collaboration across Technology, Operations and front-office business areas. It offers the opportunity to shape and lead the firm's data governance strategy during a period of organisational growth. The Role The Data Officer will be responsible for developing, embedding and overseeing the organisation ...

Morgan Hunt are working with a housing association in London to recruit an Azure Data Engineer on a permanent basis. The purpose of the role is to lead the implementation of data flows to connect operational systems, data for analytics and BI systems. … data technologies Evaluate and improved existing data processes Essential Experiences: Advanced SQL skills Proficient in Databricks, including Spark, Delta Lake and MLflow Experience migrating SSIS to Databricks In depth understanding of ETL/ELT processes Knowledge of data warehousing concepts and architectures Able ...

Junior Data Governance Analyst Bristol (Hybrid) Salary - £30,000 to £35,000 + Bonus, Health, 25 days holiday, 10% PensionAre you early in your data career and interested in Data Governance , but don’t want a heavily technical or coding-focused role This … curiosity, and willingness to learn Desirable (but not required): Exposure to tools such as Azure Data Factory, Azure SQL, Data Lake, Purview, or Power BI Understanding of GDPR or data protection principles Degree or background in data, IT, information management ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

Data Engineer £53,000 per annum Bedford Permanent Hybrid Working Role Overview Join us at the Money and Pensions Service (MaPS) as a Data Engineer where you will design and implement data pipelines to connect operational systems, engineering data for analytics … profiles and establish recovery processes to maintain data integrity. Azure Services • Utilise Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer.• Ensure the scalability and reliability ...

Role: Data Architect Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Rate: £550 - £650 per day Security Clearance: Active SC Clearance required Project Description We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise-scale … roles High proficiency in SQL and database technologies (e.g. Oracle, SQL Server, PostgreSQL, MySQL) Strong knowledge of data warehouse, data lake, and lakehouse architectures Experience with ETL/ELT frameworks and orchestration tools (e.g. Informatica, Talend, Apache Airflow) Proven experience establishing and maintaining data ...

Data Architect | Hybrid | RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

Anson McCade is delighted to partner with a leading digital transformation consultancy as they seek to appoint a Lead Data Architect to their talented team in the United Kingdom. The Data Architect will play a pivotal role in shaping and delivering high-quality data solutions. Acting as a subject matter expert, they will bring deep expertise in core data architecture disciplines, including data structures, data flows, data sourcing, and data governance. Working in close partnership with clients, they will analyse business ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

Head of Data Salary: Up to £120,000 + Bonus I am working with a forward-thinking organisation that is modernising its data capabilities to enable scalable analytics, reporting and data-driven decision-making across the Group. They are looking for a Head … , Data Director, or similar). Strong understanding of modern data platforms and architecture, including Azure Data Lake Storage, Azure SQL Data Warehouse, or Azure Databricks. Expertise in data governance, compliance, and security best practices. Knowledge of analytics ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

tomorrow’s public sector skill demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span across architecture, project management … scalable ETL/ELT pipelines using modern tools and frameworks. Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, ADF). Data Governance: Understanding of GDPR, PII, and secure data management principles. Communication: Strong data storytelling skills ...

Data Architect (SC Cleared) Location: Edinburgh or Newcastle preferred Other locations considered: Luton, Bristol, Southampton (Hybrid – predominantly onsite ) Contract: 6 months initially (potential to extend) Rate: Up to £69.44 per hour umbrella ( rate may be negotiable ) Clearance: Active SC clearance required Nationality: UK Eyes Only – sole British nationality … required The Opportunity We are seeking an experienced Data Architect to support a high-profile, security-critical programme within a UK government/defence environment. This role focuses on the design, implementation and governance of enterprise-level data architectures , ensuring data is accurate, secure ...

modern, scalable data platform. You'll lead the migration away from legacy reporting tools and help deliver a unified data lake/data warehouse. The role offers real ownership, exposure across the business, and the chance to shape how data … Engineer to support a major phase of data modernisation. THE ROLE: Design, develop, and maintain a centralised data lake/data warehouse Integrate multiple internal systems and data sources into a single, consistent data model Lead ...

Senior Data Engineer – Azure ** 5 days a week onsite - Central London ** £70,000 - £80,000 per annum About the Role One of the UK’s leading insurers are looking for a Senior Data Engineer with a primary focus on Azure to lead the design and implementation … Hands-on experience with Azure services, including: Data Factory, Logic Apps, Azure Functions, Azure Synapse and/or Azure Data Lake Strong experience with Power BI, including data modelling and dashboard development Experience working with OpenAI APIs or similar AI/ML services ...