1 to 25 of 99 Permanent Data Lake Jobs in the UK

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data warehouse ...

strategy and standards Design and support data solutions using Azure-based services such as Data Factory and Data Lake Essential Skills & Experience Active SC (Security Check) clearance Strong experience in data modelling, including conceptual, logical, and physical data models … modelling tools Latest hands-on experience with Azure-based data services, including Data Factory and Data Lake Strong understanding of data classification, data security, and encryption principles Experience working in client-facing environments within complex programmes Experience ...

Mission is to be famous for excellence in delivery, embracing transformation with our people and our customers at its heart. The Head of Data & Analytics leads Cornerstone’s data strategy, governance, BI and reporting, and data infrastructure. The role exists to establish data … . Experience with data warehouse/lakehouse architecture and Azure data services (Data Factory, Synapse, Data Lake, SQL). Leadership of multi disciplinary data teams across governance, reporting and engineering. Executive level stakeholder engagement and communication skills. Budget management ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices Develop and optimise data lake and data warehouse architectures on AWS Ensure high standards of data quality, governance, security and accessibility across data ...

Business Transformation team, the Senior Data Engineer will take a lead role in developing and building our cloud architecture, data lake and warehousing, and data pipelines to support the organisation's service development and improvement. The role offers the opportunity to support innovation … hours urgent care services during an important time of change and development in NHS care, with a shift to more digitised, technological and data-driven services that support the delivery of excellent healthcare services. The role will work across BrisDoc and its clinical, operational and back-office services ...

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience Contract Type: Permanent We're looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data … robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data ...

more Chinese jobs please follow us on WeChat: teamchinapf AND pfteamchina Ref: 23377 The Skills You'll Need: Mandarin and English fluent, solid data management experiences within banking. Your New Salary: Competitive + Bonus + Benefits Fully office based Permanent Office based: London Start: ASAP Reports to: Head … report automation and process management tools Should be able to read and write SQL Should understand the architecture and concept of data lake and data warehouse related knowledge and design Must be proactive and analytical to evaluate and solve problems independently Must be able ...

IMMEDIATE JOINERS !! 💻 Junior Big Data Developer (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data … distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree ...

into the Bronze layer, working in partnership with the Development and Application Management team.Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. * Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing … ensuring compliance with industry standards. Deep expertise in data modelling - conceptual, logical and physical. Data warehousing and data lake architecture for high-performance analytics. ETL/ELT pipeline development and optimisation to support large-scale data processing. Data integration ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … platform ensuring reliable data across the organisation Extensive hands-on experience designing and delivering scalable, resilient cloud-based data lake platforms using modern lakehouse architectures Drive better data governance through the creation and embedding of principles and processes Build and maintain ...

reliability for operational and reporting systems. Modern Data Platform Development Contribute to the build and enhancement of a data lake/lakehouse architecture. Work with AWS tools such as S3, Glue and Lambda. Develop robust, scalable data pipelines. Prepare clean, structured datasets … visualisation tools (Tableau desirable). Strong analytical, problem-solving and communication skills. Knowledge of data warehousing and/or data lake concepts. Any Data DevOps experience (e.g., Terraform, GitHub) would be highly beneficial. Experience & Behaviours You'll bring experience in a similar data ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

Engineer Location: Birmingham - Hybrid- 3 days onsite/week Duration: 6 months contract Pay Rate: £375 per day through FCSA Umbrella Role Description: Data Ops Engineer will be assisting Senior Data Ops Engineer responsible for inspiring and assisting Data Engineering team in designing, developing … related programming skills SQL/Python/Spark/Scala. Database technologies in relation to Data Warehousing/Data Lake/Lake housing patterns and relevant experience when handling structured and non-structured data (Information Modeler) Experience in data ...

Join Our Team as a Data Engineer Location: Chesterfield, Derbyshire Are you an experienced Data Engineer with a strong background within Data Engineering, Design and Architecture looking for your next challenge? If so, we could have the perfect opportunity for you. This … Solid understanding of ETL/ELT processes and data integration techniques. Familiarity with the end-to-end Azure ecosystem (Data Lake, Synapse, etc.). Proficient in Python for data engineering tasks. Deep understanding of data governance, security, and compliance best practices. ...

architecture. This engagement will play a key role in shaping and governing data across core platforms including SAP, Azure Data Lake and Power BI, ensuring data is structured, secure and optimised for reporting and analytics. This is a strategic, design-led role, requiring … similar senior data role Strong expertise in data modelling, architecture and information design Experience working with Azure Data Lake or modern cloud data platforms Exposure to SAP or enterprise ERP data environments Experience supporting Power BI or similar reporting ...

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design … retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep) * Databricks - Delta Lake, Unity Catalog, job cluster vs interactive cluster trade ...

Data Engineer - West Yorkshire (Hybrid) Harvey Nash has partnered with a market-leading client of ours based in West Yorkshire to recruit an experienced Data Engineer . This role sits within the data team and will play a key part in designing, building … Azure SQL. Good understanding of data warehouse design , including star schema and dimensional modelling. Experience working with Azure Data Lake/Blob Storage and cloud-native data architectures. Strong proficiency in SQL , with experience designing and optimising data models and queries. ...

Data Engineer – Remote (occasional visits to Yorkshire) £55,000 - £60,000 + bonus, 35-hour work week and great benefits Joining a well-established and highly skilled Data team, an experienced Data Engineer is required to help design and develop modern cloud solutions. … that will benefit the department Requirements: 3+ years’ experience in data engineering and data warehousing. Amazon Redshift. Data Lake architectures (S3, lakehouse patterns). SQL and Power BI development experience. DAX/Data Modelling Familiarity with ELT/ETL tools. Knowledge ...

client is an international bank seeking a Data Management Officer to join its London-based IT function, supporting critical data governance and data security initiatives across the business. This is a hands-on role operating at the intersection of data, regulation … technology, working closely with Finance, Compliance, and broader business teams to embed robust data management practices across the organisation. Key Responsibilities * Support the implementation of group-wide data governance frameworks and standards * Assist in building and enhancing data quality frameworks, monitoring, and reporting mechanisms ...

Location: Hessle Salary: £50,000–£60,000 depending on experience Contract Type: Permanent We're looking for a Data Engineer with experience in Business Intelligence to join a forward-thinking organisation modernising its data ecosystem. This role is ideally suited to someone operating at a strong … level, looking to deepen their technical capability while gaining exposure to more advanced data engineering and architectural concepts. As a Data Engineer, you'll work with data from systems such as SAP, Salesforce and production environments, helping to ensure it is connected, structured ...

critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. ...