26 to 50 of 143 Data Lake Jobs

Data Architect The Data Architect will play a vital role in shaping and implementing data strategies within the financial services industry. Based in London, this permanent position offers an excellent opportunity to design and manage data architecture for a forward-thinking organisation. … Client Details Data Architect This organisation operates within the financial services industry and is recognised for its innovative approach to data driven solutions. As a mid-sized company, they focus on analytics and strive to deliver exceptional results to their clients and stakeholders. Description Data ...

Develop and optimise cloud data platforms using Azure Synapse Manage and enhance structured and unstructured datasets stored in Azure Data Lake Storage Write efficient, production-ready Python code to support automation, data ingestion and transformation Ensure high standards of data quality … Data Engineer within cloud-based environments Hands-on expertise with Azure Data Factory, Synapse and Azure Data Lake Storage Solid programming experience with Python Good understanding of data modelling, ETL patterns and modern data platform concepts Ability to document ...

HEAD OF ERP DATA (MAT COVER) LONDON/HYBRID UP TO £90,000 This is a rare opportunity to lead a data function through a major transformation at a global consumer brand. You will play a critical role in stabilising, shaping, and optimising their product … supply chain data ecosystem as they implement a new ERP platform and enhance their BI and data environment. ROLES AND RESPONSIBILITIES: The Head of ERP Data will: * Lead and develop a data team covering data engineering and master data. * Oversee ...

Role: Data Migration Specialist - Defence Sector Location: London (On-site) Start Date: ASAP Contract: Freelance Duration: 12 Months + A leading organisation within the defence sector is seeking a Data Migration & Data Synchronisation Specialist to support a large-scale data transformation initiative. … This role requires a contractor experienced in designing and delivering secure data migration frameworks across complex enterprise environments, integrating both on-premise and cloud platforms. Candidates must be freelance contractors and have Security clearance or eligible for Security clearance due to the nature of the programme The successful ...

Cleared Data Warehouse Engineer - Outside IR35 - Remote Role Overview We are seeking a skilled Data Warehouse Engineer to design, build, and maintain scalable data warehouse solutions within the Microsoft Azure ecosystem. The role focuses on developing robust data models, optimizing analytical queries … Data Engineering Experience with: Azure Synapse Analytics Azure Data Factory or similar ETL tools Azure Storage/Data Lake Experience designing data pipelines and transformations. To apply for this role please submit your CV or contact Dillon Blackburn ...

Data Architect/Technical Data Architect/Senior Data Architect/Lead Data Architect The client is are searching for multiple experienced Data Architect's to play a key role in a large-scale organisational transformation focused on significantly improving … enterprise data capabilities. This role will shape the target data architecture, enable modern data platform adoption, and support the delivery of trusted, scalable, and governed data products across the organisation. Working closely with engineering, analytics, governance, and senior business stakeholders, you will ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … meet our business needs. Key Responsibilities Data Platform & Engineering Build and maintain data ingestion pipelines using Azure Data Lake (ADLS Gen2) and Microsoft Fabric. Seamlessly integrate third-party platforms and implement data transformations. Develop datasets for Power BI and support management ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … meet our business needs. Key Responsibilities Data Platform & Engineering Build and maintain data ingestion pipelines using Azure Data Lake (ADLS Gen2) and Microsoft Fabric. Seamlessly integrate third-party platforms and implement data transformations. Develop datasets for Power BI and support management ...

deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance … fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Data Governance Technical Product Owner - £550 p/d Inside IR35 – 12-month contract – London/Hybrid We are currently looking for a Data Governance Product Owner to join a Global Media organisation, responsible for leading the implementation of a Data Governance Framework within … Quality Reporting • Strong capabilities to manage Data Catalogues and Data Lineage • Experience within Data Warehouses, Data Lake and Data Mesh • Experience with Python, Pyspark and ETL is desirable. This is an exciting opportunity to lead and influence data ...

Data Engineer Permanent £70 - £80k plus annual bonus scheme (up to 10%) Hybrid working (typically 2 days working from home) Wigan Sellick Partnership are delighted to be supporting a growing manufacturing organisation with the recruitment of a Data Engineer - a brand new role to the business … ensuring effective project management and delivery on time. Design and build a scalable, modern cloud-based data platform, including data lake, data ingestion pipelines, transformation and data modelling. Evaluation of current data setup to identify gaps and improvements ...

critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. ...

Power BI. Responsibilities You will design, build, and maintain a scalable Enterprise Data Warehouse using Amazon Redshift alongside a Data Lake architecture (S3), developing robust ELT/ETL pipelines to ingest and transform data from multiple sources. You'll ensure data … Strong experience as a Data Engineer with exposure to BI/reporting Hands-on experience with Amazon Redshift and Data Lake architectures (S3) Advanced SQL skills for data transformation and optimisation Proven experience with Power BI (data modelling, DAX, reporting) Strong ...

software engineering in a data context. You'll work across the modern Azure data stack - ADF, ADLS Gen2, PySpark, Delta Lake - with increasing exposure to Microsoft Fabric as the platform matures. You'll collaborate closely with customers and internal teams to ensure data … Event Hubs, Kafka), and legacy databases into ADLS Gen2 and OneLake Develop structured data models aligned to Lakehouse, Medallion Architecture, and Delta Lake patterns Continuously profile, debug, and optimise Spark jobs, SQL queries, and Python scripts for maximum performance and cost-efficiency at scale Champion DevOps best ...

Type: Contract (Inside IR35) Duration: 6 Months Job Summary: We are looking for a Senior Technical Lead with in-depth expertise in data governance, data quality, metadata management , and a strong background in delivering solutions using the Collibra platform . You will play a pivotal role … defining solution architectures, leading Collibra configuration and integration, implementing governance workflows, and collaborating closely with enterprise architects, data stewards, and platform teams. Key Responsibilities: Solution Architecture & Design Lead the design and implementation of Collibra-based data governance solutions, including: Data Catalog Business Glossary Policy ...

Data Bricks Product Owner, Microsoft Fabric Product Owner, Data Engineering, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Bricks Product Owner, Microsoft Fabric Project Owner, Data Engineering/Technology Product Owner required … Engineering (Data Bricks, Microsoft Fabric etc) before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance Development Framework experience within Microsoft Stack Technologies Experience with implementing ...

Data Bricks Product Owner, Microsoft Fabric Product Owner, Data Engineering, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Bricks Product Owner, Microsoft Fabric Project Owner, Data Engineering/Technology Product Owner required … Engineering (Data Bricks, Microsoft Fabric etc) before moving into Product Ownership Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance Development Framework experience within Microsoft Stack Technologies Experience with implementing ...

Data Architect Salary: Circa 80k Working arrangement: flexible, travel to Durham once or twice a week, remaining WFH Overview We are supporting a large, values-driven organisation to recruit a Data Architect. This is a senior role responsible for shaping and delivering enterprise data strategy across a complex technology environment. You will act as the technical authority for data and AI, ensuring data is secure, high quality and effectively used to support business outcomes. Key Responsibilities Define and deliver data strategy aligned to organisational goals Design ...

Data Architect Location: Wyton, Huntingdon (45 days onsite) Clearance: Active DV required Contract: 12 months (extension likely up to 3 years) or Permanent role Programme Overview Arqtech Search is supporting a defence delivery partner on a secure data transformation programme within an RAF operational environment. … platforms. Expertise in data modelling (conceptual, logical, physical). Strong knowledge of data warehousing and data lake architectures. Experience working within defence, national security or similarly regulated environments. Strong understanding of data governance, access control and information assurance. Experience ...

Python for data engineering Experience delivering solutions on cloud data platforms ( AWS preferred , Azure acceptable) Understanding of data lake and lakehouse architectures Ability to work autonomously and collaboratively within delivery squads Experience working within Central Government departments (highly desirable) Desirable Azure Data Lake, Synapse, Delta Lake Streaming technologies (Kafka, Event Hubs ...

Cleared Data Engineers & Data Architects UK | Hybrid | Multiple levels At Datatech Analytics, we’re supporting a leading UK technology and consulting organisation delivering mission critical data and AI platforms across defence and national security programmes. We’re looking to speak with DV-cleared Data … modern data engineering tooling Spark, Databricks and distributed data platforms AWS, Azure and Google Cloud Modern data lake and data warehouse architectures Who we’re keen to speak with Active DV clearance is essential. We’re interested in strong engineers ...

Principal Data Architect Python | Cloud | Distributed Systems | AI/ML Infrastructure Location: Glasgow or London (King’s Cross) Workstyle: Hybrid Reports to: CTO About Chemify: Chemify is revolutionising chemistry. We are creating a future where the synthesis of previously unimaginable molecules, drugs, and materials is instantly accessible. … systems that automate synthesis, optimisation, and library generation. As we scale up to globally distributed facilities, we are undertaking a foundational transformation of data integrates and scales across our platform. The Role We are looking for a Principal Data Architect to design and lead the evolution ...