501 to 525 of 661 Data Lake Jobs

We’re looking for an experienced Data Engineering Manager to lead a team in designing and building cutting-edge data solutions, driving the strategy for a fast-growing, innovative company. If you're passionate about building scalable data platforms, optimising pipelines, and empowering teams … to leverage data effectively, this could be your next big move! What You’ll Do: 🔹 Lead and mentor a team of data engineers, fostering a high-performance culture 🔹 Design, build, and optimise data pipelines and platforms to support business insights 🔹 Work with modern cloud … based data technologies to ensure scalability and efficiency 🔹 Collaborate with cross-functional teams to drive data-driven decision-making 🔹 Ensure best practices in data governance, security, and reliability Key Skills & Experience: ✔️ Proven experience leading data engineering teams in a fast-paced environment More ❯

required to join a buoyant City-based Insurance group. This role will see you working across the organisation's brands to ensure that data remains at the forefront of decision making and that the appropriate data foundations covering architecture, systems and reporting are in place to … analytics to address specific challenges within the business from ideation to delivery. Key Responsibilities: Designing, developing and maintaining BI solutions (Dashboards, reports and data models-semantic) using tools such as PowerBI, SQL Identifying gaps/areas for improvement across the data eco-system and outline appropriate … dependencies, building easy-to-follow code annotations, data dictionaries, data lineage/flow documenting or production deployment requests. Experience in DataLake technologies (DataBricks, Azure Synapse) and/or Dataiku More ❯

required to join a buoyant City-based Insurance group. This role will see you working across the organisation's brands to ensure that data remains at the forefront of decision making and that the appropriate data foundations covering architecture, systems and reporting are in place to … analytics to address specific challenges within the business from ideation to delivery. Key Responsibilities: Designing, developing and maintaining BI solutions (Dashboards, reports and data models-semantic) using tools such as PowerBI, SQL Identifying gaps/areas for improvement across the data eco-system and outline appropriate … dependencies, building easy-to-follow code annotations, data dictionaries, data lineage/flow documenting or production deployment requests. Experience in DataLake technologies (DataBricks, Azure Synapse) and/or Dataiku More ❯

required to join a buoyant City-based Insurance group. This role will see you working across the organisation's brands to ensure that data remains at the forefront of decision making and that the appropriate data foundations covering architecture, systems and reporting are in place to … analytics to address specific challenges within the business from ideation to delivery. Key Responsibilities: Designing, developing and maintaining BI solutions (Dashboards, reports and data models-semantic) using tools such as PowerBI, SQL Identifying gaps/areas for improvement across the data eco-system and outline appropriate … dependencies, building easy-to-follow code annotations, data dictionaries, data lineage/flow documenting or production deployment requests. Experience in DataLake technologies (DataBricks, Azure Synapse) and/or Dataiku More ❯

We’re looking for an experienced Data Engineering Manager to lead a team in designing and building cutting-edge data solutions, driving the strategy for a fast-growing, innovative company. If you're passionate about building scalable data platforms, optimising pipelines, and empowering teams … to leverage data effectively, this could be your next big move! What You’ll Do: Lead and mentor a team of data engineers, fostering a high-performance culture Design, build, and optimise data pipelines and platforms to support business insights Work with modern cloud … based data technologies to ensure scalability and efficiency Collaborate with cross-functional teams to drive data-driven decision-making Ensure best practices in data governance, security, and reliability Key Skills & Experience: ✔️ Proven experience leading data engineering teams in a fast-paced environment More ❯

We’re looking for an experienced Data Engineering Manager to lead a team in designing and building cutting-edge data solutions, driving the strategy for a fast-growing, innovative company. If you're passionate about building scalable data platforms, optimising pipelines, and empowering teams … to leverage data effectively, this could be your next big move! What You’ll Do: Lead and mentor a team of data engineers, fostering a high-performance culture Design, build, and optimise data pipelines and platforms to support business insights Work with modern cloud … based data technologies to ensure scalability and efficiency Collaborate with cross-functional teams to drive data-driven decision-making Ensure best practices in data governance, security, and reliability Key Skills & Experience: ✔️ Proven experience leading data engineering teams in a fast-paced environment More ❯

days per week. About the Role We're looking for a great candidate to join our clients Platform team to help deliver data engineering and technical pipeline solutions … that support their growing product portfolio. This will include orchestration of complex pipelines that bridge software products, frameworks and our own data lake infrastructure. Responsibilities Working within the Platform Team to architect, build and maintain pipeline/data engineering solutions for geospatial and non-spatial … datasets. Integrate and consume data from WFS/WMS services. Support the deployment and maintenance of Geoserver instances. Collaborate with analysts, developers, and stakeholders to define data requirements. Ensure data integrity, quality, and security across all sources. Liaise with other team members, including within More ❯

days per week. About the Role We're looking for a great candidate to join our clients Platform team to help deliver data engineering and technical pipeline solutions … that support their growing product portfolio. This will include orchestration of complex pipelines that bridge software products, frameworks and our own data lake infrastructure. Responsibilities Working within the Platform Team to architect, build and maintain pipeline/data engineering solutions for geospatial and non-spatial … datasets. Integrate and consume data from WFS/WMS services. Support the deployment and maintenance of Geoserver instances. Collaborate with analysts, developers, and stakeholders to define data requirements. Ensure data integrity, quality, and security across all sources. Liaise with other team members, including within More ❯

days per week. About the Role We're looking for a great candidate to join our clients Platform team to help deliver data engineering and technical pipeline solutions … that support their growing product portfolio. This will include orchestration of complex pipelines that bridge software products, frameworks and our own data lake infrastructure. Responsibilities Working within the Platform Team to architect, build and maintain pipeline/data engineering solutions for geospatial and non-spatial … datasets. Integrate and consume data from WFS/WMS services. Support the deployment and maintenance of Geoserver instances. Collaborate with analysts, developers, and stakeholders to define data requirements. Ensure data integrity, quality, and security across all sources. Liaise with other team members, including within More ❯

Services (GPT models, embeddings, cognitive services) Azure Functions , Azure API Management , and Azure Logic Apps Azure Data Factory , Synapse , Data Lake , and Databricks Familiarity with Microsoft Fabric for managing AI-infused data products. API & System Integration Experience integrating ML/LLM models into … with business KPIs. Additional Skills (Nice to Have) Experience with CI/CD for ML (Azure DevOps, GitHub Actions) Familiarity with Responsible AI , data privacy, and explainability Understanding of vector databases and embedding-based search Exposure to semantic search , chatbot development , and AI assistants Soft Skills Strong problem … fast-paced, evolving environments Collaborative and proactive attitude in cross-functional teams Certifications (Preferred) Microsoft Certified: Azure AI Engineer Associate Microsoft Certified: Azure Data Scientist Associate English (C1) required Office: Brussels modality of work: near-site If interested, please apply! Our personnel search is addressed to candidates of More ❯

must live within a reasonable distance to the office or be willing to relocate by the role commencement date. Job Purpose As a Data Analyst, you will play a critical role in leveraging data to drive insights, optimise business performance, and … support decision-making. You will work with existing data platforms while contributing to the development of an Azure-based data lake, ensuring seamless integration and enabling advanced analytics. Your responsibilities will span across data extraction, cleaning, visualisation, and analysis, as well as collaborating … business challenges and opportunities. This role will require a bright and enthusiastic individual who has a proven track record of working in a data reporting team supporting all areas of the business. Candidates will need retail experience and a minimum 5 years IT experience of SQL SSIS and More ❯

Job Title : Snowflake Data Engineer - Cortex AI Location: Spain (Madrid) Type : Contract/Permanent Skills: Snowflake, Cortex AI, AWS & Python. Working Model: Remote within Spain (eventual trips to the client's offices). We are hiring a Snowflake Data Engineer - Cortex AI to design and maintain … scalable data solutions using Snowflake, Cortex AI, and AWS. The role requires 5+ years of experience in data engineering, Python, ETL workflows, and containerization tools like Docker/Kubernetes. Required Skills: 5+ yrs of experience as Data engineer Design, build, and maintain large-scale … data pipelines, data warehouses, and data lakes on Snowflake, leveraging Cortex AI to drive business insights and decision-making Proficiency in Cortex and AWS Services. Strong programming skills in Python, experience in Streamlit Experience with containerization technologies (e.g., Docker, Kubernetes). Familiarity with data More ❯

Senior Engineering Manager - Data Platform FTC - 6 months 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager - Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee … the development of our foundational data platform - encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and Real Time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, Back End engineers, and product leaders to ensure … our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1-2 engineering squads focused on experimentation, analytics event logging, batch More ❯

Senior Data Engineer – Spark & Databricks Platform Build Location: London (2 days a week on site) Contract: 6-month sign-on Interview process: 2 stages twentyAI’s customer is building the next generation of their data platform, with Databricks and Apache Spark at the core. A PoC … the full-scale build and help roll the platform out across the organisation. The project involves migrating the existing on-prem Data Lake to a Databricks-based architecture, while continuing to leverage private cloud storage. You’ll be laying the foundations: building ETL pipelines in PySpark, implementing … delivering Spark/Databricks implementations in a lead or senior role Solid hands-on background in PySpark, Spark, and Python Experience setting up data platforms with a DevOps-first approach (IaC, CI/CD, automation) Exposure to AWS-based environments Familiarity with financial/trading systems and working More ❯

Senior Data Engineer – Spark & Databricks Platform Build Location: London (2 days a week on site) Contract: 6-month sign-on Interview process: 2 stages twentyAI’s customer is building the next generation of their data platform, with Databricks and Apache Spark at the core. A PoC … the full-scale build and help roll the platform out across the organisation. The project involves migrating the existing on-prem Data Lake to a Databricks-based architecture, while continuing to leverage private cloud storage. You’ll be laying the foundations: building ETL pipelines in PySpark, implementing … delivering Spark/Databricks implementations in a lead or senior role Solid hands-on background in PySpark, Spark, and Python Experience setting up data platforms with a DevOps-first approach (IaC, CI/CD, automation) Exposure to AWS-based environments Familiarity with financial/trading systems and working More ❯

Senior Data Engineer – Spark & Databricks Platform Build Location: London (2 days a week on site) Contract: 6-month sign-on Interview process: 2 stages twentyAI’s customer is building the next generation of their data platform, with Databricks and Apache Spark at the core. A PoC … the full-scale build and help roll the platform out across the organisation. The project involves migrating the existing on-prem Data Lake to a Databricks-based architecture, while continuing to leverage private cloud storage. You’ll be laying the foundations: building ETL pipelines in PySpark, implementing … delivering Spark/Databricks implementations in a lead or senior role Solid hands-on background in PySpark, Spark, and Python Experience setting up data platforms with a DevOps-first approach (IaC, CI/CD, automation) Exposure to AWS-based environments Familiarity with financial/trading systems and working More ❯

and skills necessary to help us meet future business challenges. Position not right for you? Share it with someone you know. Business Intelligence Data Architect Reference: MAY Expiry date: 2025-05-:59:00.000 Location: Ipswich Benefits: BUPA medical, Life Assurance, discounted holidays and cruises plus retail discounts and … all about making lasting memories for our guests. As we continue to grow, we are strengthening our IT department with a Business Intelligence Data Architect in our Ipswich Head Office. This is an exciting and varied position responsible for designing, developing, and maintaining the data architecture … that underpins our organisation's business intelligence and analytics platforms. This role plays a key part in ensuring data is accurate, accessible, secure, and structured to support enterprise decision-making, reporting, and performance insights. Key Responsibilities include: Design and implement scalable data architecture to support BI More ❯

Data Analyst - Southampton - £30,000 - £45,000 per annum. VIQU have partnered with a fast-growing SaaS and data analytics company who are looking to expand their current team and hire a geospatial data analyst. The ideal candidate will hold experience with modelling physical … joining a team of high achievers, working within a rapidly emerging industry with exposure to a range of technologies. Job Duties of the Data Analyst: Run and develop simulations and experiments, utilising scripting languages (Python) to do so. Utilising a range of data analysis techniques. Extracting … Must hold a year's professional experience using Python/Pyspark/Pandas. Experience with processing data and working with databases/datalakes (SQL). Strong understanding of data manipulation, analysis and processing. Ability to communicate to technical and non-technical stakeholders. To discuss this exciting More ❯

JOB SUMMARY In this role, you'll play a pivotal part in building and optimizing data pipelines that transform large, multi-modal datasets into high-quality training inputs for cutting-edge AI models for drug discovery. You'll help evolve our data pipeline and storage infrastructure … control, testing, and documentation. This role is remote, with preference for candidates on the East Coast or UK. KEY RESPONSIBILITIES Design and improve data pipelines that process large, multi-modal datasets from a variety of internal and external sources into training datasets for AI models. Evolve our data … Hands-on experience with multi-terabyte scale data processing. Familiarity with AWS; Kubernetes experience is a bonus. Knowledge of data lake technologies such as Parquet, Iceberg, AWS Glue etc. Strong Python software engineering skills. Pragmatic mindset - able to evaluate tradeoffs find solutions that empower ML More ❯

Hypercube Consulting is a rapidly growing data and AI consultancy dedicated to transforming the energy sector through cutting-edge technology. Specialising in advanced AI systems, including Agentic AI workflows and large language models (LLMs), we help clients unlock profound value from their data assets. Join our … a Senior AI Engineer with experience in Agentic AI and LLM technologies to design and develop impactful AI solutions. You'll work alongside data engineers, data scientists, and cloud specialists, directly contributing to client success. In this role, you will: Engage with client challenges, developing practical … contribution Develop and deploy reliable AI and LLM solutions, collaborating with senior team members. Contribute to the implementation and maintenance of AI pipelines (data ingestion, model training, deployment, and monitoring). Work within multidisciplinary teams to deliver client-focused solutions. Effectively communicate AI concepts and methodologies to peers More ❯

updates or an exclusive offer. Name Email Telephone Address Cover Note Upload CV What do you want to search? Keyword Apprenticeship Type Location Data Analyst Apprentice Apply From: 26/05/2025 Learning Provider Delivered by NOWSKILLS LIMITED Employer STANDGUIDE LTD Vacancy Description Develop and implement databases … data collection systems, and data engineering solutions that optimise reporting efficiency and clarity. Acquire data from primary or secondary data sources and maintain databases/data lakes. Interpret data, analyse results using statistical techniques, and provide ongoing reports. … Identify, analyse, and interpret trends or patterns in complex data sets. Filter and "clean" data by reviewing raw data, reports, and performance indicators to locate and correct code problems. Work with management to prioritise business and information needs. Locate and define new process improvement More ❯

teams through developing tooling and blueprints for logging, monitoring, and alerting (LMA), security, and automation patterns. Design, build, and optimize solutions using Azure Data Factory, Azure Databricks, Azure Kubernetes Service (AKS), and related services. Drive internal enablement through trainings, coaching sessions, community events, and hackathon Key requirement: A … least 2 focused on Azure . Experienced in Azure Data Services (e.g., Functions, Data Factory, SQL DB, Data Lake, Cosmos DB). Skilled in Azure DevOps , CI/CD, and IaC using Bicep, PowerShell, CLI, or Bash . Well-versed in containerization, serverless More ❯

Principal Data Architect Hybrid - London – weekly office visit We’re working with a cutting-edge SaaS business that's revolutionising how organisations integrate systems, manage data, and deliver insights. This high-growth, product-led company offers a game-changing, AI-powered platform that’s driving digital … for their approach to high achieving professionalism balanced with a great work-life balance. About the Role We’re looking for a Principal Data Architect to join a highly skilled team focused on delivering next-gen, data-driven solutions across complex enterprise environments. We’re looking … listening to and tailoring for clients. You’ll act as a platform superuser and thought leader, responsible for designing and delivering modular, reusable data architecture components that accelerate implementation and drive value for customers. This is a key opportunity to influence the development of industry-specific solutions for More ❯

Job Title: Technical Leader – Individual Contributor (Cloud Data Transformation) Location: London, UK (Hybrid – 2–3 days onsite) Industry: Financial Markets/Capital Markets Infrastructure Employment Type: Full-time | Permanent Overview We are partnering with a global leader in financial markets infrastructure , currently undergoing an enterprise level modernisation programme … of their core platform. This multi-year transformation is focused on rebuilding core data and analytics capabilities using a modern cloud-native stack —and they are looking for a high-calibre Technical Leader (IC) to play a pivotal role. This an opportunity with significant architectural ownership, suited for … or data architecture roles, with proven experience at enterprise scale. Deep hands-on expertise with: Azure cloud services (e.g., Data Lake, Synapse, Functions, Event Grid) Python for backend, data engineering, and automation Snowflake , including performance tuning, architecture, and best practices Experience leading or More ❯

Job Title: Technical Leader – Individual Contributor (Cloud Data Transformation) Location: London, UK (Hybrid – 2–3 days onsite) Industry: Financial Markets/Capital Markets Infrastructure Employment Type: Full-time | Permanent Overview We are partnering with a global leader in financial markets infrastructure , currently undergoing an enterprise level modernisation programme … of their core platform. This multi-year transformation is focused on rebuilding core data and analytics capabilities using a modern cloud-native stack —and they are looking for a high-calibre Technical Leader (IC) to play a pivotal role. This an opportunity with significant architectural ownership, suited for … or data architecture roles, with proven experience at enterprise scale. Deep hands-on expertise with: Azure cloud services (e.g., Data Lake, Synapse, Functions, Event Grid) Python for backend, data engineering, and automation Snowflake , including performance tuning, architecture, and best practices Experience leading or More ❯