101 to 125 of 606 Permanent Data Lake Jobs

Job Summary We are seeking an experienced Data Engineer to drive the development of our industrial digital platform with an acute focus on rigorous data validation. The ideal candidate will design, build, and maintain scalable data pipelines and infrastructure, ensuring that robust data quality checks and validations are integral to every process. You will collaborate with process engineers, data scientists, analysts, and other stakeholders to support critical decision-making through precise, validated, and secure data. Key Responsibilities: • Data Validation & Quality Assurance: Design, implement, and enforce comprehensive data validation protocols throughout all data management systems to ensure data accuracy, consistency, and integrity. • Scalable Infrastructure: Construct, test, and maintain highly scalable data pipelines that integrate advanced data validation processes at every stage. • ETL Process Enhancement: Develop and continuously improve More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Job Description For an organization to transform in today's digital world, it needs to properly collect, store, and organize its data. Effective data management can enable more efficient operations, yielding more growth. As a data architect, you know how to apply your creative-thinking and … analytical mindset to help organizations manage their data assets. We're looking for an experienced data architect like you to deliver leading-edge solutions for the U.S. Air Force client, providing combat air, intelligence, surveillance, and reconnaissance (ISR) capabilities for global air, space, and cyberspace operations. … As a data architect on our team, you'll use your extensive technical expertise to design data architecture solutions and implement robust, scalable data architectures that empowers our data scientists and analysts to extract maximum value from massive ISR datasets in support More ❯

a focus on training, growth and fostering an inclusive culture. We are now looking for a Product Manager to join the Guardian's Data team. In this role you'll work with key stakeholders to translate their unique business needs into data requirements. You'll work … with data governance and data & analytics engineers to create data products and manage through the product lifecycle. We see data as an asset that is critical for informing our business and driving performance. Data supports all areas of operations: informing … experience working with data products and an understanding of data platforms (e.g. data warehouse/data lake) using cloud based technologies Proven experience of understanding stakeholder goals and turning them into successful products and product performance metrics. Has the drive and More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £60,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think … scalable pipelines, secure platforms, and data systems that directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and … development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … culture of mentorship and leadership development, identifying and nurturing talents Drive the recruitment, retention, and development of top-tier engineering talent within the data engineering team Define and drive the overall data platform strategy with a focus on Azure Cloud to ensure that the organisation's … optimization of the data platform, leveraging Azure technologies such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, and Azure SQL Database Ensure the data platform supports data engineering, analytics, and data science initiatives across squads More ❯

for the improvement of patient care. We are looking for an ambitious, business driven person who will accelerate our transition from a light data platform to an enterprise data platform by 2027. This will allow Werfen to explore complex use cases and make a real impact … in the health care and diagnostics industry as well as democratize data to thousands of employees around the world. The scope of the data platform spans from technology centers, commercial operations, supply chain, corporate functions and sales affiliates. The data platform and governance manager … Collaborate with internal teams to create and communicate a global roadmap for the enterprise data platform, including AWS compute, Data Lake, cloud data catalog, visualization tools, AI/ML platforms, and code-first cloud components. Lead the outsourced data platform team More ❯

for the improvement of patient care. We are looking for an ambitious, business driven person who will accelerate our transition from a light data platform to an enterprise data platform by 2027. This will allow Werfen to explore complex use cases and make a real impact … in the health care and diagnostics industry as well as democratize data to thousands of employees around the world. The scope of the data platform spans from technology centers, commercial operations, supply chain, corporate functions and sales affiliates. The data platform and governance manager … Collaborate with internal teams to create and communicate a global roadmap for the enterprise data platform, including AWS compute, Data Lake, cloud data catalog, visualization tools, AI/ML platforms, and code-first cloud components. Lead the outsourced data platform team More ❯

Data Engineer Role - Remote - UK Based We're working with a fast-growing, down-to-earth Microsoft Partner that's looking for a Senior and Mid Level Data Engineer to join their team. If you're passionate about data and want to help businesses … solutions to meet customer needs. Helping organisations create, manage, and optimize their data. Developing cloud-native data products and data lake solutions. Engineering cloud-based data lakes to connect and leverage internal and external data. Providing technical support through prototyping, testing, and deployment. … improving development standards and processes. What You Need to Have Solid experience with core Azure tech: Data Factory, Databricks, Data Lake, Azure SQL, Synapse, Data Catalog, Purview. Strong Python and SQL skills for data engineering. Familiarity with Azure databases like Synapse More ❯

Data Engineer - Salisbury - £55,000-£65,000 - Hybrid My client is looking for a highly skilled Data Engineer to join our growing data team. This role is ideal for someone with strong experience in Azure data services and a passion for building … compliant. Key Responsibilities Design, build, and maintain robust ETL/ELT pipelines using Azure Data Factory, Synapse Analytics, and Data Lake Storage. Model data for analytical and BI consumption, including normalized and denormalized schemas. Collaborate with stakeholders to gather data requirements … pipeline automation best practices. Must-Have Skills Strong hands-on experience with Azure Synapse Analytics, Data Factory, and Data Lake Storage. Proven ability to build and manage ETL pipelines from various structured and unstructured sources. Expertise in SQL and data modeling for More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from … architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from … architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This More ❯

DATA ARCHITECT Location: London, UK Reporting To: SVP, Technology Contract Term: Full time, permanent About LIV Golf The LIV Golf League is the world's only global golf league featuring 13 teams, a 14-tournament schedule, and many of the world's best golfers. Launched in 2022, the … level and create new value within the golfing ecosystem while enhancing the game's societal impact. Role Objective We are seeking a visionary Data Architect to lead the design, implementation, and optimization of LIV Golf's enterprise data ecosystem. This role will focus on building scalable … data infrastructure that supports real-time analytics, player performance tracking, fan engagement, and business intelligence initiatives. The ideal candidate will have a passion for sports, a deep understanding of data architecture, and a knack for solving complex data challenges in a dynamic environment. Responsibilities More ❯

Location: London (hybrid working 3 office days per week) Employment Type: Permanent, full time Are you passionate about data and eager to make a significant impact? The AA is a well-loved brand with a range of driver services much wider than most people realise. We have an … data. As a Data Engineer, you'll be crucial in developing and maintaining our data pipelines and data lake house architecture. You'll be central to the success of our data team's efforts to maximise our data capabilities. … Designing, building and maintaining resilient data pipelines Identifying and automating manual or repetitive data processes. Establishing the data lake house as a single source of insight for the business. Developing analytical datasets to support insights into customer behaviour, operational efficiency and key performance More ❯

Join us as Senior Adobe Experience Platform (AEP) Data Architect. Be part of an Adobe Gold partner agency, growing 20% YOY. Enjoy training budget, bonuses, remote/flexible working and clear progression opportunities. If you have a track record as a Data Architect utilising the Adobe … award-winning work, for a variety of well-known clients. In line with our continued growth, we’re looking for a Senior AEP Data Architect to join our team who’ll be instrumental in the design and implementation of data architectures and data models … JSON for data transformation, APIs, and data interchange. Extensive experience with API management . Strong knowledge of Data Lake architectures and data storage solutions (e.g. AWS, Azure, Google Cloud). Knowledge of data integration methodologies, including batch and real More ❯

Senior Data Engineers x 2 for Kent based concern My client is seeking to recruit Senior Data Engineers to join its expanding IT operation To be considered for these positions you will need to have experience in the following areas - Good … Data Engineering/ETL development experience - Data design experience in an MI/BI/Analytics environment (for example Kimball, lake house, data lake) - Good experience working in a structured Change Management project lifecycle - Excellent Data Warehouse skills - A strong … knowledge of business intelligence solutions and an ability to translate this into data solutions for the broader business is essential. - Strong demonstrable knowledge of data warehouse methodologies - Robust understanding of high-level business processes - Understanding of data migration, including reconciliation, data cleanse More ❯

across various industries. With a presence in over 50 countries, HCLTech leverages cutting-edge technologies, including artificial intelligence (AI), machine learning (ML), and data analytics, to deliver exceptional solutions that empower businesses to achieve their goals. Objectives of this Role As a Data & AI Principal at … HCLTech, you will serve as the main point of contact for all Data & AI engagements, addressing client concerns and needs. You will manage large strategic accounts valued at $10M+, focusing on growth and customer satisfaction. Your role will involve building and strengthening client relationships to achieve long-term … by Microsoft Azure, Google Vertex, or Amazon. Technical know-how and understanding of Cloud Technology, Cloud Data Warehouse, and Data Lake platforms. Expertise in Data Governance practices, including leading solutions for Data Quality, Data Profiling, Data Catalog More ❯

across various industries. With a presence in over 50 countries, HCLTech leverages cutting-edge technologies, including artificial intelligence (AI), machine learning (ML), and data analytics, to deliver exceptional solutions that empower businesses to achieve their goals. Objectives of this Role As a Data & AI Principal at … HCLTech, you will serve as the main point of contact for all Data & AI engagements, addressing client concerns and needs. You will manage large strategic accounts valued at $10M+, focusing on growth and customer satisfaction. Your role will involve building and strengthening client relationships to achieve long-term … by Microsoft Azure, Google Vertex, or Amazon. Technical know-how and understanding of Cloud Technology, Cloud Data Warehouse, and Data Lake platforms. Expertise in Data Governance practices, including leading solutions for Data Quality, Data Profiling, Data Catalog More ❯

Databricks Data Engineer – Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key … expertise and experience we’re looking for: Data Engineering in Databricks – Spark programming with Scala, Python, SQL and Ideally experience with Delta Lake or Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks … Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data More ❯

Databricks Data Engineer – Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key … expertise and experience we’re looking for: Data Engineering in Databricks – Spark programming with Scala, Python, SQL and Ideally experience with Delta Lake or Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks … Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data More ❯

Data Architect Our client, a leading financial services corporation, is hiring a Data Architect to drive & design our client's data strategy as they move from on-prem to Azure cloud services. You will be part of a team designing and managing data systems primarily in Azure, ensuring alignment with business goals and requirements. To be successful, you must have strong expertise in Azure-based data solutions working within a regulated environment. Our client is paying a basic salary of £83,000 circa + 15% bonus/28 days holiday … various data sources (on-premises, cloud-based, and third-party) into the Azure environment. Utilise Azure services like Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, and Azure Databricks for data storage, transformation, and analysis. Core skills and experience: Previous experience acting More ❯

The Analytics & Data Engineer role is engaged in architecture, consulting and development of Data Engineering and Business Intelligence solutions related to client projects. This role will also participate in activities that are directed at the overall growth of the Analytics and Data Estate Practice … and solution architecture/development skills. Essential Functions and Responsibilities • Support solution decision-making as a trusted technical advisor. • Design, implement, and deploy data platforms in public and private cloud environments. • Guide clients on data strategy, governance, architecture, and quality management. • Conduct customer workshops, discovery sessions … and experience architecting and developing all components of modern analytics stacks, including MDM, normalization, Business Intelligence/Visualization, relational data warehouse/lake house structures, popular schemas, ETL & ELT. • Ability to identify company requirements for data insights and warehousing. • Comfortable working with various corporate stakeholders. More ❯

Exciting Opportunity in Health Tech! Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Reporting To: Vice President of Software Development Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with … secure clinical data in-motion and at-rest. Shape Data Workflows : Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable. Key Responsibilities Data Engineering with …/CD pipelines and manage container technologies to support a robust development environment. Requirements Expertise in Databricks : Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge : Experience with Azure Data Factory for data orchestration. Clinical More ❯