26 to 50 of 132 Data Lake Jobs

build through to release, optimisation, and retirementCollaborate closely with product owners and data scientists to align platform capabilities with business needsLead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planningProvide hands-on data engineering expertise, building … platforms (e.g. Databricks, AWS)Proven ability to design and manage scalable data pipelines, models, and schemasSolid SQL and relational database expertiseExperience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover)Strong understanding of data governance, quality, and lifecycle managementExperience with BI tools such as Power ...

Business Intelligence: Support and enhance Business Intelligence reporting and analytics capabilities. Data Architecture: Contribute to the development of a data lake and modern data architecture. Platform Development: Work across both BAU support and new capability development, with approximately 50% of the role focused … emerging AI use cases Proactive, collaborative and delivery-focused approach Strong communication and stakeholder management skills Desirable Experience contributing to data lake builds or modern data platforms Experience working in complex or regulated environments is beneficial Exposure to Data Ops and CI/ ...

Data Architect Permanent Hybrid Working (2 Days on site in Birmingham) Reporting to the Head of Architecture, the Data Architect will be responsible for designing and implementing enterprise-level data architecture and strategies that align with the business and technology goals of the organisation … rather than the operational aspects such as performance, monitoring, quality reporting. As the Data Architect, you'll focus on architectures that move, process, store, validate and present data, ensuring scalability, efficiency and security. This role is strategic in nature, requiring less of a hands-on approach. ...

expectation to attend the office in London or Swindon 1 day per month. The successful AI Engineer will join a growing data team supporting the development of a modern AWS-based data platform while contributing to emerging AI initiatives. This is a hands-on role combining … Engineer, Data Scientist, Business Intelligence Engineer, BI Engineer, Data Engineer, AWS, Glue, Lambda, Redshift, Athena, SQL, Python, Data Lake, Data Platform, Business Intelligence, Analytics, AI, Machine Learning, AWS Bedrock, Generative AI, Data Warehousing, Public Sector, London, Swindon, Hybrid ...

through to release, optimisation, and retirement Collaborate closely with product owners and data scientists to align platform capabilities with business needs Lead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise … Databricks, AWS) Proven ability to design and manage scalable data pipelines, models, and schemas Solid SQL and relational database expertise Experience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover) Strong understanding of data governance, quality, and lifecycle management Experience with BI tools such ...

solutions and guide delivery teams through best practice. You will architect solutions using Azure Synapse, Data Factory, Databricks, Fabric, Data Lake, SQL and Power BI, with a strong focus on governance, security, performance and reliability. This position suits someone who enjoys a mix of hands … professional services. Key Skills: Azure Data Architecture and solution design Azure Synapse, Data Factory, Databricks, Fabric, Data Lake Data modelling, integration, pipelines and governance Strong stakeholder engagement and consulting experience Experience working within a Microsoft Partner or consultancy environment ...

inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Data Engagement Lead Position Description At CGI, we help organisations unlock the full value of their data to drive transformation, innovation, and measurable … more technologies including AWS, Microsoft Fabric, Databricks, Snowflake, Azure Data Factory, Azure Synapse Analytics, Power BI, or Azure Data Lake Strong knowledge of data governance, data quality, metadata management, lineage, and enterprise data management practices Proven ability to engage ...

Data Engineer | Hybrid | South Wales | 6 months initially IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team in this … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

pipelines and platform components within AWS Support and enhance Business Intelligence reporting and analytics Contribute to the development of a modern data lake and data architecture Deliver across both BAU support and new capability development Collaborate with cross-functional teams on AI initiatives and roadmap … Experience working in complex or regulated environments is beneficial Desirable Experience Knowledge of AWS AI services (e.g. Bedrock) Experience contributing to data lake or modern data platforms Exposure to DataOps/CI-CD practices Experience in the public sector (nice to have) Role Split ...

Data Engineer - Niche RMS Duration: 8 Months Rate: £500 per day Location: Hybrid - Remote working with occasional visits to Warwickshire (approx. 2-3 days per month) IR35 Status: Outside Start: ASAP Role Overview: A Data Engineer with Niche RMS experience is required to work … integration Experience with data migration and transformation in complex environments Knowledge of data modelling, warehousing, and data lake architectures Experience with cloud platforms (Azure preferred) Understanding of data quality, governance, and compliance frameworks Experience working with structured datasets and large ...

engineering squads, leveraging both UK engineering resource and RecoTek (Reconomy’s near-shore technology scaling hub based in Bucharest), focused on delivering innovative data‐centric products for Valpak and the wider Reconomy business. Reporting to the Chief Technology Officer (Comply) and being an active member of the Comply … data platforms, with a strong focus on Azure Cloud technologies (e.g., Azure Data Factory, Azure Synapse, Azure Data Lake, Azure SQL Database, Databricks, Apache Spark). Proven experience leading the implementation of data platform strategies and managing large‐scale data ...

Company NW Tech are delighted to be working with a rapidly expanding professional services organisation in their search for a Data Engineer. The Role Key responsibilities include: Design, build and maintain scalable data pipelines to ingest, process and transform structured and unstructured data from … using industry-standard tools and cloud technologies. Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies. Proficiency in working with at least one major cloud data platform Proficiency in Python for data ...

Data Engineer £70,000 - West London (Hybrid - 1 day onsite) We are seeking a Data Engineer to join a well-established, international organisation operating within a sustainability-focused industry. The business is undergoing a significant digital and data transformation, with major investment in modern … PySpark, particularly within Fabric Notebooks Exposure to Azure data services such as Data Factory, Synapse or Data Lake Power BI experience, including supporting reporting and dashboarding requirements What's on Offer Salary of up to £70,000 Hybrid working model (West London with ...

Cleared Data Governance Manager - Contract Rate: Up to £620 per day (Inside IR35) Location: London or Manchester (1-2 days per week on-site) Contract: 6 months Clearance: Active SC required We're hiring an experienced SC-cleared Data Governance Manager to support the delivery … information assurance Experience defining and implementing data standards, policies, and controls Familiarity with Azure data environments (Data Lake, Synapse, etc.) Experience working with data owners, stewards, and governance forums Strong stakeholder management and communication skills Comfortable working in Agile, multidisciplinary teams ...

employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Azure Data Architect Position Description At CGI, we help organisations unlock the full value of their data through secure, scalable Azure solutions. … enterprise environments •Strong data modelling and database design expertise •Hands-on experience with Azure Data Factory, Azure Data Lake, Azure SQL, Cosmos DB and Power BI •Knowledge of Azure security, governance and compliance •Experience designing scalable cloud data platforms •Strong stakeholder ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. • Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. • Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). • Experience with AWS cloud services including S3, Glue, Lambda, IAM. • Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. • Understanding of data governance and compliance frameworks. • Experience in the healthcare sector or knowledge of NHS data ...

Engineering, translating finance requirements into data solutions and managing development priorities. Administer and support the ongoing development of the Global Finance Datalake and Forecasting & Budgeting (FaB) tool, including user access, process configuration and governance. Work with Finance data stakeholders across the Group to resolve system … sets. Desirable: experience with TM1 Planning Analytics, Microsoft Dynamics 365 and/or Microsoft Fabric. Experience with enterprise reporting or data lake tools is preferred; prior exposure to a finance function would be beneficial. Salary will depend on experience and is expected ...

Engineering, translating finance requirements into data solutions and managing development priorities. Administer and support the ongoing development of the Global Finance Datalake and Forecasting & Budgeting (FaB) tool, including user access, process configuration and governance. Work with Finance data stakeholders across the Group to resolve system … sets. Desirable: experience with TM1 Planning Analytics, Microsoft Dynamics 365 and/or Microsoft Fabric. Experience with enterprise reporting or data lake tools is preferred; prior exposure to a finance function would be beneficial. Salary will depend on experience and is expected ...

hiring a hands-on Data Architect to support the evolution of a cloud-based data platform, with a strong focus on data warehousing, analytics, and reporting. You'll work closely with BI Developers to design, build, and optimise end-to-end data … operating at architecture level - s trong Azure expertise across: Azure Data Factory (ADF) Azure Synapse/Azure SQL Azure Data Lake (ADLS) Exposure to Microsoft Fabric (highly desirable) Strong background in data warehousing and BI environments Excellent dimensional modelling (Kimball) experience Experience working ...

Markets & Regions WE Location: Putney, UK IT BUSINESS SOLUTIONS MANAGER The role is aimed to support JTI markets in Western Europe with data-driven decision-making strategy, primarily focused on Strategic Insights and Commercial Planning. As IT Business Solutions Manager for Data &Analytics this role involves … successful execution Experience with budget management, contract management Technical & Analytical Skills Delivery on Azure stuck (Databricks, Data Factory, Data Lake) Very good understanding of Azure PaaS management and resource monitoring CI/CD experience and DevOps Working knowledge of SQL and experience in Python/ ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger commercial decision making and elevate campaign management for client facing teams. … 2+ years experience as data engineer on AI/ML project with Python· Strong experience using Databricks, including Jobs, Asset Bundles, Delta Lake, and MLflow, as well as Azure data engineering tools such as Azure Data Factory and Azure Data Lake ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, the Principal … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

wants to execute a defined plan. You will be working across two fronts simultaneously: building the core platform capabilities — the virtualized data lake, Common Data Layer, and data contract framework — that give WTW a unified, AI-ready data foundation; and embedding … requirements. Background in financial services, insurance, or broking is a plus but not required. Technical Skills Deep expertise in Databricks, including Unity Catalog, Delta Lake, Delta Sharing, and the full Databricks data engineering and ML stack. Strong command of DBT for modular, testable, and well-documented data ...

Senior Data Engineer | Hybrid | Outside IR35 | £475 - £525 | London We are looking for a Senior Data Engineer to join a leading organisation on a contract basis. This role will suit someone with strong experience across the Azure data platform , particularly Databricks and PySpark … across engineering, analytics, and business teams Required Experience Strong experience as a Senior Data Engineer Expertise in Azure (ADF, Data Lake, Synapse/Fabric) Hands-on experience with Databricks and PySpark (essential) Experience building data pipelines and data platforms Strong ...