76 to 100 of 270 Data Lake Jobs

pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working with SQL Server and advanced SQL development Delivering API integrations across internal and third-party systems Supporting Azure DevOps and CI/… also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already ...

Solution Architect Willis Re is building its global technology estate from the ground up, unencumbered by legacy and designed around data, analytics and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics and client‐facing … solutions on Microsoft Azure, spanning infrastructure, PaaS services, networking, identity, security and observability. Data Engineering: Design solutions around our data lake platform, architecting performant pipelines, sound data models and strong governance for large volumes of reinsurance placement, exposure, claims and market data. Hands ...

Data Business Analyst – SQL/Enterprise Data Transformation Remote - UK £56,000 + Competitive Benefits + Above Market-Rate Bonus (OTE £72,000+) I’m working with a household name organisation undergoing a large-scale data transformation programme, and they’re looking … experienced Data Business Analyst to join their growing data function. What you’ll be doing: Providing the Data BA part of delivering a new customer management system and using SQL to test data ingestion into Data Lakes and Warehouses. Partnering ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

IR35, £800 - £950 per day)Willis Re is building its global technology estate from the ground up, unencumbered by legacy and designed around data, analytics and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics … solutions on Microsoft Azure, spanning infrastructure, PaaS services, networking, identity, security and observability.* **Data Engineering:** Design solutions around our data lake platform, architecting performant pipelines, sound data models and strong governance for large volumes of reinsurance placement, exposure, claims and market data.* **Hands ...

exciting opportunity has arisen for a Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

Azure Databricks Data Lake Deployment Squad Lead** (Contract) Duration: Up until 31 March 2026 (Possibility for extension) Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role Profile This role will manage a scrum … team that will ingest data required for the ECB Onboarding program into the EMEA Data Platform with a focus on data required by the EUAG Finance Department. Key Responsibilities: Facilitate efficient and effective software delivery from inception to go-live for the EMEA Data ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, the Principal … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

Delivery Consultant - Data, Public Sector Professional Services - UK Job ID: 10380238 | AWS EMEA SARL (UK Branch) The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you’ll work closely with … home, there’s nothing we can’t achieve. Basic Qualifications Experience implementing AWS services in a variety of distributed computing environments Data lake architecture and design (Lake Formation, S3-based architectures) Medallion architecture implementation (bronze/silver/gold layer design) Data strategy ...

hiring a hands-on BI Architect to support the evolution of a cloud-based data platform, with a strong focus on data warehousing, analytics, and reporting. You'll work closely with BI Developers to design, build, and optimise end-to-end data solutions across … operating at architecture level - s trong Azure expertise across: Azure Data Factory (ADF) Azure Synapse/Azure SQL Azure Data Lake (ADLS) Exposure to Microsoft Fabric (highly desirable) Strong background in data warehousing and BI environments Excellent dimensional modelling (Kimball) experience Experience working ...

Data Architect Telford/Hybrid - 2 days per week onsite £640 inside ir35 6 months contract Active SC clearance We're looking for an experienced Data Architect to join a major UK Government programme, designing enterprise-scale data solutions that support critical public services. … lead the architecture of modern data platforms, working across cloud, hybrid and on-premise environments to deliver robust, secure and scalable data solutions. This role will see you designing end-to-end data architectures, driving data governance, supporting cloud migration initiatives ...

more liquid world. The more we share, the more we all gain. About the role Sharegain is looking for an experienced and driven Data Team Lead to join our R&D organization. In this role, you will lead a team of data engineers while taking hands … Engineering & Architecture Define and drive the data architecture strategy, including the design of scalable pipelines, ETL workflows, and Data Lake expansion. Oversee the design and maintenance of schemas, data structures, and data organization standards. Own data quality, integrity ...

Build and optimize data pipelines using Azure Data Factory (ADF) and SSIS . Leverage Databricks and Azure Data Lake to innovate and streamline workflows. Create high-impact reporting solutions in Power BI . Collaborate with multi-functional product teams and mentor junior developers. … Looking For: Languages: Strong proficiency in SQL and Python . Data Platforms: Hands-on experience with Databricks and Azure Data Lake . ETL: Proven ability to build efficient pipelines (ADF, SSIS, APIs). Desirable: PySpark, Dimensional Modelling, DAX/SSAS, or an interest ...

platform administration experience across Microsoft cloud data technologies, including Azure Databricks, Microsoft Fabric, Azure Data Factory, Azure Data Lake, Azure SQL and Power BI. Operational mindset with experience managing, monitoring and supporting data platforms in production environments. Experience working in controlled … Skills & Experience Current SC Clearance. Hands‐on administration experience across Azure Databricks, Microsoft Fabric, Azure Data Factory, Azure Data Lake, Azure SQL and Power BI. Strong understanding of cloud data platform operations, monitoring, access management and environment support. Experience working within controlled ...

Senior Data Engineer – Azure/Databricks £70,000 + bonus Hybrid Working – 1 day on-site per week East Midlands based I'm working with a business that's continuing to invest in its Azure data platform and is looking for a Senior Data … evolution of the Azure data platform Key experience: Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Advanced SQL and Python CI/CD with Azure DevOps Strong stakeholder engagement and communication skills What's on offer: Flexible hybrid working ...

Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

Closing date 20 May 2026 What is the purpose of this job? As the Data Engineering Lead, you will provide senior technical leadership and oversight for the RDG’s current AWS-based data platform, ensuring it is robust, scalable and able to support RDG and wider … DataOps is essential, ideally including the development of pipelines and tooling. You will champion best‐practice data warehouse and data lake design, driving automation and high standards in code quality. You’ll lead by example, be curious about data and eager to uncover ...

multidimensional models. Investigate and resolve complex technical, functional, and performance-related issues. Develop and support data integration processes, including Data Lake implementations and associated workflows. Build and maintain API-based integrations between Infor EPM and third-party business applications. Monitor platform performance and implement improvements … within Infor EPM. Advanced knowledge of EPM modelling, business rules, application engine functionality, and associated platform components. Experience implementing and managing Data Lake solutions and related data management processes. Proven experience integrating applications through APIs, web services, or similar technologies. Strong SQL and data ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

validate all technical designs and implementation plans of the 3rd party SI/vendors Provide technical knowledge and understand of existing applications, data & integration configuration Own collation and delivery of Control Risks’ Non‐Functional Requirements to the project Accountable for the assurance of the technical design, system configuration … Agile environment Desirable Implementing and supporting Microsoft D365 solutions, Microsoft Power Platform solutions and Microsoft Data solutions (Data Lake, Data Factory, Data Warehouse) MS SQL DB, TSQL language, ETL, SSRS, SSIS Experience Dataverse, Common Data Services, Synapse Experience Strong ...

utilizing Azure Data Factory (ADF). ETL/ELT Development: Build and maintain seamless pipelines across SQL Server, Azure Data Lake Storage (ADLS), and Snowflake ecosystems. Automation & Frameworks: Build reusable frameworks for data onboarding, schema deployment, and validation. Automate operational processes using … role, you must have strong hands-on experience in the following areas: Core Technologies: Azure Data Factory (ADF), Azure Data Lake (ADLS), Azure SQL, and core ETL concepts. SQL Server Mastery: Advanced SQL Server development and administration skills, including hands-on experience managing SQL Server ...

utilizing Azure Data Factory (ADF). ETL/ELT Development: Build and maintain seamless pipelines across SQL Server, Azure Data Lake Storage (ADLS), and Snowflake ecosystems. Automation & Frameworks: Build reusable frameworks for data onboarding, schema deployment, and validation. Automate operational processes using … role, you must have strong hands-on experience in the following areas: Core Technologies: Azure Data Factory (ADF), Azure Data Lake (ADLS), Azure SQL, and core ETL concepts. SQL Server Mastery: Advanced SQL Server development and administration skills, including hands-on experience managing SQL Server ...

Developer to design, build, and maintain data-driven applications. You'll play a pivotal role in integrating with data lakes, lake house architectures, and enterprise databases, all while working with large-scale data systems that drive our analytics and business-critical applications. What … Develop and maintain pipelines for ingesting, transforming, and serving data across systems. Integration: Seamlessly integrate applications with data lakes and lake house platforms. Data Models: Design and implement data models for structured, semi-structured, and unstructured data. APIs & Services: Develop APIs ...