201 to 225 of 258 Permanent Data Lake Jobs

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

starter to serve as an ADVANA Developer supporting the Southern Command Operations, Planning, and Engagement Support (SCOPES) program. This position will reside in the Office of the Chief Data Officer as part of a project spanning various development, data science, and knowledge management functions. This position requires a strong background in software development, data engineering principles, and cloud technologies. The ADVANA Developer will contribute to building and enhancing capabilities that enable data-driven decision-making for SOUTHCOM. Responsibilities: • Design and Development: Participate in the full software development lifecycle, including requirements gathering, system design, development, testing, and deployment of applications and data pipelines within the ADVANA environment. • Data Engineering: Develop and maintain robust and scalable data pipelines to ingest, transform, cleanse, and integrate data from various DoD source systems into the ADVANA data lake. • Cloud Technologies: Utilize and contribute to the development within ADVANA's cloud based architecture, leveraging cloud-native services for data storage, processing, and analytics. More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

1. (Mandatory) Demonstrated experience in data architecture. 2. (Mandatory) Demonstrated experience with and understanding of database structure principles 3. (Mandatory) Demonstrated experience in data modeling and design, including SQL development and database administration. 4. (Mandatory) Demonstrated experience in data visualization, data migration and data modeling. 5. (Mandatory) Demonstrated experience in … relational database management systems (DBMS). 6. (Mandatory) Demonstrated experience in DBMS software, including SQL Server. 7. (Mandatory) Demonstrated experience in database and cloud computing design, architectures and data lakes. 8. (Mandatory) Demonstrated experience in configuration and administration of enterprise level data stores, ETL and ELT methods, and batch and streaming data transport. 9. More ❯

Data Management Developer Lead page is loaded Data Management Developer Leadlocations: Londontime type: Full timeposted on: Posted Todayjob requisition id: RThe purpose of this role is to oversee the development of our database marketing solutions, using database technologies such as Microsoft SQL Server/Azure, Amazon Redshift, Google BigQuery. The role will be involved in design … the company has put people at the heart of its approach to digital business transformation. As the only integrated experience consultancy in the world with a heritage in data science and business performance, Merkle delivers holistic, end-to-end experiences that drive growth, engagement, and loyalty. Merkle's expertise has earned recognition as a "Leader" by top industry … analyst firms, in categories such as digital transformation and commerce, experience design, engineering and technology integration, digital marketing, data science, CRM and loyalty, and customer data management. With more than 16,000 employees, Merkle operates in 30+ countries throughout the Americas, EMEA, and APAC. For more information, visit . Role Purpose The purpose of this role More ❯

Lead DevOps Engineer – Azure Data Platform 6-Month Contract Hybrid – Newcastle or Leeds £450–£500 Inside IR35 We are seeking a Lead DevOps Engineer to take ownership of our Microsoft Azure Data Platform strategy and lead a team of engineers in delivering high-quality, scalable solutions. This is a hands-on leadership role, combining technical expertise … with the ability to mentor, manage, and inspire a growing DevOps capability. Key Responsibilities: Lead and Manage a team of DevOps and Data Engineers, providing direction, mentorship, and performance support. Drive the development, support, and optimisation of solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design and oversee Infrastructure and … Skills & Experience: Proven experience leading and managing engineering teams, including mentoring and developing team members. Extensive hands-on experience with Microsoft Azure services (ADF, Synapse Analytics, Data Lake). Proficiency with Infrastructure as Code (Terraform). Strong background with CI/CD pipelines (GitLab CI preferred, Azure DevOps considered). Experience delivering cloud-based solutions in agile More ❯

and innovation. You will also foster close working relationships with Microsoft on current and emerging new product features. Main responsibilities: Design customer-centric solutions considering all systems and data impacts, with a strong focus on standardisation and to minimise customisations Conduct Fit/Gap Analysis and identify technical solutions for gaps ensuring design consistency cross domain across Finance … will bring: Proven experience designing and implementing technical architectures for Dynamics 365 F&O solutions. Familiarity with enterprise architecture frameworks is a plus Experience in working with Common Data Services (Dual Write) for integration with Dynamics 365 for sales and Field services Solid experience with integrating Dynamics 365 F&O with other systems using tools such as Data … scale enterprise implementations Strong client leadership and engagement skills up to C-level Knowledge of emerging Microsoft technologies; Azure Cloud Platform, Power Bi, PowerApps, Flow, Azure Data Lake, DevOps, RSAT Intellectual curiosity, especially around emerging enterprise technologies Requirements Microsoft Dynamics 365 F&O certifications (e.g., Dynamics 365 Finance and Operations Core, Dynamics 365 Finance, Dynamics 365 Supply More ❯

join our software group and help build the next generation AI-driven scientific platform. In this role, you will design, build, and optimize backend systems that power intelligent, data-driven applications. You will focus on creating high-performance APIs, architecting scalable data management tooling, and ensuring the reliability of services that integrate advanced AI frameworks with … You'll work closely with ML researchers, platform engineers, and scientists to develop systems that can handle diverse workloads and scale seamlessly, including structured SQL database, data lake houses, and vector databases. This is an opportunity to apply your deep backend expertise to a cutting-edge AI platform with real scientific impact. If you are passionate about … Building Design & Build APIs: Design and build high-performance, secure, and well-documented APIs that integrate with AI-driven applications. Database Architecture & Scaling: Architect schemas and manage diverse data systems (SQL, NoSQL, Vector DBs, and others) for optimal performance and scalability. Backend Systems Development: Drive the implementation of backend services, focusing on performance, maintainability, and reliability. Performance & Reliability More ❯

Hubs, Event Grid). Experience building APIs/microservices with Azure tools (Functions, APIM, Web Apps). Knowledge of Azure data services (SQL, Storage, Data Lake, Cosmos DB). Track record of leading development and mentoring others. Strong communication skills, able to engage both technical and non-technical stakeholders. Experience working in agile teams. Desirable More ❯

document (FDD) development. Define and evaluate functional and non-functional requirements. Create development design specifications. Set up applications, system configurations for, and conduct, Fit Gap Analysis, Conduct functional, data acceptance and process testing, Develop test plans, execute functional and user acceptance testing, and identify and resolve issue, Functional installation, configuration, and user acceptance testing, Key user training, go … deliver comprehensive training sessions to end users on the implemented D365 F&O functionalities. Previous experience implementing Dynamics finance modules in a multi-company environment Experience using the Data Management Framework. Good documentation, communication, and presentation skills Creating functional requirements documents and presenting them to Stakeholders, Business Leads and Subject Matter Experts for signoff Providing key inputs during … and administrator training Skills: Dynamics 365 certifications. Understanding of integrations and third-party solutions. Knowledge of Related Microsoft technologies such as PowerBI, Azure Logic Apps, Azure Data Lake, Power Platform and Microsoft SQL. An understanding of the broader Microsoft stack and be able to leverage it to create powerful solutions (PowerApps, Common Data Services) and More ❯

31st December 2025 Day Rate: £579.70 (Inside IR35) Start Date: ASAP Role Overview We are seeking an experienced ETL Tester Lead to take ownership of testing activities across data, ETL, and visualisation projects within a fast-paced environment. The successful candidate will play a key role in ensuring high-quality delivery through the design, execution, and automation of … execution of testing activities, including test automation. Contribute to quality assurance processes across planning, execution, defect reporting, and problem resolution. Skills & Experience Required Proven expertise in ETL and data warehouse testing, including ETL/ELT processes. Strong proficiency in SQL scripting, including writing and executing complex queries. Hands-on experience with structured and unstructured data testing. … Good understanding of Azure data services , including Data Factory, Databricks, Synapse (Azure SQL DW), Cosmos DB, and Azure Data Lake. Knowledge of data testing concepts and best practices within data warehouse environments. Hands-on experience with Python/PySpark scripting for test development. Exposure to data testing automation More ❯

days on-site) £40,000 £50,000 + benefits Were partnered with a fast-growing technology business that is undergoing a major transformation programme to modernise its data and analytics capabilities. Theyre looking for a Business Intelligence Developer who can play a key role in shaping the way data is used across the organisation. This is … an opportunity to get involved in a large-scale, complex data environment and make a tangible impact on how insights drive decision-making at a global level. What youll be doing Designing and developing Power BI dashboards and reports that provide meaningful insight and data storytelling for senior stakeholders. Working with large, complex datasets from multiple … sources, ensuring they are queried, modelled, and optimised for reporting. Collaborating with engineers and analysts to develop data pipelines and models that feed enterprise-level reporting solutions. Supporting the ongoing transformation programme , helping to break down legacy reporting structures and introduce modern BI practices. Partnering closely with commercial, finance, and operational teams to ensure reporting is aligned with More ❯

focus on stabilising the financial planning cycle, followed by implementing a scalable forecasting tool to support long-term growth. You will play a pivotal role in building robust, data-driven insights to support strategic decision-making, while ensuring that the FP&A function is positioned for sustainable and autonomous success in the future. Key Responsibilities … Deliver a financial forecast model for FY26 and beyond, supporting the FY27–FY31 Business Plan. Design, recommend, and implement a scalable forecasting solution, leveraging the existing data lake infrastructure. Drive KPI reporting and forecasting across multiple areas: Marketplace: Revenue & margin analysis, acquisition data integration, pipeline analysis, tech spend, overheads, headcount, and scenario modelling. Experiences: Weekly … Capex integration from SAP/Ariba, and scenario modelling. Central: Employee and non-employee costs, below EBITDA items, Capex, cashflow, and balance sheet reporting. Partner with finance, IT, data, and operations to deliver automated planning models and reporting dashboards. Provide in-depth cost analysis, financial simulations, and scenario modelling to support transformation initiatives. Ensure alignment and transparency in More ❯

focus on stabilising the financial planning cycle, followed by implementing a scalable forecasting tool to support long-term growth. You will play a pivotal role in building robust, data-driven insights to support strategic decision-making, while ensuring that the FP&A function is positioned for sustainable and autonomous success in the future. Key Responsibilities … Deliver a financial forecast model for FY26 and beyond, supporting the FY27–FY31 Business Plan. Design, recommend, and implement a scalable forecasting solution, leveraging the existing data lake infrastructure. Drive KPI reporting and forecasting across multiple areas: Marketplace: Revenue & margin analysis, acquisition data integration, pipeline analysis, tech spend, overheads, headcount, and scenario modelling. Experiences: Weekly … Capex integration from SAP/Ariba, and scenario modelling. Central: Employee and non-employee costs, below EBITDA items, Capex, cashflow, and balance sheet reporting. Partner with finance, IT, data, and operations to deliver automated planning models and reporting dashboards. Provide in-depth cost analysis, financial simulations, and scenario modelling to support transformation initiatives. Ensure alignment and transparency in More ❯

focus on stabilising the financial planning cycle, followed by implementing a scalable forecasting tool to support long-term growth. You will play a pivotal role in building robust, data-driven insights to support strategic decision-making, while ensuring that the FP&A function is positioned for sustainable and autonomous success in the future. Key Responsibilities … Deliver a financial forecast model for FY26 and beyond, supporting the FY27–FY31 Business Plan. Design, recommend, and implement a scalable forecasting solution, leveraging the existing data lake infrastructure. Drive KPI reporting and forecasting across multiple areas: Marketplace: Revenue & margin analysis, acquisition data integration, pipeline analysis, tech spend, overheads, headcount, and scenario modelling. Experiences: Weekly … Capex integration from SAP/Ariba, and scenario modelling. Central: Employee and non-employee costs, below EBITDA items, Capex, cashflow, and balance sheet reporting. Partner with finance, IT, data, and operations to deliver automated planning models and reporting dashboards. Provide in-depth cost analysis, financial simulations, and scenario modelling to support transformation initiatives. Ensure alignment and transparency in More ❯

a large, well-known organisation who are a reputable force within their industry. Your new role You will be responsible for the delivery, integration, and operation of IT data services aligned with business strategy, compliance standards, and technical architecture. Partner with business stakeholders to deliver IT services aligned with strategic goals. Lead planning and integration of data solutions and application environments. Ensure operational excellence using ITIL and ISO27001 standards. Collaborate globally to define data and architecture standards. Manage vendor performance and service levels. Champion data governance and compliance across the UK organisation. Oversee budgets, resource planning, and delivery timelines. Lead and develop a high-performing IT data management team. … Identify and mitigate risks to ensure compliance with group policies. What you'll need to succeed Experience in IT consulting and service delivery. Strong knowledge of data engineering, Azure Data Factory & Data Lake. Experience with Agile and automation technologies. Proven leadership in managing teams and third-party vendors. Excellent communication, strategic thinking, and problem More ❯

a large, well-known organisation who are a reputable force within their industry. Your new role You will be responsible for the delivery, integration, and operation of IT data services aligned with business strategy, compliance standards, and technical architecture. Partner with business stakeholders to deliver IT services aligned with strategic goals. Lead planning and integration of data solutions and application environments. Ensure operational excellence using ITIL and ISO27001 standards. Collaborate globally to define data and architecture standards. Manage vendor performance and service levels. Champion data governance and compliance across the UK organisation. Oversee budgets, resource planning, and delivery timelines. Lead and develop a high-performing IT data management team. … Identify and mitigate risks to ensure compliance with group policies. What you'll need to succeed Experience in IT consulting and service delivery. Strong knowledge of data engineering, Azure Data Factory & Data Lake. Experience with Agile and automation technologies. Proven leadership in managing teams and third-party vendors. Excellent communication, strategic thinking, and problem More ❯

Azure. Designing, configuring and using IaaS services (like VM, Azure Kubernetes Services, networking, storage). Designing, configuring and using PaaS services (like WebApp, Database services, Kubernetes, Data Lake, Databricks etc.). Proven experience working in Azure DevOps. Extensive knowledge in cloud based data integration patterns and architectures. Troubleshooting complex scenarios related to an Application Deployment. More ❯

to Quality Assurance processes including planning, testing, defect reporting, and resolution. Work within Agile development methodologies, contributing to sprints and ceremonies. Your Profile Strong expertise in ETL and Data Warehouse (DW) testing, including ELT processes. Proficient in SQL scripting, writing complex queries, and test script development. Experience with structured and unstructured data testing. Hands-on knowledge … of Azure data services like Data Factory, Databricks, Synapse, Cosmos DB, and Data Lake. Familiarity with data testing automation tools and frameworks. Domain knowledge in Insurance is a plus. Skilled in Python and PySpark for scripting and automation. Excellent written and verbal communication skills for effective collaboration. About Capgemini Capgemini is a … needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion. Get The Future You Want More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯

point-to-site and site-to-site for high secure VPN connectivity from end user’s device and Sizewell C various offices and sites. Configuration of Data Lake storage, ensuring security hardening. Compliance of backup and restoration. Integration of IAAS, PAAS and SAAS application with Microsoft Entra ID (AAD) for secure access through SAML SSO. Maintain the More ❯