176 to 200 of 249 Permanent Data Lake Jobs

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions. You will lead one of … our data engineering teams, setting technical standards, reviewing code, and ensuring high-quality delivery across projects. Key Responsibilities Design, build and maintain scalable data architectures and pipelines. Implement and manage data warehouses and data lakes, ensuring data security, durability and accessibility. Develop data processing and analysis algorithms to … handle complex, large-scale datasets. Collaborate with data scientists to support machine learning model deployment. Lead and mentor a team of data engineers, setting coding standards and driving best practices. Partner with senior stakeholders to align data solutions with business strategy. Manage risk and ensure compliance with governance and control frameworks. Contribute to strategic More ❯

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions. You will lead one of … our data engineering teams, setting technical standards, reviewing code, and ensuring high-quality delivery across projects. Key Responsibilities Design, build and maintain scalable data architectures and pipelines. Implement and manage data warehouses and data lakes, ensuring data security, durability and accessibility. Develop data processing and analysis algorithms to … handle complex, large-scale datasets. Collaborate with data scientists to support machine learning model deployment. Lead and mentor a team of data engineers, setting coding standards and driving best practices. Partner with senior stakeholders to align data solutions with business strategy. Manage risk and ensure compliance with governance and control frameworks. Contribute to strategic More ❯

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions. You will lead one of … our data engineering teams, setting technical standards, reviewing code, and ensuring high-quality delivery across projects. Key Responsibilities Design, build and maintain scalable data architectures and pipelines. Implement and manage data warehouses and data lakes, ensuring data security, durability and accessibility. Develop data processing and analysis algorithms to … handle complex, large-scale datasets. Collaborate with data scientists to support machine learning model deployment. Lead and mentor a team of data engineers, setting coding standards and driving best practices. Partner with senior stakeholders to align data solutions with business strategy. Manage risk and ensure compliance with governance and control frameworks. Contribute to strategic More ❯

your career to the next level in the exciting world of finance? Our client, a leading organisation in the financial sector, is seeking a talented Microsoft SQL DBA & Data Developer to join their dynamic Data Services team. This is an incredible opportunity to make a significant impact on data environments, drive transformation, and innovate … within a supportive and flexible work culture! Position: Microsoft SQL DBA & Data Developer Contract Type: Permanent Annual Salary: £45,000 - £52,000 Working Pattern: Full Time Location: Leicester/Hybrid Working Available Job Purpose: As a Microsoft DBA & Data Developer, this role will be 70 percent DBA and 30 percnet Development. You will be at the … heart of maintaining and evolving my client's data environments, both traditional MS SQL Server and cutting-edge Azure Data Services. You'll manage system security, support data delivery projects, and engage in transformative initiatives that shape the future of data. Key Responsibilities: Oversee daily management and maintenance of data systems. Ensure More ❯

daily to our panel of over 24 million registered members to understand opinion and behaviors around the world. We have a strong reputation as a source of accurate data and we're trusted by the world's biggest brands to get it right, making us the most quoted market research source in the world. With operations in the … India and Asia Pacific, YouGov has one of the world's largest research networks. About Brandindex BrandIndex is YouGov's flagship brand intelligence platform that transforms consumer survey data into insights for businesses: it monitors thousands of brands globally to deliver a comprehensive view of brand health. Through continuous data collection and analysis, BrandIndex enables customers … and MySQL Exposure to Docker, Kubernetes, AWS, Helm, Terraform, Vault, Grafana, ELK Stack, New Relic Relevant experience in the maintenance of data APIs and data lake architectures, including experience with Apache Iceberg, Trino/Presto, Clickhouse, Snowflake, BigQuery. Master's degree in Computer Science or Engineering-related field Get to know us better YouGov is More ❯

Software Engineer - Core Financial Analytics Location New York Business Area Engineering and CTO Ref # Description & Requirements The Core Financial Analytics team provides the foundational pricing, analytics, and data infrastructure that powers Bloomberg's markets business. The group delivers cross-asset solutions for curves, volatility surfaces, consensus pricing, screening tools, and listed derivatives, ensuring that clients and internal … systems have access to accurate, transparent, and real-time market data. The CFA department is made up of four specialized teams : The Market Data Analytics team delivers high-performance, cross-asset market data systems that power critical pricing, risk, and analytics for Bloomberg's Terminal and Enterprise clients. The team builds scalable, adaptable platforms that transform … producing real-time FX rates and fair values for commodities such as oil, gas, metals, and agricultural products. Leveraging modern C+, advanced algorithms, and a robust data lake ecosystem, the team delivers transparent, accurate, and high-quality pricing that powers trading, valuation, risk management, and regulatory workflows worldwide. The Futures & Options (F&O) team empowers key market More ❯

the end-to-end architecture for AI/ML solutions on Azure, from concept and design to deployment. Develop high-level solution designs that integrate with clients' existing data platforms and infrastructure. Client Engagement: Work closely with enterprise clients to understand business challenges and identify opportunities where AI/ML can drive value (e.g. predictive maintenance in manufacturing … modeling in insurance). Translate these needs into solution roadmaps and technical plans. Technical Leadership: Provide hands-on technical leadership to delivery teams. Guide Azure AI Engineers and Data Engineers in implementing best practices for data preparation, model development, and cloud deployment. Mentor team members in advanced AI techniques and review designs/code to ensure … suitable for junior candidates ). Azure Expertise: Deep hands-on knowledge of Azure data and AI services - including Azure Machine Learning, Azure Databricks, Azure Data Lake/Synapse, Azure Cognitive Services (Text, Vision, Speech), Azure OpenAI and Azure AI Foundry. Ability to architect solutions that leverage these services cohesively. Architectural Skills: Strong skills in system More ❯

the end-to-end architecture for AI/ML solutions on Azure, from concept and design to deployment. Develop high-level solution designs that integrate with clients' existing data platforms and infrastructure. Client Engagement: Work closely with enterprise clients to understand business challenges and identify opportunities where AI/ML can drive value (e.g. predictive maintenance in manufacturing … modeling in insurance). Translate these needs into solution roadmaps and technical plans. Technical Leadership: Provide hands-on technical leadership to delivery teams. Guide Azure AI Engineers and Data Engineers in implementing best practices for data preparation, model development, and cloud deployment. Mentor team members in advanced AI techniques and review designs/code to ensure … suitable for junior candidates ). Azure Expertise: Deep hands-on knowledge of Azure data and AI services - including Azure Machine Learning, Azure Databricks, Azure Data Lake/Synapse, Azure Cognitive Services (Text, Vision, Speech), Azure OpenAI and Azure AI Foundry. Ability to architect solutions that leverage these services cohesively. Architectural Skills: Strong skills in system More ❯

the end-to-end architecture for AI/ML solutions on Azure, from concept and design to deployment. Develop high-level solution designs that integrate with clients' existing data platforms and infrastructure. Client Engagement: Work closely with enterprise clients to understand business challenges and identify opportunities where AI/ML can drive value (e.g. predictive maintenance in manufacturing … modeling in insurance). Translate these needs into solution roadmaps and technical plans. Technical Leadership: Provide hands-on technical leadership to delivery teams. Guide Azure AI Engineers and Data Engineers in implementing best practices for data preparation, model development, and cloud deployment. Mentor team members in advanced AI techniques and review designs/code to ensure … suitable for junior candidates ). Azure Expertise: Deep hands-on knowledge of Azure data and AI services - including Azure Machine Learning, Azure Databricks, Azure Data Lake/Synapse, Azure Cognitive Services (Text, Vision, Speech), Azure OpenAI and Azure AI Foundry. Ability to architect solutions that leverage these services cohesively. Architectural Skills: Strong skills in system More ❯

Involvement in school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. Skilled in technical writing. Competence in More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

starter to serve as an ADVANA Developer supporting the Southern Command Operations, Planning, and Engagement Support (SCOPES) program. This position will reside in the Office of the Chief Data Officer as part of a project spanning various development, data science, and knowledge management functions. This position requires a strong background in software development, data engineering principles, and cloud technologies. The ADVANA Developer will contribute to building and enhancing capabilities that enable data-driven decision-making for SOUTHCOM. Responsibilities: • Design and Development: Participate in the full software development lifecycle, including requirements gathering, system design, development, testing, and deployment of applications and data pipelines within the ADVANA environment. • Data Engineering: Develop and maintain robust and scalable data pipelines to ingest, transform, cleanse, and integrate data from various DoD source systems into the ADVANA data lake. • Cloud Technologies: Utilize and contribute to the development within ADVANA's cloud based architecture, leveraging cloud-native services for data storage, processing, and analytics. More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

1. (Mandatory) Demonstrated experience in data architecture. 2. (Mandatory) Demonstrated experience with and understanding of database structure principles 3. (Mandatory) Demonstrated experience in data modeling and design, including SQL development and database administration. 4. (Mandatory) Demonstrated experience in data visualization, data migration and data modeling. 5. (Mandatory) Demonstrated experience in … relational database management systems (DBMS). 6. (Mandatory) Demonstrated experience in DBMS software, including SQL Server. 7. (Mandatory) Demonstrated experience in database and cloud computing design, architectures and data lakes. 8. (Mandatory) Demonstrated experience in configuration and administration of enterprise level data stores, ETL and ELT methods, and batch and streaming data transport. 9. More ❯

Data Management Developer Lead page is loaded Data Management Developer Leadlocations: Londontime type: Full timeposted on: Posted Todayjob requisition id: RThe purpose of this role is to oversee the development of our database marketing solutions, using database technologies such as Microsoft SQL Server/Azure, Amazon Redshift, Google BigQuery. The role will be involved in design … the company has put people at the heart of its approach to digital business transformation. As the only integrated experience consultancy in the world with a heritage in data science and business performance, Merkle delivers holistic, end-to-end experiences that drive growth, engagement, and loyalty. Merkle's expertise has earned recognition as a "Leader" by top industry … analyst firms, in categories such as digital transformation and commerce, experience design, engineering and technology integration, digital marketing, data science, CRM and loyalty, and customer data management. With more than 16,000 employees, Merkle operates in 30+ countries throughout the Americas, EMEA, and APAC. For more information, visit . Role Purpose The purpose of this role More ❯

and innovation. You will also foster close working relationships with Microsoft on current and emerging new product features. Main responsibilities: Design customer-centric solutions considering all systems and data impacts, with a strong focus on standardisation and to minimise customisations Conduct Fit/Gap Analysis and identify technical solutions for gaps ensuring design consistency cross domain across Finance … will bring: Proven experience designing and implementing technical architectures for Dynamics 365 F&O solutions. Familiarity with enterprise architecture frameworks is a plus Experience in working with Common Data Services (Dual Write) for integration with Dynamics 365 for sales and Field services Solid experience with integrating Dynamics 365 F&O with other systems using tools such as Data … scale enterprise implementations Strong client leadership and engagement skills up to C-level Knowledge of emerging Microsoft technologies; Azure Cloud Platform, Power Bi, PowerApps, Flow, Azure Data Lake, DevOps, RSAT Intellectual curiosity, especially around emerging enterprise technologies Requirements Microsoft Dynamics 365 F&O certifications (e.g., Dynamics 365 Finance and Operations Core, Dynamics 365 Finance, Dynamics 365 Supply More ❯

join our software group and help build the next generation AI-driven scientific platform. In this role, you will design, build, and optimize backend systems that power intelligent, data-driven applications. You will focus on creating high-performance APIs, architecting scalable data management tooling, and ensuring the reliability of services that integrate advanced AI frameworks with … You'll work closely with ML researchers, platform engineers, and scientists to develop systems that can handle diverse workloads and scale seamlessly, including structured SQL database, data lake houses, and vector databases. This is an opportunity to apply your deep backend expertise to a cutting-edge AI platform with real scientific impact. If you are passionate about … Building Design & Build APIs: Design and build high-performance, secure, and well-documented APIs that integrate with AI-driven applications. Database Architecture & Scaling: Architect schemas and manage diverse data systems (SQL, NoSQL, Vector DBs, and others) for optimal performance and scalability. Backend Systems Development: Drive the implementation of backend services, focusing on performance, maintainability, and reliability. Performance & Reliability More ❯

Hubs, Event Grid). Experience building APIs/microservices with Azure tools (Functions, APIM, Web Apps). Knowledge of Azure data services (SQL, Storage, Data Lake, Cosmos DB). Track record of leading development and mentoring others. Strong communication skills, able to engage both technical and non-technical stakeholders. Experience working in agile teams. Desirable More ❯

document (FDD) development. Define and evaluate functional and non-functional requirements. Create development design specifications. Set up applications, system configurations for, and conduct, Fit Gap Analysis, Conduct functional, data acceptance and process testing, Develop test plans, execute functional and user acceptance testing, and identify and resolve issue, Functional installation, configuration, and user acceptance testing, Key user training, go … deliver comprehensive training sessions to end users on the implemented D365 F&O functionalities. Previous experience implementing Dynamics finance modules in a multi-company environment Experience using the Data Management Framework. Good documentation, communication, and presentation skills Creating functional requirements documents and presenting them to Stakeholders, Business Leads and Subject Matter Experts for signoff Providing key inputs during … and administrator training Skills: Dynamics 365 certifications. Understanding of integrations and third-party solutions. Knowledge of Related Microsoft technologies such as PowerBI, Azure Logic Apps, Azure Data Lake, Power Platform and Microsoft SQL. An understanding of the broader Microsoft stack and be able to leverage it to create powerful solutions (PowerApps, Common Data Services) and More ❯