1 to 25 of 32 Data Lake Jobs in the North West

hour at peak. Job Description Dive into expansive datasets and shape the future of data infrastructure as a Data Lake Developer. The Data Engineering department builds and maintains the robust infrastructure that powers global operations. Handling vast amounts of information daily, the team … ensures data is accessible, secure and optimised for complex analytical processing. As a Data Lake Developer, you will deliver everything from large-scale transformations linked to business-critical programmes to bespoke improvements for individual users. Navigating a continually evolving technical landscape, you will collaborate with ...

Salesforce Data 360 solutions in line with approved architecture, delivery standards and user stories. You’ll create and maintain Data Lake Objects, Data Model Objects, data streams, mappings, transformation logic and customer data models. • You’ll support the implementation … least 3+ years in understanding of customer data concepts including data ingestion, data streams, Data Lake Objects, Data Model Objects, identity resolution, unified profiles, segmentation and activation. • You’ll have at least 3+ years of experience building Salesforce solutions ...

democratisation, governance maturity and AI-readiness across the firm.## **What you will be doing** * Design and maintain scalable, secure data lake and lakehouse solutions using Azure Data Lake, Databricks and Delta Lake — built to support real-time insight, advanced analytics … catch issues early and keep the platform reliable. **Key Requirements** * Experience in data engineering, including designing and delivering data lake or lakehouse architectures in an enterprise cloud environment, ideally Microsoft Azure.* Hands-on expertise with Databricks, Spark, PySpark, SQL and core Azure Data ...

using cloud-based services, focusing on Microsoft Azure technologies such as Azure Data Factory, Azure Databricks, Synapse Analytics, and Data Lake Storage. You will collaborate with clients and internal teams to understand business requirements, troubleshoot data issues, and deliver robust solutions that enhance … pipelines using Azure Data Factory and Databricks. Implement data models and analytics solutions using Synapse Analytics and Data Lake Storage. Collaborate with clients to understand their data needs and provide tailored solutions. Develop and optimise ETL/ELT processes to maintain ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

Manchester/PERMANENT/SALARY: COMPETITIVE Job Purpose Responsible for developing, maintaining and optimising MPM’s data infrastructure. Provide technical expertise to ensure efficient data handling, ensuring availability, scalability and security of the centralised data asset. Ensure that all ETL pipeline and scheduled jobs … Experience with source control and CI/CD (GitHub, Azure DevOps, DABs) Data architecting, solutions architecting and experience optimising pipelines and Delta Lake Databricks Data Engineer Professional certified #J-18808-Ljbffr ...

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

stack and evolving toward a Lakehouse and semantic layer direction. Your Core Impact Design the Lakehouse: Build and own our unified data lake foundations, focusing on scalable ingestion, lifecycle management, and optimised access patterns. Build the Semantic Layer: Implement “metrics-as-code” so KPIs like … control of their business and removing high third‐party commission fees. The Technical Essentials The Azure Specialist: Deep experience with Azure Data Lake, Azure SQL, Data Factory, and Power BI. The DataOps & DevOps Advocate: Proficient with Git, CI/CD (Azure DevOps/GitHub Actions ...

Communicate complex technical and architecturalconcepts to business and senior stakeholders in a clear, simplified manner Review and approve test strategies, functional testcases, and data validation approaches. Ability … design data architectures supporting NLP andAI‐driven analytics, including ingestion, curation, and governance ofunstructured data within Data Lake, Data warehouse platforms. Experience translating business and compliancerequirements into NLP‐enabled analytical use cases, such as: Textclassification and categorization, Entity extraction, Risk indicatoridentification ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. The Data Engineering department … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines Additional Information ...

team of strategy setting Enterprise Architects, focused on the technology enablers that support all our colleague and customer services. For example: Cloud, Infrastructure, Data and API services. We collaborate closely with business and engineering leaders across the organisation to drive strategy, deliver strategic roadmaps, provide thought leadership … utilise technology to achieve outcomes and articulate options that balance the different drivers of change. More About our Technology Enablers: Data Our data architecture team supports workloads across a wide range of data repositories including relational and NoSQL databases, data warehouses ...

Requirements Proven experience (8+ years) in data, analytics and AI platform architecture, design and delivery Expertise in Microsoft Azure data and analytics services across the data value chain, with experience selecting appropriate platform capabilities for different client needs Experience defining target architectures and roadmaps … warehouse and lakehouse ecosystems, such as Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, Azure Data Factory and Azure Data Lake Storage Gen2 Experience with Azure data integration and real-time analytics services, such as Event Hubs and Stream Analytics Experience with Microsoft ...

Head of Data Science & AI £100,000 - £125,000 plus private healthcare, company car or car allowance and more great benefits (Work Level 4) In this role you’ll split your time between working at home and our Manchester office, being in the office … join our group Data & AI team and help us unlock even greater value from our Databricks group data lake, covering all our Co-op businesses and giving you access to world leading capabilities at scale. You'll lead our data science ...

digital lives. At CityFibre, you'll be part of something bigger, helping to build a better-connected Britain, together. Joining us as a Data Solution Architect You'll play a key role in shaping and delivering CityFibre's enterprise data architecture, designing scalable data … benefits. This is some of what you can expect to be doing: Lead the end-to-end solution architecture and design of enterprise data platforms, data products, analytics and AI-enabled solutions, from initial requirements through to implementation Partner with business and technical stakeholders to understand ...

Senior Data Platform Engineer Primary location: Salford (M50 3SP) or Staines (TW18 3DZ) or London (EC2R 7HJ) Flexible/Hybrid working options. Permanent Salary Negotiable depending on experience & location 10% Bonus+ fantastic benefits Full time 37.5 hours We consider all types of flexibility, including locations, hours and working … Azure-based data solutions. Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

Reply, Inc. in Manchester is seeking a Data Engineer … design, develop and deploy data solutions on Microsoft Azure including Data Factory, Databricks, Synapse Analytics and Data Lake Storage. You will work closely with clients and internal teams to translate requirements into robust data pipelines. The role emphasises mentoring junior engineers ...

Anaplan’s forecasting solutions. The team is responsible for the production execution of forecasting and predictive models, the MLOps infrastructure supporting our data scientists, and the data processing services that deliver insights to enterprise customers. This role reports to the Director of Engineering for Predictive Intelligence … models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi-cloud experience across AWS, GCP, and Azure. Background in forecasting ...

Technopals Pte.Ltd. is seeking an experienced project professional to coordinate technical solutions and translate business requirements into data initiatives aligned with the bank's strategic objectives. You will … primary contact for stakeholders and drive progress updates. The role involves risk identification and mitigation, resource allocation, and leading enterprise-scale Data Lake and Data Warehouse initiatives, collaborating with business stakeholders to convert requirements #J-18808-Ljbffr ...

summary Data & Analytics is pivotal to the delivery of high quality efficient healthcare provision. The Analytics Team provides high quality, robust information to operational, clinical and corporate decision makers through the use of analytics solutions, primarily Power BI, including dashboards, semantic models and self-service analytics capabilities. … recognized professional body is desirable (IHRIM, AphA) Knowledge, Skills & Experience Essential Broad understanding of data engineering and processing environments including Azure Datalake, ML Ops, Data Factory and Databricks Broad understanding of current NHS, national, regional, and local context Knowledge of statistical techniques (regression, classification, decision trees ...

Sonata Software is seeking a Data … Architect for a permanent hybrid role in the UK. The candidate will lead data architecture with extensive Azure Databricks experience, including Delta Lake medallion patterns and Unity Catalog governance. You will collaborate with senior stakeholders and ensure secure data lake implementations in a Microsoft ...