1 to 25 of 31 Data Lake Jobs in Manchester

hour at peak. Job Description Dive into expansive datasets and shape the future of data infrastructure as a Data Lake Developer. The Data Engineering department builds and maintains the robust infrastructure that powers global operations. Handling vast amounts of information daily, the team … ensures data is accessible, secure and optimised for complex analytical processing. As a Data Lake Developer, you will deliver everything from large-scale transformations linked to business-critical programmes to bespoke improvements for individual users. Navigating a continually evolving technical landscape, you will collaborate with ...

Salesforce Data 360 solutions in line with approved architecture, delivery standards and user stories. You’ll create and maintain Data Lake Objects, Data Model Objects, data streams, mappings, transformation logic and customer data models. • You’ll support the implementation … least 3+ years in understanding of customer data concepts including data ingestion, data streams, Data Lake Objects, Data Model Objects, identity resolution, unified profiles, segmentation and activation. • You’ll have at least 3+ years of experience building Salesforce solutions ...

democratisation, governance maturity and AI-readiness across the firm.## **What you will be doing** * Design and maintain scalable, secure data lake and lakehouse solutions using Azure Data Lake, Databricks and Delta Lake — built to support real-time insight, advanced analytics … catch issues early and keep the platform reliable. **Key Requirements** * Experience in data engineering, including designing and delivering data lake or lakehouse architectures in an enterprise cloud environment, ideally Microsoft Azure.* Hands-on expertise with Databricks, Spark, PySpark, SQL and core Azure Data ...

using cloud-based services, focusing on Microsoft Azure technologies such as Azure Data Factory, Azure Databricks, Synapse Analytics, and Data Lake Storage. You will collaborate with clients and internal teams to understand business requirements, troubleshoot data issues, and deliver robust solutions that enhance … pipelines using Azure Data Factory and Databricks. Implement data models and analytics solutions using Synapse Analytics and Data Lake Storage. Collaborate with clients to understand their data needs and provide tailored solutions. Develop and optimise ETL/ELT processes to maintain ...

workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets … Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring ...

workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets … Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

Manchester/PERMANENT/SALARY: COMPETITIVE Job Purpose Responsible for developing, maintaining and optimising MPM’s data infrastructure. Provide technical expertise to ensure efficient data handling, ensuring availability, scalability and security of the centralised data asset. Ensure that all ETL pipeline and scheduled jobs … Experience with source control and CI/CD (GitHub, Azure DevOps, DABs) Data architecting, solutions architecting and experience optimising pipelines and Delta Lake Databricks Data Engineer Professional certified #J-18808-Ljbffr ...

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

stack and evolving toward a Lakehouse and semantic layer direction. Your Core Impact Design the Lakehouse: Build and own our unified data lake foundations, focusing on scalable ingestion, lifecycle management, and optimised access patterns. Build the Semantic Layer: Implement “metrics-as-code” so KPIs like … control of their business and removing high third‐party commission fees. The Technical Essentials The Azure Specialist: Deep experience with Azure Data Lake, Azure SQL, Data Factory, and Power BI. The DataOps & DevOps Advocate: Proficient with Git, CI/CD (Azure DevOps/GitHub Actions ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. The Data Engineering department … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines Additional Information ...

team of strategy setting Enterprise Architects, focused on the technology enablers that support all our colleague and customer services. For example: Cloud, Infrastructure, Data and API services. We collaborate closely with business and engineering leaders across the organisation to drive strategy, deliver strategic roadmaps, provide thought leadership … utilise technology to achieve outcomes and articulate options that balance the different drivers of change. More About our Technology Enablers: Data Our data architecture team supports workloads across a wide range of data repositories including relational and NoSQL databases, data warehouses ...

Requirements Proven experience (8+ years) in data, analytics and AI platform architecture, design and delivery Expertise in Microsoft Azure data and analytics services across the data value chain, with experience selecting appropriate platform capabilities for different client needs Experience defining target architectures and roadmaps … warehouse and lakehouse ecosystems, such as Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, Azure Data Factory and Azure Data Lake Storage Gen2 Experience with Azure data integration and real-time analytics services, such as Event Hubs and Stream Analytics Experience with Microsoft ...

Head of Data Science & AI £100,000 - £125,000 plus private healthcare, company car or car allowance and more great benefits (Work Level 4) In this role you’ll split your time between working at home and our Manchester office, being in the office … join our group Data & AI team and help us unlock even greater value from our Databricks group data lake, covering all our Co-op businesses and giving you access to world leading capabilities at scale. You'll lead our data science ...

Cyber , you will: Key accountabilities Own the operational stability, resilience and performance of infrastructure, cloud, network and workplace technology services. Own data lake and Fabric infrastructure, including platform foundations, storage, compute and operational resilience. Lead infrastructure engineering, cloud services, network services, hosting and platform operations. … measures Improved service stability, availability and operational resilience. Reduced severity and recurrence of major incidents. Effective ITSM adoption and service reporting. Data lake infrastructure available and scalable to support data engineering and analytics needs. Security operations are effective and aligned to CISO standards. What ...

digital lives. At CityFibre, you'll be part of something bigger, helping to build a better-connected Britain, together. Joining us as a Data Solution Architect You'll play a key role in shaping and delivering CityFibre's enterprise data architecture, designing scalable data … benefits. This is some of what you can expect to be doing: Lead the end-to-end solution architecture and design of enterprise data platforms, data products, analytics and AI-enabled solutions, from initial requirements through to implementation Partner with business and technical stakeholders to understand ...

Senior Data Platform Engineer Primary location: Salford (M50 3SP) or Staines (TW18 3DZ) or London (EC2R 7HJ) Flexible/Hybrid working options. Permanent Salary Negotiable depending on experience & location 10% Bonus+ fantastic benefits Full time 37.5 hours We consider all types of flexibility, including locations, hours and working … Azure-based data solutions. Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

Reply, Inc. in Manchester is seeking a Data Engineer … design, develop and deploy data solutions on Microsoft Azure including Data Factory, Databricks, Synapse Analytics and Data Lake Storage. You will work closely with clients and internal teams to translate requirements into robust data pipelines. The role emphasises mentoring junior engineers ...

Anaplan’s forecasting solutions. The team is responsible for the production execution of forecasting and predictive models, the MLOps infrastructure supporting our data scientists, and the data processing services that deliver insights to enterprise customers. This role reports to the Director of Engineering for Predictive Intelligence … models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi-cloud experience across AWS, GCP, and Azure. Background in forecasting ...

summary Data & Analytics is pivotal to the delivery of high quality efficient healthcare provision. The Analytics Team provides high quality, robust information to operational, clinical and corporate decision makers through the use of analytics solutions, primarily Power BI, including dashboards, semantic models and self-service analytics capabilities. … recognized professional body is desirable (IHRIM, AphA) Knowledge, Skills & Experience Essential Broad understanding of data engineering and processing environments including Azure Datalake, ML Ops, Data Factory and Databricks Broad understanding of current NHS, national, regional, and local context Knowledge of statistical techniques (regression, classification, decision trees ...