1 to 25 of 34 Lakehouse Jobs in Manchester

Highly Desirable Experience in the utilities, water, or regulated infrastructure sector — understanding of operational data, compliance requirements, and safety-critical system considerations Familiarity with Lakehouse Federation in Azure Databricks — federating queries across external data sources without full ingestion Experience with Azure Data Factory or equivalent ETL/ELT tooling ...

Spark, Python or SQL - Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics ...

foundations for a secure, scalable data environment. Key responsibilities Develop and maintain batch and streaming pipelines across multiple data sources. Build the warehouse or lakehouse architecture and data models supporting reporting and analytics. Establish checks and processes for data accuracy, traceability and governance. Deliver reliable datasets for financial ...

Must-Have Skills & Experience Expert-level experience with Databricks, PySpark, SQL, and Apache Spark Strong experience designing and delivering cloud-based data platforms and lakehouse architectures Hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and performance tuning Experience building batch and streaming data pipelines Strong knowledge ...

Snowflake). Architect scalable, enterprise-grade cloud platforms across the full data lifecycle—from platform setup and ingestion to orchestration and consumption. Design modern lakehouse solutions, defining Medallion Architectures (Bronze/Silver/Gold), cross-domain data modeling, and governance standards. Define data architectures supporting Enterprise AI, Generative ...

expertise across every area listed below. We're primarily looking for strong Data & AI architecture experience across the Microsoft ecosystem. Data & Analytics Microsoft Fabric Lakehouse architecture patterns Power BI and self-service analytics Semantic modelling and reporting solutions Data platform modernisation and analytics strategy AI & Automation Agentic AI patterns ...

responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that ...

responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that ...

responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that … standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. Support the migration and re-platforming ...

A bit about us: Established in 1994, The Fragrance Shop is the UK’s leading independent fragrance retailer. Our aim is to make mainstream and luxury fragrances affordable and accessible to all. We showcase more ...

AI. Modernisation is at the heart of the role: helping customers move away from legacy data warehouses, databases and fragmented data estates towards modern lakehouse, warehouse and federated designs on platforms such as Databricks, Snowflake, Microsoft Fabric and Starburst. In a pre-sales capacity, there is a demand … define migration approaches and phased roadmaps, and identify risks, dependencies and quick wins. Data Architecture & Modelling - Design end-to-end data platform architectures, including lakehouse, warehouse, federated and data-product approaches. Apply appropriate modelling patterns such as medallion, dimensional and domain-oriented designs. Data Integration & Engineering - Design ingestion ...

responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that ...

technical credibility in relevant data engineering technologies such as SQL, Python, orchestration tools, cloud data platforms, APIs, file‐based integrations or data warehouse/lakehouse platforms What we can offer you We recognise that our people are our most important assets. That’s why we offer a flexible reward ...

analytics capabilities. Leverage SAP BTP DataSphere and SAP Analytics Cloud (SAC) to create integrated analytics solutions. Data Integration & Management Implement data integration into Fabric Lakehouse, Warehouse, and Synapse Engineering. Design and build Azure Data Factory pipelines for data ingestion and transformation. Ensure data security and governance at storage … field required. Technical Experience 5 years of progressive IT experience, with a minimum of 2 years of hands‐on experience with Microsoft Fabric (Workspace, Lakehouse, Warehouse, and Data Engineering). Proven expertise architecting solutions with SAP (ECC and S/4HANA), Microsoft Fabric, and Power BI, including a strong ...

improve data engineering, reporting and analytics, and provide senior technical leadership for data engineering delivery. Core responsibilities Lead hands-on Microsoft Fabric architecture across lakehouse, warehouse, notebooks, semantic models, Git-backed delivery and production governance. Drive migration from legacy reporting and metric tooling into a governed Fabric semantic layer … ingestion, data profiling, master-data mapping, migration QA and reporting continuity. NoSQL-to-analytics modelling, including change-feed patterns from operational databases into lakehouse or warehouse structures. GA4, BigQuery export, Google Ads/SEM feeds, Segment or other event and marketing analytics sources. Experience with Azure OpenAI, LLMs ...

stakeholder skills and confidence leading requirements sessions, challenging assumptions and explaining findings to non-technical audiences. Knowledge of Microsoft Fabric and medallion warehouse and lakehouse architecture, including Bronze, Silver and Gold layers. Ability to design Gold layer schemas and write clear, testable requirements for Data Engineering. Experience Extensive hands ...

Sonata Software is seeking a Data Architect for a permanent hybrid role in the UK. The candidate will lead data architecture with extensive Azure Databricks experience, including Delta Lake medallion patterns and Unity Catalog governance. ...

Power BI environment. Develop scalable batch and real-time data-processing solutions. Lead the design of a Customer Data Platform. Build and evolve a lakehouse architecture using AWS technologies. Create governed semantic models, consistent metrics and clear data definitions. Enable secure, self-service data analysis using modern AI tooling. … comparable platforms. AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. Infrastructure as code using Terraform. CI/CD and automated testing. Lakehouse architecture and open table formats such as Iceberg. Medallion architecture and dimensional data modelling. Strong SQL and Python. SQL Server, SSIS/SSDT ...

judgement, with the ability to balance business value, technical complexity, risk, cost and compliance considerations Practical MDM and metadata management experience, specifically Databricks/Lakehouse platform Experience providing technical leadership and influencing decisions across large-scale programmes, transformation initiatives and diverse stakeholder groups A collaborative approach, with a passion ...

environment. Develop scalable batch and real-time data-processing capabilities. Lead the design of a Customer Data Platform. Build and evolve a modern AWS lakehouse architecture. Create governed semantic models, consistent metrics and clear data definitions. Enable secure, self-service data analysis through modern AI tools. Automate manual, repetitive … streaming technologies such as Flink or comparable platforms. Production AWS data engineering. AWS services including S3, Lambda, Glue, Athena, Kinesis, RDS, IAM and CloudWatch. Lakehouse architectures and open table formats such as Iceberg. Medallion-style data layering and dimensional modelling. Strong SQL and Python development skills. Infrastructure as code ...

data products, data flows, integration patterns, metadata and data lifecycle management. 2. Data platform and solution design Design scalable cloud data platforms and lakehouse solutions using Microsoft Fabric, OneLake, Azure Data Factory, Azure Databricks, Azure Synapse and related Azure services. Define approaches for batch and real-time data ingestion … Strong data modelling capability across conceptual, logical and physical models, including dimensional modelling, data vault or comparable approaches. Experience designing data integration, data migration, lakehouse or enterprise data platform solutions across multiple systems and data domains. Experience with data governance, metadata, lineage, data quality, master data and reference data ...

Canopius is seeking an experienced Data Engineer lead in Manchester to drive the next generation of its data estate. You will mentor junior engineers, deliver scalable PySpark pipelines on Databricks, and collaborate with product owners ...

profiling, lineage and 'AI-readiness' health checks that establish the baseline for AI adoption. Modern data platform – Microsoft Fabric, Azure Synapse/Databricks, data lakehouse and warehouse design, migration and modernisation from legacy platforms. Data engineering and integration – ingestion pipelines, ETL/ELT modernisation, master data management, unstructured content … readiness and AI. What we expect of you Demonstrable knowledge of the Data & AI landscape – modern data platforms (Microsoft Fabric, Azure Synapse, Databricks, data lakehouse/warehouse), data engineering and integration, and analytics (Power BI). Knowledge of data governance, data quality and data management disciplines – cataloguing, lineage, master ...

Data & AI practice. You will design modern data platforms for secure, scalable, and cost-efficient data foundations supporting analytics and AI, including lakehouse and federated architectures on Databricks, Snowflake, Fabric and Starburst. The role requires strong pre-sales capability, customer engagement with data stakeholders, and the ability to translate ...

doing: Technical leadership Defining and owning the data engineering architecture patterns CreateFuture uses across client engagements — migration frameworks, streaming architectures, data integrity standards, and Lakehouse design Acting as the most senior technical authority on client engagements — making critical architecture decisions, resolving design disputes, and setting the bar for quality ...