26 to 50 of 75 Lakehouse Jobs in the North of England

including building pipelines and working with data storage and transformation. You'll also bring strong SQL, Python and data modelling skills, an understanding of lakehouse and warehouse approaches, and experience preparing data for Power BI. You should be comfortable taking ownership, explaining your decisions and sharing your knowledge with ...

someone who wants to move away from development into pure management. You'll work across: Python/PySpark Microsoft Fabric Spark and notebook engineering Lakehouse/Medallion architecture Delta SQL Azure Git/CI/CD Automated testing Data quality and observability Reusable engineering patterns They're particularly interested ...

Python, PySpark and notebook-based development. What you’ll be working with The environment includes: Python/PySpark Microsoft Fabric Spark and notebook development Lakehouse architecture Medallion/Bronze, Silver & Gold patterns Delta tables SQL Azure Git/source control CI/CD Testing, monitoring and data quality Experience ...

including data modelling, DAX, and dashboard design. Capability in SQL for data transformation, optimisation, and reporting solutions. Experience using Microsoft Fabric, including pipelines, lakehouse, and warehouse functionality. Confidence communicating insight to a range of audiences through clear data storytelling and analysis. Knowledge of data governance, data quality management ...

identifying issues and improving quality. Nice to have Python experience, particularly for test automation, test data creation, or data validation activities. Experience working within Lakehouse architectures and modern data platforms. Some of our benefits Flexible, hybrid working model Inclusive culture and environment, check out our Glassdoor reviews £1000 flexible ...

AI. Modernisation is at the heart of the role: helping customers move away from legacy data warehouses, databases and fragmented data estates towards modern lakehouse, warehouse and federated designs on platforms such as Databricks, Snowflake, Microsoft Fabric and Starburst. In a pre-sales capacity, there is a demand … define migration approaches and phased roadmaps, and identify risks, dependencies and quick wins. Data Architecture & Modelling - Design end-to-end data platform architectures, including lakehouse, warehouse, federated and data-product approaches. Apply appropriate modelling patterns such as medallion, dimensional and domain-oriented designs. Data Integration & Engineering - Design ingestion ...

Proven experience building data platforms on Azure. You know Databricks inside out – not just how to write a notebook, but how to architect a Lakehouse, manage clusters, and optimise costs. Data Modelling Proficiency: You understand that data engineering is more than moving JSON blobs. You have strong opinions ...

responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that ...

Business Intelligence Developer and Data Engineer Cheshire TBC, Permanent/Full Time Business Intelligence Developer and Data Engineer Location: Hybrid (Runcorn) with travel across the North West and Yorkshire Job type: Full-time, permanent Are ...

/SQL Data Warehousing ETL/ELT Processes Queries, stored procedures, scripts and database objects Data Reporting Microsoft Fabric Azure Data Factory Dataflows Data Lakehouse or Warehouse solutions Python Source Control (Git) Technical Leadership & Team Management You will be a Lead SQL Developer with good communication skills and have ...

technical credibility in relevant data engineering technologies such as SQL, Python, orchestration tools, cloud data platforms, APIs, file‐based integrations or data warehouse/lakehouse platforms What we can offer you We recognise that our people are our most important assets. That’s why we offer a flexible reward ...

/Java or Scala Experience working with large-scale data platforms, data lakes or warehouses A good understanding of modern data concepts like Lakehouse, ingestion and analytics Experience across the full delivery lifecycle, from design to support A mindset focused on quality, simplicity and continuous improvement The ability ...

analytics capabilities. Leverage SAP BTP DataSphere and SAP Analytics Cloud (SAC) to create integrated analytics solutions. Data Integration & Management Implement data integration into Fabric Lakehouse, Warehouse, and Synapse Engineering. Design and build Azure Data Factory pipelines for data ingestion and transformation. Ensure data security and governance at storage … field required. Technical Experience 5 years of progressive IT experience, with a minimum of 2 years of hands‐on experience with Microsoft Fabric (Workspace, Lakehouse, Warehouse, and Data Engineering). Proven expertise architecting solutions with SAP (ECC and S/4HANA), Microsoft Fabric, and Power BI, including a strong ...

improve data engineering, reporting and analytics, and provide senior technical leadership for data engineering delivery. Core responsibilities Lead hands-on Microsoft Fabric architecture across lakehouse, warehouse, notebooks, semantic models, Git-backed delivery and production governance. Drive migration from legacy reporting and metric tooling into a governed Fabric semantic layer … ingestion, data profiling, master-data mapping, migration QA and reporting continuity. NoSQL-to-analytics modelling, including change-feed patterns from operational databases into lakehouse or warehouse structures. GA4, BigQuery export, Google Ads/SEM feeds, Segment or other event and marketing analytics sources. Experience with Azure OpenAI, LLMs ...

Senior Data Engineer County Durham - Flexible working arrangements £60,000 plus great benefits 2 Year Fixed Term We are looking for a Senior Data Engineer on a 2 year fixed term appointment to play a ...

stakeholder skills and confidence leading requirements sessions, challenging assumptions and explaining findings to non-technical audiences. Knowledge of Microsoft Fabric and medallion warehouse and lakehouse architecture, including Bronze, Silver and Gold layers. Ability to design Gold layer schemas and write clear, testable requirements for Data Engineering. Experience Extensive hands ...

Sonata Software is seeking a Data Architect for a permanent hybrid role in the UK. The candidate will lead data architecture with extensive Azure Databricks experience, including Delta Lake medallion patterns and Unity Catalog governance. ...

through served APIs. EXPERIENCE REQUIRED Strong Python and SQL, with production experience building and operating data pipelines — ideally in Microsoft Fabric, or a comparable lakehouse platform such as Databricks, Synapse or a dbt-based stack. Hands‐on experience with time‐series, sensor or telemetry data at scale, including ...

Power BI environment. Develop scalable batch and real-time data-processing solutions. Lead the design of a Customer Data Platform. Build and evolve a lakehouse architecture using AWS technologies. Create governed semantic models, consistent metrics and clear data definitions. Enable secure, self-service data analysis using modern AI tooling. … comparable platforms. AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. Infrastructure as code using Terraform. CI/CD and automated testing. Lakehouse architecture and open table formats such as Iceberg. Medallion architecture and dimensional data modelling. Strong SQL and Python. SQL Server, SSIS/SSDT ...

haves:*** Familiarity with evaluating AI system performance, including prompt evaluation, A/B testing, and quality assessment frameworks.* Understanding of modern data patterns: lakehouse architectures, vector databases, and relational/NoSQL stores* Familiarity with API gateways, event streaming and general integration patterns. **Eligibility:*** You need to have resided ...

judgement, with the ability to balance business value, technical complexity, risk, cost and compliance considerations Practical MDM and metadata management experience, specifically Databricks/Lakehouse platform Experience providing technical leadership and influencing decisions across large-scale programmes, transformation initiatives and diverse stakeholder groups A collaborative approach, with a passion ...

environment. Develop scalable batch and real-time data-processing capabilities. Lead the design of a Customer Data Platform. Build and evolve a modern AWS lakehouse architecture. Create governed semantic models, consistent metrics and clear data definitions. Enable secure, self-service data analysis through modern AI tools. Automate manual, repetitive … streaming technologies such as Flink or comparable platforms. Production AWS data engineering. AWS services including S3, Lambda, Glue, Athena, Kinesis, RDS, IAM and CloudWatch. Lakehouse architectures and open table formats such as Iceberg. Medallion-style data layering and dimensional modelling. Strong SQL and Python development skills. Infrastructure as code ...

data products, data flows, integration patterns, metadata and data lifecycle management. 2. Data platform and solution design Design scalable cloud data platforms and lakehouse solutions using Microsoft Fabric, OneLake, Azure Data Factory, Azure Databricks, Azure Synapse and related Azure services. Define approaches for batch and real-time data ingestion … Strong data modelling capability across conceptual, logical and physical models, including dimensional modelling, data vault or comparable approaches. Experience designing data integration, data migration, lakehouse or enterprise data platform solutions across multiple systems and data domains. Experience with data governance, metadata, lineage, data quality, master data and reference data ...

Canopius is seeking an experienced Data Engineer lead in Manchester to drive the next generation of its data estate. You will mentor junior engineers, deliver scalable PySpark pipelines on Databricks, and collaborate with product owners ...

expert-level Databricks and/or Snowflake and an Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data … Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across the core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines ...