14 of 14 Data Lake Jobs in West Yorkshire

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Developers and other technical stakeholders to turn business and technical requirements into practical, scalable solutions. Key responsibilities Design and build scalable data lake and data warehouse solutions on AWS. Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational … cases. Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

Data & Analytics Solution Architect SC Cleared - Leeds (Hybrid) - Up to £80,000 + Bonus Data Strategy - Cloud Transformation - AWS/Azure - Databricks - Data Platforms I'm working with a leading technology consultancy that delivers large-scale data and cloud transformation programmes across … central government, public sector and enterprise organisations. Due to continued growth, they are looking to appoint a Data & Analytics Solution Architect to help clients shape data strategy, modernise legacy platforms and deliver business-critical transformation initiatives. This is a highly consultative role where you'll work ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

locations(Hybrid- 3 days working from onsite-Mandatory)Immediate startPermanent/Contract inside IR35/Fixed term contractWe're looking for a Lead Data Engineer to join UST Data Team. As the most senior engineer working across a number of squads, you'll blend hands … engineering with providing technical leadership and mentorship to data engineers. You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive client's strategic objectives. Additionally ...

Corecom Consulting is seeking a Contract Data Engineer to transform a legacy SQL data warehouse into a modern cloud-native AWS platform. … role is Outside IR35 and hybrid, with one day per week onsite north of Leeds. You will design scalable AWS data lake and warehouse solutions and lead ETL/ELT development to deliver a robust data foundation. Key responsibilities include migrating data from ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

remote, with monthly travel to Leeds/Bradford Type: Permanent | Full-time The Opportunity A forward-thinking organisation undergoing significant investment in its data and technology capabilities is seeking an experienced Data Engineer to join its growing team. This is an excellent opportunity to play … role in the evolution of a modern Azure-based data platform, supporting reporting, analytics, business intelligence, and emerging AI initiatives. You'll work closely with analysts, architects, engineers, and business stakeholders to deliver scalable, secure, and high-quality data solutions. Key Responsibilities Design, develop and maintain ...

sales expertise to deliver end-to-end solutions-from data acquisition and SCADA integration to enterprise-level analytics and data lake architectures. Responsibilities: Position Schneider Electric GeoSCADA as the core supervisory control solution for water, wastewater, and utility networks as well as other suitable applications. … understand operational challenges and translate them into software-driven solutions. Deliver compelling presentations and workshops showcasing the value of integrated automation and data-driven insights. Design software architectures to integrate with AVEVA software, and enable seamless data flow from device layer through to enterprise systems. Ensure ...

into robust technical solutions with clear traceability for stakeholders. Experience using architecture modelling techniques and tools to design and communicate solutions. Knowledge of data integration technologies including real-time and batch processing across multiple source systems. Experience of analytics and reporting platforms, including data warehousing, data … design secure, scalable solutions across cloud, hybrid and on-premises environments while leading architectural governance, influencing technology strategy and driving innovation across data, analytics and reporting platforms. As part of DWP Digital's Data Insights and Analytics community, you'll mentor and support other architects, helping ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...