14 of 14 Data Lake Jobs in Yorkshire

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Developers and other technical stakeholders to turn business and technical requirements into practical, scalable solutions. Key responsibilities Design and build scalable data lake and data warehouse solutions on AWS. Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational … cases. Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Build trusted data products that turn complexity into confident decisions. Vanquis is strengthening how it uses data to improve customer outcomes, insight and competitive advantage. This is an opportunity to help shape a modern, cloud-first data platform at a point when scalable, trustworthy … data matters more than ever. As a Data Engineer, you will transform raw information into dependable data products, joining cloud and on-premise sources and making data easier to find, understand and use. Your work will reduce manual effort, improve analyst productivity ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

Corecom Consulting is seeking a Contract Data Engineer to transform a legacy SQL data warehouse into a modern cloud-native AWS platform. … role is Outside IR35 and hybrid, with one day per week onsite north of Leeds. You will design scalable AWS data lake and warehouse solutions and lead ETL/ELT development to deliver a robust data foundation. Key responsibilities include migrating data from ...

remote, with monthly travel to Leeds/Bradford Type: Permanent | Full-time The Opportunity A forward-thinking organisation undergoing significant investment in its data and technology capabilities is seeking an experienced Data Engineer to join its growing team. This is an excellent opportunity to play … role in the evolution of a modern Azure-based data platform, supporting reporting, analytics, business intelligence, and emerging AI initiatives. You'll work closely with analysts, architects, engineers, and business stakeholders to deliver scalable, secure, and high-quality data solutions. Key Responsibilities Design, develop and maintain ...

Newcastle or Leeds The Opportunity We're looking for an experienced Azure DevOps Engineer to support one of our central governnent clients Azure Data Platform team, helping to build, automate, enhance and support cloud-native platforms and DevOps capabilities across a complex Azure estate. The Role … must demonstrate hands-on experience (minimum SFIA Level 4 equivalent) across: Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Azure & DevOps Strong experience supporting and developing Azure cloud-based platforms and applications. Experience implementing and maintaining CI/CD pipelines. Azure DevOps, GitLab ...

software engineer who enjoys building production-grade applications, backend services, APIs, developer tooling, and automation solutions that support enterprise-scale cyber security and data platforms. This is a software engineering-focused position with significant hands-on development responsibilities. It is not a traditional infrastructure, DevOps, or platform engineering … supporting production environments. Desirable Skills Experience with Kong API Gateway. Exposure to Cyber Security engineering environments. Knowledge of Databricks, Spark, or Data Lake technologies. Experience supporting Data Engineering platforms. Understanding of API security concepts including OAuth2, JWT, and mTLS. Knowledge of Site Reliability Engineering ...

sales expertise to deliver end-to-end solutions-from data acquisition and SCADA integration to enterprise-level analytics and data lake architectures. Responsibilities: Position Schneider Electric GeoSCADA as the core supervisory control solution for water, wastewater, and utility networks as well as other suitable applications. … understand operational challenges and translate them into software-driven solutions. Deliver compelling presentations and workshops showcasing the value of integrated automation and data-driven insights. Design software architectures to integrate with AVEVA software, and enable seamless data flow from device layer through to enterprise systems. Ensure ...

into robust technical solutions with clear traceability for stakeholders. Experience using architecture modelling techniques and tools to design and communicate solutions. Knowledge of data integration technologies including real-time and batch processing across multiple source systems. Experience of analytics and reporting platforms, including data warehousing, data … design secure, scalable solutions across cloud, hybrid and on-premises environments while leading architectural governance, influencing technology strategy and driving innovation across data, analytics and reporting platforms. As part of DWP Digital's Data Insights and Analytics community, you'll mentor and support other architects, helping ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...