17 of 17 Data Lake Jobs in Yorkshire

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … operations for the worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered ...

Role: Senior Data Migration Engineer Location: Sheffield (3 days a week) Employment: Fulltime Role Overview We are seeking an experienced Data Migration Specialist to deliver complex enterprise data migration projects. The successful candidate will have strong SQL and Azure Data Engineering expertise … analysis, transformation, validation and reconciliation. Hands-on experience with : Azure Data Factory (ADF) Python Azure SQL DBs Azure Data Lake and Lakehouse architectures ETL and ELT pipeline development Azure DevOps, Git and CI/CD practices Microsoft Fabric (Good to have) Strong understanding ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

Data Engineer Sheffield/Hybrid Contract until end of August 2027 Up to £538 per day (Umbrella) We are seeking an experienced Data Engineer with strong Python development, Azure cloud, and SRE/DevOps expertise to join a high-profile programme. This is not a pure …/or PowerShell) Hands-on SRE/DevOps and production support experience Desirable Skills Azure Databricks, Data Factory, or Data Lake Kafka, Event Hubs, or Spark Kubernetes Azure Monitor, Grafana, or Prometheus Cybersecurity experience, including SIEM/SOAR technologies Financial Services experience Ideal Candidate ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

connect security telemetry, assets, identities, vulnerabilities, threats, controls, and incidents into a trusted intelligence layer. The role is highly hands-on and combines data science, graph engineering, cybersecurity analytics, semantic modeling, and technical leadership to enable attack-path analysis, threat investigation, exposure prioritization, GraphRAG, and AI-assisted security … graph ingestion and transformation pipelines for SIEM, EDR/XDR, IAM/PAM, CMDB, vulnerability scanners, cloud security platforms, threat intelligence feeds, security data lakes, and case-management systems. Develop entity extraction, identity resolution, deduplication, schema mapping, relationship inference, confidence scoring, temporal modeling, and graph enrichment capabilities. Model ...

engineer who enjoys building production-grade applications, Back End services, APIs, developer tooling, and automation solutions that support enterprise-scale cyber security and data platforms. This is a software engineering-focused position with significant hands‐on development responsibilities. It is not a traditional infrastructure, DevOps, or platform engineering … supporting production environments. Desirable Skills Experience with Kong API Gateway. Exposure to Cyber Security engineering environments. Knowledge of Databricks, Spark, or Data Lake technologies. Experience supporting Data Engineering platforms. Understanding of API security concepts including OAuth2, JWT, and mTLS. Knowledge of Site Reliability Engineering ...

when required. On-site availability should be confirmed. We are seeking an experienced DevOps Consultant to support the Azure Data Platform within Health and Disability. You will develop CI/CD pipelines and DevOps toolchains, with a strong focus on automation, cloud infrastructure, resilience and continuous improvement. … delivering PoCs, proof of capabilities and technical improvements. Active SC Clearance. Desirable Azure Data Factory Azure Synapse Analytics Azure Data Lake Databricks Kafka/Kafka Connect Interview The interview will include a problem-solving exercise assessing technical depth, engineering judgement, communication and approach to problem ...

infrastructure across cloud and on-premise environments. Develop scalable architectures for AI workloads, including model hosting, vector databases, orchestration layers, APIs, and data pipelines. Integrate AI platforms with business-critical systems, data platforms, collaboration tools, and operational applications. Produce and maintain architecture documentation, operational procedures … Agentic AI frameworks such as LangGraph, AutoGen, or CrewAI. AI orchestration platforms such as n8n or similar technologies. Knowledge graph technologies. Data lake and analytics platforms. Experience supporting organisation-wide AI adoption programmes. ...

LEAD DATA SCIENTIST Security Knowledge Graphs & Cyber AI Lead Experience 10+ years overall; 5+ years in AI/ML or graph analytics Location Flexible/Hybrid Employment Type Full-time Role Purpose Lead the design, engineering, and operationalization of enterprise Security Knowledge Graphs that connect security telemetry, assets … identities, vulnerabilities, threats, controls, and incidents into a trusted intelligence layer. The role is highly hands-on and combines data science, graph engineering, cybersecurity analytics, semantic modeling, and technical leadership to enable attack-path analysis, threat investigation, exposure prioritization, GraphRAG , and AI-assisted security operations. Key Responsibilities Design ...

Credera is seeking a senior data engineering leader in the UK to drive complex data delivery across client projects. You’ll shape data pipelines, data lakes, and ML-ready platforms using Spark, Python, SQL, and AWS services. You’ll mentor engineers, collaborate … ensure secure, scalable solutions within a hybrid work model. You will work across regulated environments with a focus on delivering high-impact data and AI workloads, including GenAI/LLM-based #J-18808-Ljbffr ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...