20 of 20 Data Lake Jobs in Yorkshire

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

Role Data Management and Analytics-Data Modelling Experience (In Years) 6-9 Job Location Yorkshire , United Kingdom Job Description EXL (NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock … growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute complex operations for the world’s leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data ...

Role: Senior Data Migration Engineer Location: Sheffield (3 days a week) Employment: Fulltime Role Overview We are seeking an experienced Data Migration Specialist to deliver complex enterprise data migration projects. The successful candidate will have strong SQL and Azure Data Engineering expertise … analysis, transformation, validation and reconciliation. Hands-on experience with : Azure Data Factory (ADF) Python Azure SQL DBs Azure Data Lake and Lakehouse architectures ETL and ELT pipeline development Azure DevOps, Git and CI/CD practices Microsoft Fabric (Good to have) Strong understanding ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

Corecom Consulting is seeking a Contract Data Engineer to transform a legacy SQL data warehouse into a modern cloud-native AWS platform. … role is Outside IR35 and hybrid, with one day per week onsite north of Leeds. You will design scalable AWS data lake and warehouse solutions and lead ETL/ELT development to deliver a robust data foundation. Key responsibilities include migrating data from ...

Data Engineer Sheffield/Hybrid Contract until end of August 2027 Up to £538 per day (Umbrella) We are seeking an experienced Data Engineer with strong Python development, Azure cloud, and SRE/DevOps expertise to join a high-profile programme. This is not a pure …/or PowerShell) Hands-on SRE/DevOps and production support experience Desirable Skills Azure Databricks, Data Factory, or Data Lake Kafka, Event Hubs, or Spark Kubernetes Azure Monitor, Grafana, or Prometheus Cybersecurity experience, including SIEM/SOAR technologies Financial Services experience Ideal Candidate ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

connect security telemetry, assets, identities, vulnerabilities, threats, controls, and incidents into a trusted intelligence layer. The role is highly hands-on and combines data science, graph engineering, cybersecurity analytics, semantic modeling, and technical leadership to enable attack-path analysis, threat investigation, exposure prioritization, GraphRAG, and AI-assisted security … graph ingestion and transformation pipelines for SIEM, EDR/XDR, IAM/PAM, CMDB, vulnerability scanners, cloud security platforms, threat intelligence feeds, security data lakes, and case-management systems. Develop entity extraction, identity resolution, deduplication, schema mapping, relationship inference, confidence scoring, temporal modeling, and graph enrichment capabilities. Model ...

engineer who enjoys building production-grade applications, Back End services, APIs, developer tooling, and automation solutions that support enterprise-scale cyber security and data platforms. This is a software engineering-focused position with significant hands‐on development responsibilities. It is not a traditional infrastructure, DevOps, or platform engineering … supporting production environments. Desirable Skills Experience with Kong API Gateway. Exposure to Cyber Security engineering environments. Knowledge of Databricks, Spark, or Data Lake technologies. Experience supporting Data Engineering platforms. Understanding of API security concepts including OAuth2, JWT, and mTLS. Knowledge of Site Reliability Engineering ...

enabling businesses to thrive and economies to prosper, and, ultimately, helping people fulfil their hopes and realise their ambitions. We are seeking a Data Analyst The Financial Crime (FC) Chief Data and Analytics Office (CDAO) role is to manage data products, processes and applications … Compliance/FC Data Lakes and Cloud Environments and define the strategy for their future evolution. This encompasses the end-to-end design, modelling and delivery of enhanceddatasets to optimise the performance of our crime detection models and yield the greatest possible insight for all users, including ...

sales expertise to deliver end-to-end solutions—from data acquisition and SCADA integration to enterprise-level analytics and data lake architectures. Responsibilities: Position Schneider Electric GeoSCADA as the core supervisory control solution for water, wastewater, and utility networks as well as other suitable applications. … understand operational challenges and translate them into software-driven solutions. Deliver compelling presentations and workshops showcasing the value of integrated automation and data-driven insights. Design software architectures to integrate with AVEVA software, and enable seamless data flow from device layer through to enterprise systems. Ensure ...

Credera is seeking a senior data engineering leader in the UK to drive complex data delivery across client projects. You’ll shape data pipelines, data lakes, and ML-ready platforms using Spark, Python, SQL, and AWS services. You’ll mentor engineers, collaborate … ensure secure, scalable solutions within a hybrid work model. You will work across regulated environments with a focus on delivering high-impact data and AI workloads, including GenAI/LLM-based #J-18808-Ljbffr ...

HSBC is seeking a Data Analyst within the Financial Crime Chief Data and Analytics Office (CDAO). You will manage data products and analytics on Compliance/FC Data Lakes and Cloud Environments, shaping data assets to enhance crime-detection … models and provide insight for FC Analysts, Investigators, and Data Scientists. You will work with stakeholders and engineers to define questions, track progress, and support governance while advancing agile delivery and data security across multiple #J-18808-Ljbffr ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...

HSBC Holdings plc is seeking a Data Scientist within the Financial Crime Chief Data and Analytics Office. You will manage data products and analytics to optimise crime-detection models and yield actionable insights for analysts, investigators and MI teams. The role involves design, modelling … delivery across data lakes and cloud environments. You will partner with stakeholders, engineers and leadership to define problem statements, track performance metrics, and drive data-driven decisions. #J-18808-Ljbffr ...