1 to 25 of 52 Data Lake Jobs in the North of England

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

transformation, storage, and consumption layers. Provide technical leadership for Azure-based data platforms, including Databricks, Data Factory, Data Lake, and analytics solutions. Collaborate with Product Managers, Engineers, Analysts, and business stakeholders to translate requirements into robust technical solutions. Own solution architecture reviews … scale Data & Analytics solutions. Strong expertise in Microsoft Azure services including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), Azure SQL, and related data services. Deep understanding of modern data architectures including Data Lakes ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Developers and other technical stakeholders to turn business and technical requirements into practical, scalable solutions. Key responsibilities Design and build scalable data lake and data warehouse solutions on AWS. Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational … cases. Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...

Azure Data Factory (ADF). Develop and optimise data solutions using Azure Synapse Analytics. Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform. Use GitLab for source control, version management, and CI/… architectures and Real Time data processing. Key Technologies Azure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake | Terraform | GitLab | Databricks | Kafka | Kafka Connect Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

hands-on delivery, you will: Help define and deliver the data platform roadmap Design and deliver solutions using Azure Data Lake, Databricks, SQL and Python Lead the transformation and migration of existing systems and data services Translate the wider programme into practical workstreams … mentored engineers and is ready for greater responsibility. You must be able to demonstrate: Hands-on experience with Azure Data Lake Strong practical experience with Databricks and SQL Experience using Python within a data engineering environment Data platform design and architecture experience ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

Will Be Working With As a Data Engineer at Capgemini, you'll design, build and operate reliable, scalable data pipelines and data products: the trusted foundations that power analytics, AI, GenAI and increasingly agentic systems. You'll work hands‐on with modern data … Specialist tracks (we'd love depth in one of these; you don't need all of them) Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search ...

Build trusted data products that turn complexity into confident decisions. Vanquis is strengthening how it uses data to improve customer outcomes, insight and competitive advantage. This is an opportunity to help shape a modern, cloud-first data platform at a point when scalable, trustworthy … data matters more than ever. As a Data Engineer, you will transform raw information into dependable data products, joining cloud and on-premise sources and making data easier to find, understand and use. Your work will reduce manual effort, improve analyst productivity ...

CAVU Summary Lead Data Engineer Hybrid (2 days per week in the office) Permanent About CAVU For airports, for partners, for people. We are Cavu. At Cavu, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody — from the smallest … help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a key role in shaping and evolving Cavu's data platform, enabling data-driven decision making across ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. • Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. • Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). • Experience with AWS cloud services including S3, Glue, Lambda, IAM. • Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. • Understanding of data governance and compliance frameworks. • Experience in the healthcare sector or knowledge of NHS data ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

home, there’s nothing we can’t achieve. Basic Qualifications Experience implementing AWS services in a variety of distributed computing environments Data lake architecture and design (Lake Formation, S3-based architectures) Medallion architecture implementation (bronze/silver/gold layer design) Data strategy … governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks ...

Azure-based data solutions Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric Proven experience with infrastructure-as-code using Terraform Experience building CI/CD pipelines via Azure DevOps … Industry Keywords Healthcare Insurance Enterprise Data Platform Advanced Analytics Business Intelligence Tools & Technologies Azure Data Factory Azure Data Lake Azure ML Power BI GitHub #J-18808-Ljbffr ...

days working from onsite-Mandatory) Immediate start Permanent/Contract inside IR35/Fixed term contract We're looking for a Lead Data Engineer to join UST Data Team. As the most senior engineer working across a number of squads, you'll blend hands-on engineering … with providing technical leadership and mentorship to data engineers. You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive client's strategic objectives. Additionally, you'll play ...

Firm PA Consulting Location Manchester, United Kingdom Full-time Benefits Competive Functional areas Data Science Why consider joining our Digital & Data community? Join our Data Science team, part of Digital & Data, working alongside product, design and a wide range of other experts … business needs into scalable, resilient, and secure data solutions. Our tech stack Multi-cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling, iData Visualization ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...