1 to 25 of 67 Data Lake Jobs in the North of England

data throughout its lifecycle.Modern Data PlatformsDesign and assure solutions across modern data-platform environments.Contribute to data lake architecture and solutions operating within data lake ecosystems.Assess different approaches to data storage, integration, processing and analytics.Maintain awareness … -storage technologies.Capacity planning across complex data environments.Establishing and embedding data governance processes and frameworks.Designing and implementing data lake architectures.Working with solutions built within modern data lake ecosystems.Enterprise-level Data Architecture and strategic data planning.Experience within ...

data throughout its lifecycle.Modern Data PlatformsDesign and assure solutions across modern data-platform environments.Contribute to data lake architecture and solutions operating within data lake ecosystems.Assess different approaches to data storage, integration, processing and analytics.Maintain awareness … -storage technologies.Capacity planning across complex data environments.Establishing and embedding data governance processes and frameworks.Designing and implementing data lake architectures.Working with solutions built within modern data lake ecosystems.Enterprise-level Data Architecture and strategic data planning.Experience within ...

data throughout its lifecycle.Modern Data PlatformsDesign and assure solutions across modern data-platform environments.Contribute to data lake architecture and solutions operating within data lake ecosystems.Assess different approaches to data storage, integration, processing and analytics.Maintain awareness … -storage technologies.Capacity planning across complex data environments.Establishing and embedding data governance processes and frameworks.Designing and implementing data lake architectures.Working with solutions built within modern data lake ecosystems.Enterprise-level Data Architecture and strategic data planning.Experience within ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … design teams.Experience in data solution architecture, including establishing design principles, defining solution patterns, and following architecture methodologies.Expertise in Data Lake, Lakehouse, and Data Mesh architecture.Observability and FinOps (Financial Operations) expertise.Experience of establishing common data models and suitable structures to enhance ...

Data Engineer - Warrington Data Engineer with excellent experience in data engineering, data development, data integrations, SQL, Python, data warehousing, & Azure data platforms is required by a leading company near Warrington. Any experience with Snowflake, Kimball, Databricks … schema design. * Experience building and maintaining ETL/ELT processes. Desirable Skills: * Databricks experience. * Azure Data Platform technologies, Azure Data Lake, Azure Analysis Services. * Snowflake, ThoughtSpot. * Knowledge of Kimball and Inmon data warehousing methodologies. * Exposure to AI-assisted development tools and modern ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Senior Data Engineer County Durham - Flexible working arrangements £60,000 plus great benefits 2 Year Fixed Term We are looking for a Senior Data Engineer on a 2 year fixed term appointment to play a key role in designing, building and maintaining a modern data environment that supports analytics, reporting and wider business decision-making. The role will focus on developing scalable data pipelines, robust data models and reliable data platforms, ensuring that data is accurate, accessible, secure and fit for purpose. This position will ...

Developers and other technical stakeholders to turn business and technical requirements into practical, scalable solutions. Key responsibilities Design and build scalable data lake and data warehouse solutions on AWS. Develop data ingestion, transformation and storage pipelines to support reporting, analytics and operational … cases. Work with AWS services including S3, Redshift, Glue, Lambda, Lake Formation, Athena and EventBridge. Implement Bronze, Silver and Gold data layers using Medallion Architecture principles. Build and maintain ETL/ELT pipelines across batch, streaming and Change Data Capture (CDC) workloads. Develop reusable transformation ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...

create, innovate, and help transform airport travel. Together, we can reach new heights. Together, we are Cavu. About The Role The Lead Data Engineer is responsible for overseeing the architecture, development, implementation, and maintenance of our data infrastructure, ensuring its efficiency, reliability and compliance with relevant … regulations. Supporting an existing team of data scientists, BI developers and analysts, this role will help provide the glue that empowers the business to capitalise on the wide range of data assets and drive value from the insight we extract. We develop advanced and actionable data ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

description Connect to your IndustryDo you want to be at the heart of some of the biggest and most ambitious AI & Data projects? Technology & Transformation: How do you make intelligent, future-proof decisions in a world where change is the one constant? That's exactly what … data lakes, data warehouses) and compute engine options (e.g., Spark, Databricks, Synapse Analytics, BigQuery).Implementing and optimising data lake and data warehouse solutions on cloud platforms using services such as object storage (e.g., S3, ADLS, GCS), cloud data warehouses ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

hands-on delivery, you will: Help define and deliver the data platform roadmap Design and deliver solutions using Azure Data Lake, Databricks, SQL and Python Lead the transformation and migration of existing systems and data services Translate the wider programme into practical workstreams … mentored engineers and is ready for greater responsibility. You must be able to demonstrate: Hands-on experience with Azure Data Lake Strong practical experience with Databricks and SQL Experience using Python within a data engineering environment Data platform design and architecture experience ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

opportunity to discuss your flexible working requirements during the interview process, and at offer stage.We’re reshaping our Digital, Technology and Data function for the future, creating new opportunities, strengthening our capability, and building clearer, more resilient ways of working so we can deliver even better services … with Power BI or Strategy• Experience with working within the MS Azure Cloud data platform (Data Factory, Data Lake and Databricks)• Strong SQL skills with experience of Microsoft SQL Server Management Studio or equivalent• Experience working on data warehouse projects ...

CAVU Summary Lead Data Engineer Hybrid (2 days per week in the office) Permanent About CAVU For airports, for partners, for people. We are Cavu. At Cavu, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody — from the smallest … help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a key role in shaping and evolving Cavu's data platform, enabling data-driven decision making across ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

home, there’s nothing we can’t achieve. Basic Qualifications Experience implementing AWS services in a variety of distributed computing environments Data lake architecture and design (Lake Formation, S3-based architectures) Medallion architecture implementation (bronze/silver/gold layer design) Data strategy … governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks ...