1 to 25 of 52 Permanent Data Lake Jobs in the North of England

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

Data Engineer - Warrington Data Engineer with excellent experience in data engineering, data development, data integrations, SQL, Python, data warehousing, & Azure data platforms is required by a leading company near Warrington. Any experience with Snowflake, Kimball, Databricks … schema design. * Experience building and maintaining ETL/ELT processes. Desirable Skills: * Databricks experience. * Azure Data Platform technologies, Azure Data Lake, Azure Analysis Services. * Snowflake, ThoughtSpot. * Knowledge of Kimball and Inmon data warehousing methodologies. * Exposure to AI-assisted development tools and modern ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Senior Data Engineer County Durham - Flexible working arrangements £60,000 plus great benefits 2 Year Fixed Term We are looking for a Senior Data Engineer on a 2 year fixed term appointment to play a key role in designing, building and maintaining a modern data environment that supports analytics, reporting and wider business decision-making. The role will focus on developing scalable data pipelines, robust data models and reliable data platforms, ensuring that data is accurate, accessible, secure and fit for purpose. This position will ...

create, innovate, and help transform airport travel. Together, we can reach new heights. Together, we are Cavu. About The Role The Lead Data Engineer is responsible for overseeing the architecture, development, implementation, and maintenance of our data infrastructure, ensuring its efficiency, reliability and compliance with relevant … regulations. Supporting an existing team of data scientists, BI developers and analysts, this role will help provide the glue that empowers the business to capitalise on the wide range of data assets and drive value from the insight we extract. We develop advanced and actionable data ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore) and SageMaker AI On Azure, you’re fluent across … core services, for example: Storage & lakehouse: SQL, PostgreSQL, Cosmos, Blob, Data Lake, OneLake, Fabric Warehouse Processing & ETL: Fabric Data Factory, Data Factory CDC, Fabric/Synapse Spark, ADF, Synapse Pipelines, Fabric, dbt Data management & metadata: Purview AI: Foundry, (including Agent Service ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Senior Data Engineer Make a difference and advance your career by helping deliver some of the UK’s most important #tech4good projects, making the world a smarter, safer, greener, and healthier place. You’ll join a talented team of dynamic and driven professional problem solvers; creative thinkers … digital transformation consultancy. We deliver multi-Queen’s Award for innovation winning platforms and services that support large-scale digital transformation. Our digital, data and technology solutions are used by globally recognised public and private sector brands operating in a variety of sectors including Civil Defence, Healthcare, Sustainable ...

opportunity to discuss your flexible working requirements during the interview process, and at offer stage. We’re reshaping our Digital, Technology and Data function for the future, creating new opportunities, strengthening our capability, and building clearer, more resilient ways of working so we can deliver even better services … with Power BI or Strategy Experience with working within the MS Azure Cloud data platform (Data Factory, Data Lake and Databricks) Strong SQL skills with experience of Microsoft SQL Server Management Studio or equivalent Experience working on data warehouse projects ...

CAVU Summary Lead Data Engineer Hybrid (2 days per week in the office) Permanent About CAVU For airports, for partners, for people. We are Cavu. At Cavu, our purpose is to find new and better ways to make airport travel seamless and enjoyable for everybody — from the smallest … help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a key role in shaping and evolving Cavu's data platform, enabling data-driven decision making across ...

helping to shape the future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy … Python Hands-on experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

About Rayo Rayo, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. We’re looking for an experienced … Senior Data Engineer with strong AWS expertise to design, build and deliver scalable, secure and resilient data solutions for our clients. This is a hands‐on senior engineering role, combining deep data engineering expertise with technical ownership, client engagement and the ability to guide ...

Data Manager (Data Governance) Location: Manchester (Hybrid) Contract Duration: 6 Months Working Hours: 37.5 hours per week We are looking for a proactive Data Manager to join a global travel leader's Data Governance team. This role is pivotal in supporting … years of experience in Data Governance, MDM, or lifecycle management. Concepts: Strong understanding of Data Warehouse vs. Data Lake architectures and ETL workflows. Communication: Ability to translate technical data issues into actionable business insights for senior stakeholders. Randstad Technologies is acting ...

Data & Analytics Solution Architect SC Cleared - Manchester (Hybrid) - Up to £80,000 + Bonus Data Strategy - Cloud Transformation - AWS/Azure - Databricks - Data Platforms I'm working with a leading technology consultancy that delivers large-scale data and cloud transformation programmes across … central government, public sector and enterprise organisations. Due to continued growth, they are looking to appoint a Data & Analytics Solution Architect to help clients shape data strategy, modernise legacy platforms and deliver business-critical transformation initiatives. This is a highly consultative role where you'll work ...

Data & Analytics Solution Architect SC Cleared - Leeds (Hybrid) - Up to £80,000 + Bonus Data Strategy - Cloud Transformation - AWS/Azure - Databricks - Data Platforms I'm working with a leading technology consultancy that delivers large-scale data and cloud transformation programmes across … central government, public sector and enterprise organisations. Due to continued growth, they are looking to appoint a Data & Analytics Solution Architect to help clients shape data strategy, modernise legacy platforms and deliver business-critical transformation initiatives. This is a highly consultative role where you'll work ...

Data & Analytics Solution Architect SC Cleared - Newcastle (Hybrid) - Up to £80,000 + Bonus Data Strategy - Cloud Transformation - AWS/Azure - Databricks - Data Platforms I'm working with a leading technology consultancy that delivers large-scale data and cloud transformation programmes across … central government, public sector and enterprise organisations. Due to continued growth, they are looking to appoint a Data & Analytics Solution Architect to help clients shape data strategy, modernise legacy platforms and deliver business-critical transformation initiatives. This is a highly consultative role where you'll work ...

home, there’s nothing we can’t achieve. Basic Qualifications Experience implementing AWS services in a variety of distributed computing environments Data lake architecture and design (Lake Formation, S3-based architectures) Medallion architecture implementation (bronze/silver/gold layer design) Data strategy … governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks ...

Title: Data Engineer Location: Liverpool, UK Salary: £65,000 - £70,000 per annum, depending on experience Job Type: Permanent, Full Time Working Hours: 37.5 hours per week, Monday to Friday, 9am to 5:30pm We are seeking a talented and experienced Data Engineer to join … innovative and collaborative Database and AI Team. In this role, you will play a key part in shaping our data strategy and driving business success. Your skills will contribute directly to our forward-thinking initiatives. At Acorn we value and prioritise innovation, teamwork, and continuous development. Key part ...

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

infrastructure for Azure-based data platforms Work with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to support data pipeline infrastructure and platform reliability Develop and maintain infrastructure-as-code using Terraform Build and maintain CI/CD pipelines … experience with Azure cloud services Experience with Azure Data Factory Experience with Azure Synapse Analytics Experience with Azure Data Lake Experience with Terraform for infrastructure as code Experience building and maintaining CI/CD pipelines using GitLab A proactive, self-motivated approach, comfortable identifying issues ...

edge manufacturing, turning abstract ideas into realities that transform the world for good. Your impact This is a great time to join our Data & Digital team as we continue to grow our data engineering capability across complex and impactful client environments. You'll have the opportunity … workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data dictionaries and reusable engineering assets ...

Business Intelligence Developer and Data Engineer Cheshire TBC, Permanent/Full Time Business Intelligence Developer and Data Engineer Location: Hybrid (Runcorn) with travel across the North West and Yorkshire Job type: Full-time, permanent Are you passionate about turning complex data into meaningful insight … that helps businesses make better decisions? We are recruiting on behalf of the 2M Group of Companies for a Business Intelligence Developer and Data Engineer. This is a hands-on role for someone with strong Power BI and SQL skills who can build high-quality reporting and data ...