16 of 16 Data Lake Jobs in the North East

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

Senior Data Engineer County Durham - Flexible working arrangements £60,000 plus great benefits 2 Year Fixed Term We are looking for a Senior Data Engineer on a 2 year fixed term appointment to play a key role in designing, building and maintaining a modern data environment that supports analytics, reporting and wider business decision-making. The role will focus on developing scalable data pipelines, robust data models and reliable data platforms, ensuring that data is accurate, accessible, secure and fit for purpose. This position will ...

looking for a Senior Data Engineer with deep expertise in healthcare data to join a pioneering team building data products that enable world-leading research. Whether your experience comes from academia, healthcare, biotech, or a fast-growing health-tech startup, you'll bring … Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we ve quickly … time streaming data pipelines with technologies like Kafka, Flink, Spark etc. Experience in Databricks is a plus. Experience in Data Lake/Big Data Analytics platform implementation with cloud based solution; AWS preferred. Proficient in Python programming and software engineering best practices. Expertise ...

driven by continuous improvement with a focus on great results for our customers. About the role We are looking for an experienced Data Engineer to join our Applications and DevOps team based at our Head Office on the Gateshead Quayside. As a Data Engineer … services. Experience building and maintaining data pipelines, lakehouses, and data transformations using Microsoft Fabric, Azure Data Lake, Azure Synapse, or related Azure services. Knowledge of CI/CD pipelines, version control, and DevOps practices related to data engineering. Proficiency ...

Data & Analytics Solution Architect SC Cleared - Newcastle (Hybrid) - Up to £80,000 + Bonus Data Strategy - Cloud Transformation - AWS/Azure - Databricks - Data Platforms I'm working with a leading technology consultancy that delivers large-scale data and cloud transformation programmes across … central government, public sector and enterprise organisations. Due to continued growth, they are looking to appoint a Data & Analytics Solution Architect to help clients shape data strategy, modernise legacy platforms and deliver business-critical transformation initiatives. This is a highly consultative role where you'll work ...

Company Nigel Wright Tech are pleased to be working with a North East social housing provider in their search for a Senior Data Engineer on an initial 2 year FTC. The Role Working closely with the Data Architect, you will be expected to lead the design … build and maintenance of the organisations data infrastructure ensuring their data is of the highest quality. Key responsibilities include: Lead the development and maintain data models, schemas and structures that optimise data storage Build and link datasets so that Data ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business‐specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands‐on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

looking for a Staff Software Engineer to help shape and build the shared engineering capabilities that underpin Our Future Health s data platforms. This is an opportunity to combine hands-on software engineering with Staff level technical leadership , working on large-scale data systems and reusable … biggest health research programme of its kind, and our volunteer group is also more diverse than other, similar health research programmes. Technology and data are central to our mission. Our systems power web sites, clinics across the UK, secure analytics and research systems, and pipelines that process highly ...

This is an exciting contract opportunity for an SC Cleared Data Engineer tojoin an experienced team delivering a crtitical public sector engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery … Skills & Experiences Proven experience designing and implementing data solutions in Azure using Databricks as a core platform. Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks. Deep understanding ...

consistent delivery of such. Continue to drive "true" automation by converting manually triggered automation tools into robotically automated processes and/or data pipelines. Work with the IT Data Department to convert existing automations for data transfer into proper data pipelines, making … data tables available through the Data Lake. Create and maintain live reports for key metrics using Power BI, to replace Excel-based reports currently being produced both within the team and by managers across Finance Who we're looking for Process Automation Experience in office process ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data … platforms and pipelines, while applying best practices for automation and source control. The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering #J-18808-Ljbffr ...

month in your local Office Skills Significant Architecture experience Government/Public client experience (SC cleared or at least SC eligible) Analytics & Reporting: Data warehousing, data lakes, business intelligence (BI) and analytics technologies, design patterns, tools and best practice. Translating business requirements into technical solutions with … principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...