8 of 8 Permanent Data Lake Jobs in Newcastle upon Tyne

services. Your involvement will span the entire data lifecycle: from orchestrating data ingestion into our Azure Data Lake, designing and developing sophisticated data models for analytics, to deploying Azure Logic Apps and Function Apps for process automation. With tools like Databricks … ingestion solutions on the Azure platform, ensuring scalability, reliability, and performance. Leveraging technologies such as Azure Data Factory, Databricks, Delta Lake, and Python Design and maintain robust ETL/ELT processes to integrate data from various sources into Azure data services ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Requirements Proven experience (8+ years) in data, analytics and AI platform architecture, design and delivery Expertise in Microsoft Azure data and analytics services across the data value chain, with experience selecting appropriate platform capabilities for different client needs Experience defining target architectures and roadmaps … warehouse and lakehouse ecosystems, such as Microsoft Fabric, Azure Databricks, Azure Synapse Analytics, Azure Data Factory and Azure Data Lake Storage Gen2 Experience with Azure data integration and real-time analytics services, such as Event Hubs and Stream Analytics Experience with Microsoft ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data … platforms and pipelines, while applying best practices for automation and source control. The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering #J-18808-Ljbffr ...

when required. On-site availability should be confirmed. We are seeking an experienced DevOps Consultant to support the Azure Data Platform within Health and Disability. You will develop CI/CD pipelines and DevOps toolchains, with a strong focus on automation, cloud infrastructure, resilience and continuous improvement. … delivering PoCs, proof of capabilities and technical improvements. Active SC Clearance. Desirable Azure Data Factory Azure Synapse Analytics Azure Data Lake Databricks Kafka/Kafka Connect Interview The interview will include a problem-solving exercise assessing technical depth, engineering judgement, communication and approach to problem ...

Credera is seeking a senior data engineering leader in the UK to drive complex data delivery across client projects. You’ll shape data pipelines, data lakes, and ML-ready platforms using Spark, Python, SQL, and AWS services. You’ll mentor engineers, collaborate … ensure secure, scalable solutions within a hybrid work model. You will work across regulated environments with a focus on delivering high-impact data and AI workloads, including GenAI/LLM-based #J-18808-Ljbffr ...