8 of 8 Data Lake Jobs in Newcastle upon Tyne

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

Azure Data Factory (ADF). Develop and optimise data solutions using Azure Synapse Analytics. Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform. Use GitLab for source control, version management, and CI/… architectures and Real Time data processing. Key Technologies Azure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake | Terraform | GitLab | Databricks | Kafka | Kafka Connect Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

consistent delivery of such. Continue to drive "true" automation by converting manually triggered automation tools into robotically automated processes and/or data pipelines. Work with the IT Data Department to convert existing automations for data transfer into proper data pipelines, making … data tables available through the Data Lake. Create and maintain live reports for key metrics using Power BI, to replace Excel-based reports currently being produced both within the team and by managers across Finance Who we're looking for Process Automation Experience in office process ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

identify architectural patternsMonitor compliance of cloud resources to see if they fit industry guardrails and best practicesResearch and propose solutions for AWS data transformation, data connections, operational frameworks, and application integrationWork closely with lead architects and engineers to create and maintain architectural templates and build/… pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components).Proven ability to take research and prototype environments to enterprise‐ready architectures, balancing speed, robustness, and long‐term maintainability. Strong background in cloud ...

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data … platforms and pipelines, while applying best practices for automation and source control. The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering #J-18808-Ljbffr ...

into robust technical solutions with clear traceability for stakeholders. Experience using architecture modelling techniques and tools to design and communicate solutions. Knowledge of data integration technologies including real-time and batch processing across multiple source systems. Experience of analytics and reporting platforms, including data warehousing, data … design secure, scalable solutions across cloud, hybrid and on-premises environments while leading architectural governance, influencing technology strategy and driving innovation across data, analytics and reporting platforms. As part of DWP Digital's Data Insights and Analytics community, you'll mentor and support other architects, helping ...