10 of 10 Data Lake Jobs in the North East

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

Azure Data Factory (ADF). Develop and optimise data solutions using Azure Synapse Analytics. Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform. Use GitLab for source control, version management, and CI/… architectures and Real Time data processing. Key Technologies Azure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake | Terraform | GitLab | Databricks | Kafka | Kafka Connect Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed ...

Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management … experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering ...

Description You will play a critical role as part of a small specialist to design, build and enhance data pipelines using Microsoft Fabric. With strong collaboration and analytical skills, you will work with the business to provide data solutions to meet business needs. Essential Skills: Strong … OLTP and OLAP architectures and data modelling principles. Experience with Microsoft Azure, including Fabric, Azure Data Factory, Data Lake, Data Warehouse, and Blob Storage. Sound knowledge of ETL/ELT best practices. Strong analytical and problem-solving skills with a focus ...

consistent delivery of such. Continue to drive "true" automation by converting manually triggered automation tools into robotically automated processes and/or data pipelines. Work with the IT Data Department to convert existing automations for data transfer into proper data pipelines, making … data tables available through the Data Lake. Create and maintain live reports for key metrics using Power BI, to replace Excel-based reports currently being produced both within the team and by managers across Finance Who we're looking for Process Automation Experience in office process ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

identify architectural patternsMonitor compliance of cloud resources to see if they fit industry guardrails and best practicesResearch and propose solutions for AWS data transformation, data connections, operational frameworks, and application integrationWork closely with lead architects and engineers to create and maintain architectural templates and build/… pipelines, training, inference, monitoring, and MLOps) and how they map onto AWS services (e.g. SageMaker, Batch, Step Functions, EKS/ECS, data lake components).Proven ability to take research and prototype environments to enterprise‐ready architectures, balancing speed, robustness, and long‐term maintainability.Strong background in cloud security ...

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data … platforms and pipelines, while applying best practices for automation and source control. The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering #J-18808-Ljbffr ...

month in your local Office Skills Significant Architecture experience Government/Public client experience (SC cleared or at least SC eligible) Analytics & Reporting: Data warehousing, data lakes, business intelligence (BI) and analytics technologies, design patterns, tools and best practice. Translating business requirements into technical solutions with … principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...

into robust technical solutions with clear traceability for stakeholders. Experience using architecture modelling techniques and tools to design and communicate solutions. Knowledge of data integration technologies including real-time and batch processing across multiple source systems. Experience of analytics and reporting platforms, including data warehousing, data … design secure, scalable solutions across cloud, hybrid and on-premises environments while leading architectural governance, influencing technology strategy and driving innovation across data, analytics and reporting platforms. As part of DWP Digital's Data Insights and Analytics community, you'll mentor and support other architects, helping ...