9 of 9 Azure Data Factory Jobs in the East of England

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools like Apache Spark to ensure seamless data flow. Monitoring and Failure Recovery: Implement monitoring procedures to detect failures or unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions using Azure's suite of services. Collaboration and Leadership Work closely with data scientists, analysts, and other stakeholders to More ❯

Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the … future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that … either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet More ❯

months. You'll be responsible for creating new and working on existing dashboards across a range of exciting project. Requirements: Strong Power BI experience Experience with ETL pipelines, data modelling, SQL Azure Data Factory experience Ideally: Experience with Power Platform integrations IT Service Management knowledge More ❯

reducing manual workloads, and supporting the council's digital transformation efforts and One Council programme findings. This position will work collaboratively with the RPA officer, our DBA and Data Science specialist. You will design and develop AI solutions to streamline operations and improve service delivery, ensuring solutions are scalable, maintainable, and aligned with One Council objectives. You will … increased efficiency and accuracy through automation and AI solutions. As an Automation and AI specialist, you will document and report on automation projects, including ETL processes designed with Azure Data Factory, detailing the objectives, methodologies, outcomes, and lessons learned to stakeholders at various levels within the council. What you'll need to succeed To … essential for this role. It is critical that you have hands-on experience with automation tools for process discovery, development, and orchestration. Previous experience of cloud platforms, particularly Microsoft Azure, including automating services and managing resources. It is vital that you are familiar with AI and machine learning. Previous experience in a public sector or local government setting More ❯

reducing manual workloads, and supporting the council's digital transformation efforts and One Council programme findings. This position will work collaboratively with the RPA officer, our DBA and Data Science specialist. You will design and develop AI solutions to streamline operations and improve service delivery, ensuring solutions are scalable, maintainable, and aligned with One Council objectives. You will … increased efficiency and accuracy through automation and AI solutions. As an Automation and AI specialist, you will document and report on automation projects, including ETL processes designed with Azure Data Factory, detailing the objectives, methodologies, outcomes, and lessons learned to stakeholders at various levels within the council. What you'll need to succeed To … essential for this role. It is critical that you have hands-on experience with automation tools for process discovery, development, and orchestration. Previous experience of cloud platforms, particularly Microsoft Azure, including automating services and managing resources. It is vital that you are familiar with AI and machine learning. Previous experience in a public sector or local government setting More ❯

reducing manual workloads, and supporting the council's digital transformation efforts and One Council programme findings. This position will work collaboratively with the RPA officer, our DBA and Data Science specialist. You will design and develop AI solutions to streamline operations and improve service delivery, ensuring solutions are scalable, maintainable, and aligned with One Council objectives. You will … increased efficiency and accuracy through automation and AI solutions. As an Automation and AI specialist, you will document and report on automation projects, including ETL processes designed with Azure Data Factory, detailing the objectives, methodologies, outcomes, and lessons learned to stakeholders at various levels within the council. What you'll need to succeed To … essential for this role. It is critical that you have hands-on experience with automation tools for process discovery, development, and orchestration. Previous experience of cloud platforms, particularly Microsoft Azure, including automating services and managing resources. It is vital that you are familiar with AI and machine learning. Previous experience in a public sector or local government setting More ❯

reducing manual workloads, and supporting the council's digital transformation efforts and One Council programme findings. This position will work collaboratively with the RPA officer, our DBA and Data Science specialist. You will design and develop AI solutions to streamline operations and improve service delivery, ensuring solutions are scalable, maintainable, and aligned with One Council objectives. You will … increased efficiency and accuracy through automation and AI solutions. As an Automation and AI specialist, you will document and report on automation projects, including ETL processes designed with Azure Data Factory, detailing the objectives, methodologies, outcomes, and lessons learned to stakeholders at various levels within the council. What you'll need to succeed To … essential for this role. It is critical that you have hands-on experience with automation tools for process discovery, development, and orchestration. Previous experience of cloud platforms, particularly Microsoft Azure, including automating services and managing resources. It is vital that you are familiar with AI and machine learning. Previous experience in a public sector or local government setting More ❯

in the definition of annual roadmaps and technical visions for a variety of current systems based on feedback, technology trends and the broader ICT roadmap. Skills and Experience Azure SQL, Data Factory, Analysis Services and Power BI administration, maintenance, and exploitation Microsoft Azure and Entra administration, maintenance, and exploitation Microsoft Power Platform More ❯

in the definition of annual roadmaps and technical visions for a variety of current systems based on feedback, technology trends and the broader ICT roadmap. Skills and Experience Azure SQL, Data Factory, Analysis Services and Power BI administration, maintenance, and exploitation Microsoft Azure and Entra administration, maintenance, and exploitation Microsoft Power Platform More ❯