1 of 1 Azure Jobs in Monmouthshire

seasoned Senior Data Engineer (Infrastructure) to join our team. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments. The position involves deploying and managing scalable data operations that support advanced analytics and data-driven decision-making, crucial for our organisational growth and innovation. Requirements Develop … and maintain efficient and reliable data pipelines using Python, capable of supporting both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments. Hybrid Cloud and Data Storage Solutions: Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure, ensuring seamless data integration and accessibility across platforms. … scripting and automating data processes across varied environments. Experience with ETL/ELT: Demonstrable experience in developing and optimising ETL or ELT workflows, particularly in hybrid (on-premises and Azure) environments. Expertise in Hybrid Cloud Data Architecture: Profound knowledge of integrating on-premises infrastructure with Azure cloud services. Containerisation and Orchestration Expertise: Solid experience with Docker and Kubernetes More ❯