2 of 2 DemandTrendPermanent Senior Data Engineer Jobs in the East of England

Senior Data Engineer We're looking for a Senior Data Engineer to join our Data & Analytics team at Willmott Dixon to help drive the next wave of our data platform in Microsoft Fabric. Although the IT team are based at our head office in Letchworth Garden City, this role can be done … as either a hybrid, or a remote role. Occasional travel to other sites may be required according to business needs. What you'll do: As a Senior Data Engineer, you'll be at the heart of designing and delivering scalable, reliable data products and pipelines that power decision-making and drive business performance. You'll work … closely with analysts, developers, and stakeholders to align data engineering efforts with business goals and needs. You'll play a key role in shaping how we deliver a trusted, single source of truth platform for the organisation, building the foundations for self-service analytics and smarter, faster insights. But this is more than just a technical role. You'll More ❯

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools … like Apache Spark to ensure seamless data flow. Monitoring and Failure Recovery: Implement monitoring procedures to detect failures or unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage … processing, and transfer. Ensure the scalability and reliability of data solutions using Azure's suite of services. Collaboration and Leadership Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs. Provide technical leadership and mentorship to junior data engineers, fostering a culture of continuous learning and More ❯