Data Engineer
Derby, Derbyshire, East Midlands, United Kingdom
Expleo Group
technological change to successfully deliver innovations that will help them gain a competitive advantage and improve the everyday lives of people around the globe. We are seeking a talented Data Engineer to join our team. As a Data Engineer, you will work with a variety of technologies including Python, Py-Spark, Pandas, SQL and Azure DevOps. You will … be responsible for modeling and implementing predictive maintenance solutions for our products, specifically focusing on jet engines. Responsibilities Collaborate with stakeholders to understand data migration requirements Work with diverse data formats and source/target databases Design, develop, test, and maintain data migration modules Analyse and address data quality issues at both the source and destination … and resolve issues reported in live systems to ensure minimal downtime Document migration processes and provide regular progress updates Essential skills Strong experience with Databricks Proficient in SQL for data querying and transformation Solid understanding of Azure Services including: Azure Data Factory Azure Storage Containers Lakehouse architecture Expertise in PySpark for big data processing In-depth More ❯
Employment Type: Permanent
Posted: