Azure Data Engineer Microsoft Fabric ETL West London Hybrid/Remote Flexibility

Azure Data Engineer Microsoft Fabric ETL West London Hybrid/Remote Flexibility

We are looking for an experienced Azure Data Engineer to join our agile product delivery teams. In this role, you will leverage your expertise in data analysis, ETL, and cloud technology to discover, model, provision, and store data at scale in the cloud. You will transform these data assets into commercial data products to satisfy internal and external customer requirements.

Key Responsibilities

• Ingest, warehouse, and store data at scale within the Azure cloud platform to create core data assets.

• Apply hands-on experience with Microsoft Fabric through active project work.

• Build high-value Data Products from Data Assets to fulfil commercial needs.

• Collaborate closely with Operations, Architecture, Delivery, Product, and Software Engineering teams to release platform increments.

• Contribute toward solution-level architecture, design, and continuous improvement of ADF and Synapse pipelines.

• Own releases end-to-end from development to production following DevOps and CI/CD methodologies.

• Migrate Legacy databases and storage systems to modern Azure cloud lakes and data warehouses.

• Integrate AI-driven capabilities into the coding, testing, and documentation of data engineering artifacts.

Essential Skills:

• Minimum 3+ years of hands-on experience designing and developing complex ETL/ELT pipelines in the cloud using Azure Data Factory and Azure Synapse.

• Practical experience working in both Serverless and SQL pools in Synapse Analytics.

• Direct client project experience working within Microsoft Fabric.

• Strong background in creating detailed data mappings from high-level requirements to solution-level execution.

• Comprehensive understanding of data warehousing concepts across lakes and traditional databases, covering the full ETL life cycle.

• Proficiency in relational databases (SQL Server, MySQL), NoSQL, writing complex queries, and developing Stored Procedures.

• Hands-on experience working with PySpark Notebooks for data ingestion and provisioning.

• Strong understanding of Agile methodologies, automation Scripting, and DevOps/CI/CD pipelines.

Desirable Skills:

• Coding experience in Python, PySpark, or similar languages.

• Experience utilizing AI-driven automation for coding, documentation, and testing.

• Exposure to other Azure technologies such as Power BI and Power Automate.

• Experience working with non-relational databases (CosmosDB, MongoDB) and handling unstructured data.

• Prior background working in the automotive or intelligence/data-provider industries.

Soft Skills:

• Strong communication, problem-solving, and collaboration skills.

• High attention to detail with the ability to meet tight deadlines.

Please forward your CV ASAP for immediate consideration