Data Engineer

Azure Data Engineer - Security Cleared

Role Summary:
We're looking for an experienced Azure Data Engineer to join our team and lead the development of scalable, secure, and high-performing data solutions within the Microsoft Azure ecosystem. This role will focus on building and refining data pipelines, enhancing data architecture, and ensuring robust governance and compliance across enterprise data platforms. You'll collaborate closely with cross-functional teams to deliver reliable data products that support business intelligence, analytics, and operational reporting.

Core Responsibilities:

1. Data Engineering & Architecture

• Design and implement end-to-end data pipelines using Azure Data Factory, Synapse Analytics, and Databricks (or Microsoft Fabric where applicable).
• Develop ETL/ELT workflows to integrate and transform data from diverse sources.
• Create and maintain data models to support reporting, dashboards, and analytical use cases.

2. Performance & Reliability

• Audit and enhance existing data infrastructure for improved efficiency and scalability.
• Apply best practices for data validation, error handling, and system monitoring.
• Automate routine tasks using Azure-native tools and scripting languages.

3. Security & Compliance

• Configure and manage Row-Level Security (RLS) and access controls in Power BI and Azure environments.
• Ensure alignment with data governance policies, privacy regulations, and retention standards.
• Maintain comprehensive documentation and metadata for all data assets.

4. Stakeholder Collaboration & Support

• Partner with analysts, data scientists, and business users to deliver trusted and well-structured data solutions.
• Provide support for production issues and troubleshoot data-related problems.
• Contribute to the evolution of the data engineering framework and development processes.

Required Skills & Experience:

• Demonstrated experience in data engineering within the Azure cloud environment.
• Proficiency with Azure Data Factory, Synapse Analytics, Databricks, Azure SQL, and Azure Storage.
• Strong SQL skills and expertise in dimensional modelling (e.g., star/snowflake schemas).
• Familiarity with Power BI dataflows, DAX, and RLS setup.
• Hands-on experience with Python, PySpark, or T-SQL for data processing and automation.
• Understanding of CI/CD practices in data projects using Git and YAML pipelines.
• Solid knowledge of data security, governance, and performance optimisation.

Desirable Skills:

• Exposure to Microsoft Fabric and modern lakehouse architectures.
• Experience integrating data from enterprise platforms (e.g., HR, Finance, CRM, ERP).
• Familiarity with infrastructure-as-code tools like Terraform or ARM templates.
• Background in data warehousing or analytics engineering.