Data Engineer

Data Engineer (Inside IR35)

£425 Per day

SC Cleared - A must to be considered for this opportunity

London

To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats and limited automation. A Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery.

Key Responsibilities

• Design, build, and maintain scalable data pipelines to ingest, transform, and store data from multiple sources.
• Develop and manage data models, schemas, and metadata to support analytics and reporting needs.
• Collaborate with Data Analysts, Data Scientists, and Business Analysts to ensure data availability, accessibility, and usability.
• Implement data quality checks, validation routines, and monitoring to ensure data integrity and reliability.
• Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark).
• Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow).
• Ensure adherence to data governance, security, and privacy policies.
• Document data architecture, pipelines, and processes to support transparency and knowledge sharing.
• Contribute to the development of a modern data platform that supports both real-time and batch processing.