Senior Data Engineer London
- Location
- Greater London, England, United Kingdom
understand business requirements and translate them into robust technical solutions. Contribute to solution architecture, platform design, and technology selection decisions. Implement software engineering and DataOps best practices including testing, observability, CI/CD, version control, and infrastructure automation. Develop and optimise data models, transformations, and storage layers to ensure performance … Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling. Solid understanding of data lakehouse, warehouse, and medallion architecture patterns. Experience applying DevOps and DataOps best practices including CI/CD, automated testing, monitoring, observability, and release management. Experience with Infrastructure as Code technologies such as Terraform, Pulumi, CloudFormation, or Bicep. ...