Senior Data Engineer New London
- Location
- Greater London, England, United Kingdom
EventBridge, Kinesis Firehose, S3, and are auto-ingested into Snowflake via Snowpipe; batch and third-party data lands through Snowpark-deployed Python procedures. All infrastructure is defined in Terraform/Terragrunt. Python (Poetry, Pydantic, pytest) is our pipeline language; GitHub Actions runs CI/CD. Datadog gives … as Snowflake Tasks. Schema Evolution: Work with product engineers to manage upstream schema changes and late-arriving data without breaking downstream consumers. Infrastructure & Reliability Infrastructure as Code: Own and extend Terraform/Terragrunt modules for ingestion infrastructure across multiple environments. Pipeline ...