Proven experience as a Data Architect or Lead Data Engineer in AWS environments* Deep understanding of cloud-native data services: S3, Redshift, Glue, Athena, EMR, Kinesis, Lambda* Strong hands-on expertise in data modelling, distributed systems, and pipeline orchestration (Airflow, Step Functions)* Background in energy, trading, or financial markets is a strong plus* Excellent knowledge of Python, SQL, and More ❯
Milton Keynes, Buckinghamshire, South East, United Kingdom
Upbeat Ideas UK Ltd
sources. Document test results and provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data querying and validation. Experience with Python for scripting and automation. Familiarity More ❯
engage with clients, learn domain knowledge, be proactive and curious in addition to standard tech would be ideal for the role. Tech Stack: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL), Glue, Glue Data Catalog Python Current frontend is Tableau but experience with any of them will be interchangeable DevOps experience a bonus e.g. Terraform, Drone, Kubernetes More ❯
