Milton Keynes, Buckinghamshire, South East, United Kingdom
Upbeat Ideas UK Ltd
data sources. Document test results and provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data querying and validation. Experience with Python for scripting and automation. More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
Glue Glue Data Catalog EMR services API Gateway Relational database experience with Aurora Postgres (including query performance tuning). Spark experience, including pipelines using Spark on data stored in iceberg table format in S3 and federated through Aurora Postgres. Proven experience with data modeling, medallion/lakehouse architectures, and financial domain familiarity. Ability to solve problems independently and deliver More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Robert Half
manage data solutions on AWS using serverless technologies such as Lambda, Glue, Glue Data Catalog, EMR serverless, and API Gateway. Implement and manage large-scale data processing with Spark (Iceberg tables in S3, Gold layer in Aurora Postgres). Collaborate with data scientists, analysts, and stakeholders to ensure data availability, accessibility, and reliability. Design and maintain robust data models … particularly with serverless data engineering tools (Lambda, Glue, Glue Data Catalog, EMR serverless, API Gateway, S3). Solid Spark experience with large-scale data pipelines and data lakehouse architectures (Iceberg format a plus). Hands-on experience with data modelling and designing scalable data architectures. Strong understanding of the financial domain (preferred but not mandatory). Excellent problem-solving More ❯