Data Engineer
London, South East, England, United Kingdom
Hybrid / WFH Options
Hybrid / WFH Options
Robert Half
reliable, and high-performance data pipelines and workflows. Develop clean, maintainable, and testable code in Python for data ingestion, transformation, and processing. Optimise and fine-tune query performance on Aurora Postgres and other relational databases. Architect and manage data solutions on AWS using serverless technologies such as Lambda, Glue, Glue Data Catalog, EMR serverless, and API Gateway. Implement and … manage large-scale data processing with Spark (Iceberg tables in S3, Gold layer in Aurora Postgres). Collaborate with data scientists, analysts, and stakeholders to ensure data availability, accessibility, and reliability. Design and maintain robust data models that align with business and financial domain requirements. Ensure best practices for data security, governance, and compliance. Profile Strong Python development skills … with experience writing clean, extensible, and testable code. Proven experience with relational databases (Aurora Postgres preferred), including performance optimisation. Extensive AWS experience, particularly with serverless data engineering tools (Lambda, Glue, Glue Data Catalog, EMR serverless, API Gateway, S3). Solid Spark experience with large-scale data pipelines and data lakehouse architectures (Iceberg format a plus). Hands-on experience More ❯
Employment Type: Contractor
Rate: Salary negotiable
Posted: