7 of 7 Amazon Redshift Jobs in the City of London

reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations … performance considerations AWS Lambda for scalable data processing and orchestration Amazon EventBridge for event-driven and decoupled data pipelines Vector Databases & Embeddings Strong understanding of vector database concepts, indexing strategies, and performance trade-offs Design and implementation of embedding generation pipelines Optimization techniques for semantic search and retrieval accuracy ...

error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge. Build and optimise vector database solutions and embedding generation pipelines for semantic search. Implement document processing workflows (PDF parsing, OCR, metadata ...

/ETL CI/CD Data Modelling Data Architecture Data Frameworks dbt Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred) or AWS Agentic development frameworks Automations About You 6 years+ experience as a Data Engineer solving complex and scaled data ...

with Python Tech (experience in any listed is advantageous) Python Cloud: AWS Lake house: Apache Spark or AWS Glue Cloud Native storage: Iceberg, RDS, RedShift, Kafka IaC: Terraform, Ansible CI/CD: Jenkins, Gitlab Other platforms such as Databricks or Snowflake will be considered You will have a fantastic ...

Tenable, etc.). Advantageous Security certifications such as AWS Security Specialty, AWS Solutions Architect, or equivalent. Experience supporting data platforms on AWS (Glue, EMR, Redshift, Athena, RDS, OpenSearch, Kafka/MSK). Knowledge of secure coding practices in Python/Node/Java or your core development stack. Experience ...

Utilize programming expertise in Python, Scala, and SQL for efficient data processing. Build data pipelines using cloud-native services on AWS, including Lambda, Glue, Redshift, and API Gateway. Monitor and optimise data solutions using AWS CloudWatch and other tools. What We’re Looking For: Proven hands-on experience … with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue, Cloudwatch, etc. Iac experience of deploying AWS resources using terraform Hands-on experience of setting up CI/CD workflows using GitHub Actions ...

growth, coaching, and high-quality delivery. Set technical direction across Python services, distributed systems, and large-scale data processing. Work heavily with AWS — especially Redshift, Lambda, ECS, S3 , plus data formats like Parquet . Shape high-throughput data pipelines and SQL-based workflows , ensuring scalability and performance. Run technical … Collaborate with Product & Design to define technical requirements, prioritise roadmaps, and drive measurable outcomes. Tech Environment You’ll Influence Primary language: Python AWS stack: Redshift, Lambda, ECS, S3 Data workflows: Parquet, SQL, distributed data pipelines Scale: systems processing hundreds of millions to billions of rows Focus areas: performance tuning ...