18 of 18 Permanent Apache Iceberg Jobs in London

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning ...

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning ...

many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

Azure. Develop and maintain Parquet-based data layers; contribute to evolving the data lake architecture and metadata management. Implement dataset versioning and management using Apache Iceberg. Collaborate closely with trading and quant teams to translate data requirements into robust, production-grade pipelines. Implement monitoring, validation, and automated error-handling … optimisation and concurrency. Proven experience designing, building, and tuning tick-data pipelines for high-volume environments. Hands-on experience with Parquet storage; experience with Apache Iceberg or similar table formats is a plus. Practical experience with containerisation (Docker) and orchestration platforms (Kubernetes). Strong background in profiling, debugging ...

Azure. Develop and maintain Parquet-based data layers; contribute to evolving the data lake architecture and metadata management. Implement dataset versioning and management using Apache Iceberg. Collaborate closely with trading and quant teams to translate data requirements into robust, production-grade pipelines. Implement monitoring, validation, and automated error-handling … optimisation and concurrency. Proven experience designing, building, and tuning tick-data pipelines for high-volume environments. Hands-on experience with Parquet storage; experience with Apache Iceberg or similar table formats is a plus. Practical experience with containerisation (Docker) and orchestration platforms (Kubernetes). Strong background in profiling, debugging ...

data stack (Glue, OpenSearch, RDS) Expert skills within SQL with experience in both transactional RDBMS systems and distributed systems Hands-on with Lakehouse technologies (Apache Iceberg, S3 Tables, StarRocks) Strong grasp of data governance, schema design, and quality frameworks Comfortable leading infrastructure decisions and collaborating across distributed teams ...

event routing and filtering Schema Management: Avro, Protobuf Schema Registry: compatibility, subject strategy, evolution AWS Data Stack: S3, Glue, Athena, Redshift Step Functions, Lambda Iceberg-ready lakehouse patterns Streaming Pipelines: Kinesis → S3 → Glue Glue Streaming DLQ patterns Minimum years of experience: > 10 years ...

event routing and filtering Schema Management: Avro, Protobuf Schema Registry: compatibility, subject strategy, evolution AWS Data Stack: S3, Glue, Athena, Redshift Step Functions, Lambda Iceberg-ready lakehouse patterns Streaming Pipelines: Kinesis → S3 → Glue Glue Streaming DLQ patterns Minimum years of experience: > 10 years ...

Strong communication skills and experience working cross-functionally Required Skills Experience consuming data from event streams Familiarity with modern table formats (e.g. Iceberg or similar) Exposure to BI and dashboarding tools Experience improving data observability and monitoring Comfort working in Linux or Unix environments Preferred Skills High ownership ...

Strong communication skills and experience working cross-functionally Required Skills Experience consuming data from event streams Familiarity with modern table formats (e.g. Iceberg or similar) Exposure to BI and dashboarding tools Experience improving data observability and monitoring Comfort working in Linux or Unix environments Preferred Skills High ownership ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (eg, S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, Scripting, and automation). Data Streaming: Familiarity with streaming data technologies (eg, Kinesis, Kafka, or similar). ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). ...

Data Lake (long-term historical layer) Define and expose status and statement APIs with clear SLAs. Architect AWS lakehouse solutions using S3, Glue, Athena, Iceberg, and Redshift . Enable analytics and dashboards using Amazon QuickSight . Streaming & Event-Driven Design Build event-driven pipelines using Kafka (Confluent/… schema evolution & governance Proven experience in ISO 20022 payments messaging (PAIN, PACS, CAMT, SWIFT MX) Strong background in AWS Lakehouse using S3, Glue, Athena, Iceberg , Redshift Experience using Amazon EventBridge for event routing/orchestration Solid understanding of data modeling, CQRS, event sourcing & DDD Strong AWS experience: Lambda, Step ...

Data Lake (long-term historical layer) Define and expose status and statement APIs with clear SLAs. Architect AWS lakehouse solutions using S3, Glue, Athena, Iceberg, and Redshift . Enable analytics and dashboards using Amazon QuickSight . Streaming & Event-Driven Design Build event-driven pipelines using Kafka (Confluent/… schema evolution & governance Proven experience in ISO 20022 payments messaging (PAIN, PACS, CAMT, SWIFT MX) Strong background in AWS Lakehouse using S3, Glue, Athena, Iceberg , Redshift Experience using Amazon EventBridge for event routing/orchestration Solid understanding of data modeling, CQRS, event sourcing & DDD Strong AWS experience: Lambda, Step ...

retention, 7+ years) Define and expose data APIs and status/statement services with clear SLAs. Architect an AWS lakehouse using S3, Glue, Athena, Iceberg , with Redshift for BI and operational analytics. Enable dashboards and reporting using Amazon QuickSight (or equivalent BI tools). Streaming & Event-Driven Architecture Design … using EventBridge for event routing and filtering AWS Data Platform Hands-on experience with: S3, Glue, Athena Redshift Step Functions and Lambda Familiarity with Iceberg-based lakehouse architectures Experience building streaming pipelines into S3 and Glue Payments & Financial Messaging Experience with payments data and flows Knowledge ...