1 to 25 of 29 Apache Iceberg Jobs in London

processing of real-time data streams and create scalable ingestion and transformation workflows using Python, SQL, and modern Lakehouse technologies such as Iceberg, Parquet, and Apache Hudi. This is a rare opportunity to join at an early stage and become one of the most senior technical contributors, helping … enterprise environment. Experienced with end-to-end involvement in building a data Lakehouse. Solid knowledge of related data Lakehouse technologies like Parquet, Apache Iceberg, Apache Hudi, Spark (or similar). Strong Computer Science, Engineering (or a related subject) background. Able to work in a modern software engineering ...

processing of real-time data streams and create scalable ingestion and transformation workflows using Python, SQL, and modern Lakehouse technologies such as Iceberg, Parquet, and Apache Hudi. This is a rare opportunity to join at an early stage and become one of the most senior technical contributors, helping … enterprise environment. Experienced with end-to-end involvement in building a data Lakehouse. Solid knowledge of related data Lakehouse technologies like Parquet, Apache Iceberg, Apache Hudi, Spark (or similar). Strong Computer Science, Engineering (or a related subject) background. Able to work in a modern software engineering ...

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning ...

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning ...

many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best ...

using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort … Responsibilities Provide L2/L3 support for AWS-based data platforms in the telecom domain. Maintain and enhance ETL pipelines built on Glue + Iceberg + Athena + Redshift. Monitor production jobs, fix failures, optimize queries, and ensure SLA adherence. Develop automation for operational workflows using Python. Collaborate with ...

local language Ability to lead end-to-end technical engagements and work in fast-paced environments AWS Solutions Architect – Associate certification Experience with Iceberg– an advantage Experience with Kubernetes, CI/CD, and DevOps tools – an advantage Experience with ETL processes, data lakes, and pipelines – an advantage Experience writing ...

local language Ability to lead end-to-end technical engagements and work in fast-paced environments AWS Solutions Architect – Associate certification Experience with Iceberg– an advantage Experience with Kubernetes, CI/CD, and DevOps tools – an advantage Experience with ETL processes, data lakes, and pipelines – an advantage Experience writing ...

event routing and filtering Schema Management: Avro, Protobuf Schema Registry: compatibility, subject strategy, evolution AWS Data Stack: S3, Glue, Athena, Redshift Step Functions, Lambda Iceberg-ready lakehouse patterns Streaming Pipelines: Kinesis → S3 → Glue Glue Streaming DLQ patterns Minimum years of experience: > 10 years ...

event routing and filtering Schema Management: Avro, Protobuf Schema Registry: compatibility, subject strategy, evolution AWS Data Stack: S3, Glue, Athena, Redshift Step Functions, Lambda Iceberg-ready lakehouse patterns Streaming Pipelines: Kinesis → S3 → Glue Glue Streaming DLQ patterns Minimum years of experience: > 10 years ...

event routing and filtering Schema Management: Avro, Protobuf Schema Registry: compatibility, subject strategy, evolution AWS Data Stack: S3, Glue, Athena, Redshift Step Functions, Lambda Iceberg-ready lakehouse patterns Streaming Pipelines: Kinesis S3 Glue Glue Streaming DLQ patterns If you are interested in this position and would like to learn ...

management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). AWS data stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/ ...

management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). AWS data stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/ ...

management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). - AWS data stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis's3 Glue streaming pipelines; Glue Streaming; DLQ patterns. - Payments & ISO 20022: PAIN/PACS/CAMT, life cycle modelling, reconciliation ...

Strong communication skills and experience working cross-functionally Required Skills Experience consuming data from event streams Familiarity with modern table formats (e.g. Iceberg or similar) Exposure to BI and dashboarding tools Experience improving data observability and monitoring Comfort working in Linux or Unix environments Preferred Skills High ownership ...

Strong communication skills and experience working cross-functionally Required Skills Experience consuming data from event streams Familiarity with modern table formats (e.g. Iceberg or similar) Exposure to BI and dashboarding tools Experience improving data observability and monitoring Comfort working in Linux or Unix environments Preferred Skills High ownership ...

Management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). • AWS Data Stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. • Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/ ...

Management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). • AWS Data Stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. • Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/ ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (eg, S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, Scripting, and automation). Data Streaming: Familiarity with streaming data technologies (eg, Kinesis, Kafka, or similar). ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). ...

Data Lake (long-term historical layer) Define and expose status and statement APIs with clear SLAs. Architect AWS lakehouse solutions using S3, Glue, Athena, Iceberg, and Redshift . Enable analytics and dashboards using Amazon QuickSight . Streaming & Event-Driven Design Build event-driven pipelines using Kafka (Confluent/… schema evolution & governance Proven experience in ISO 20022 payments messaging (PAIN, PACS, CAMT, SWIFT MX) Strong background in AWS Lakehouse using S3, Glue, Athena, Iceberg , Redshift Experience using Amazon EventBridge for event routing/orchestration Solid understanding of data modeling, CQRS, event sourcing & DDD Strong AWS experience: Lambda, Step ...