10 of 10 Apache Iceberg Jobs in London

requirements into efficient data solutions, leveraging modern cloud-based tools and frameworks. Key Responsibilities Design and develop scalable, testable data pipelines utilizing Python and Apache Spark. Orchestrate data workflows using AWS services including Glue, EMR Serverless, Lambda, and S3. Apply industry-standard software engineering practices such as version control …/CD, modular design, and automated testing. Contribute to the development of a lakehouse architecture leveraging Apache Iceberg for efficient data storage and management. Collaborate with business teams to understand requirements and deliver insightful, data-driven solutions. Enhance data pipeline observability and implement basic data quality checks. Participate ...

Russell - and we want you to shape it with us. Your role will involve: Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 Applying modern software engineering practices: version control, CI/… modular design, and automated testing Contributing to the development of a lakehouse architecture using Apache Iceberg Collaborating with business teams to translate requirements into data-driven solutions Building observability into data flows and implementing basic quality checks Participating in code reviews, pair programming, and architecture discussions Continuously learning ...

FICC options trading. Experience with Linux-based, concurrent, low-latency systems. Familiarity with Airflow/Dagster (pipeline orchestration), Kafka (streaming), Delta Lake/Apache Iceberg (data lakes), and relational databases. Exceptional communication skills, comfortable working directly with both engineers and business stakeholders. Degree in Computer Science, Mathematics, Engineering ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures. Experience building modern data lake/lakehouse architectures (e.g. Apache Iceberg) in cloud environments, with strong knowledge of AWS (S3, Redshift) or Azure data services. Experience with ETL/ELT processes, data ingestion ...

making complex data architectures simple and elegant Be able to explain technical decisions to non-technical humans Bonus points: Experience with Delta Lake/Iceberg, real-time streaming, or LLM orchestration What's on offer: Work on genuinely interesting problems (behavioural + financial data = never boring) Shape the data ...

using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort … Responsibilities Provide L2/L3 support for AWS-based data platforms in the telecom domain. Maintain and enhance ETL pipelines built on Glue + Iceberg + Athena + Redshift. Monitor production jobs, fix failures, optimize queries, and ensure SLA adherence. Develop automation for operational workflows using Python. Collaborate with ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (eg, S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, Scripting, and automation). Data Streaming: Familiarity with streaming data technologies (eg, Kinesis, Kafka, or similar). ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). ...

layer) and Channel Analytics Lake (7+ yrs). Expose status and statements APIs with clear SLAs. • Platform Architecture: S3/Glue/Athena/Iceberg lakehouse, Redshift for BI/ops. QuickSight for PO/ops dashboards. Lambda/Step Functions for stream processing orchestration. • Streaming & Ingest: Kafka … Management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). • AWS Data Stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. • Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/ ...