15 of 15 Apache Iceberg Jobs in England

build and manage scalable data pipelines and data analytic solutions that support strategic, ad hoc, and AI-driven data analytics using technologies such as Apache Spark, Apache Flink, Unity Catalog, Apache Hive, Databricks, Apache Iceberg, and Delta Tables. Innovation and Research: Drive innovation by researching … building high-throughput, low-latency systems to support short- and long-running processes at scale. Hands-on experience with event-driven platforms like Apache Kafka, RabbitMQ, Apache Pulsar, and other messaging systems for system integrations and real-time data streaming. Strong background in processing large batch and streaming ...

Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . The candidate will work closely with data … optimize schemas, tables, distribution keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines ...

requirements into efficient data solutions, leveraging modern cloud-based tools and frameworks. Key Responsibilities Design and develop scalable, testable data pipelines utilizing Python and Apache Spark. Orchestrate data workflows using AWS services including Glue, EMR Serverless, Lambda, and S3. Apply industry-standard software engineering practices such as version control …/CD, modular design, and automated testing. Contribute to the development of a lakehouse architecture leveraging Apache Iceberg for efficient data storage and management. Collaborate with business teams to understand requirements and deliver insightful, data-driven solutions. Enhance data pipeline observability and implement basic data quality checks. Participate ...

Russell - and we want you to shape it with us. Your role will involve: Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 Applying modern software engineering practices: version control, CI/… modular design, and automated testing Contributing to the development of a lakehouse architecture using Apache Iceberg Collaborating with business teams to translate requirements into data-driven solutions Building observability into data flows and implementing basic quality checks Participating in code reviews, pair programming, and architecture discussions Continuously learning ...

FICC options trading. Experience with Linux-based, concurrent, low-latency systems. Familiarity with Airflow/Dagster (pipeline orchestration), Kafka (streaming), Delta Lake/Apache Iceberg (data lakes), and relational databases. Exceptional communication skills, comfortable working directly with both engineers and business stakeholders. Degree in Computer Science, Mathematics, Engineering ...

using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort … Responsibilities Provide L2/L3 support for AWS-based data platforms in the telecom domain. Maintain and enhance ETL pipelines built on Glue + Iceberg + Athena + Redshift. Monitor production jobs, fix failures, optimize queries, and ensure SLA adherence. Develop automation for operational workflows using Python. Collaborate with ...

using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort … associated application documentation thoroughly before clicking on the apply button at the bottom of this description. Maintain and enhance ETL pipelines built on Glue Iceberg Athena Redshift. Monitor production jobs, fix failures, optimize queries, and ensure SLA adherence. Develop automation for operational workflows using Python. Collaborate with data architects ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures. Experience building modern data lake/lakehouse architectures (e.g. Apache Iceberg) in cloud environments, with strong knowledge of AWS (S3, Redshift) or Azure data services. Experience with ETL/ELT processes, data ingestion ...

making complex data architectures simple and elegant Be able to explain technical decisions to non-technical humans Bonus points: Experience with Delta Lake/Iceberg, real-time streaming, or LLM orchestration What's on offer: Work on genuinely interesting problems (behavioural + financial data = never boring) Shape the data ...

using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort … Responsibilities Provide L2/L3 support for AWS-based data platforms in the telecom domain. Maintain and enhance ETL pipelines built on Glue + Iceberg + Athena + Redshift. Monitor production jobs, fix failures, optimize queries, and ensure SLA adherence. Develop automation for operational workflows using Python. Collaborate with ...

provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data querying and validation. Experience with Python ...

Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain click apply for full job details ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). ...

experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/… design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). ...

layer) and Channel Analytics Lake (7+ yrs). Expose status and statements APIs with clear SLAs. • Platform Architecture: S3/Glue/Athena/Iceberg lakehouse, Redshift for BI/ops. QuickSight for PO/ops dashboards. Lambda/Step Functions for stream processing orchestration. • Streaming & Ingest: Kafka … Management: Avro/Protobuf + Schema Registry (compatibility, subject strategy, evolution). • AWS Data Stack: S3/Glue/Athena, Redshift, Step Functions, Lambda; Iceberg-ready lakehouse patterns. Kinesis→S3→Glue streaming pipelines; Glue Streaming; DLQ patterns. • Payments & ISO 20022: PAIN/PACS/CAMT, lifecycle modeling, reconciliation/ ...