1 to 25 of 75 Apache Iceberg Jobs in the UK excluding London

build and manage scalable data pipelines and data analytic solutions that support strategic, ad hoc, and AI-driven data analytics using technologies such as Apache Spark, Apache Flink, Unity Catalog, Apache Hive, Databricks, Apache Iceberg, and Delta Tables. Innovation and Research: Drive innovation by researching … building high-throughput, low-latency systems to support short- and long-running processes at scale. Hands-on experience with event-driven platforms like Apache Kafka, RabbitMQ, Apache Pulsar, and other messaging systems for system integrations and real-time data streaming. Strong background in processing large batch and streaming ...

Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . The candidate will work closely with data … optimize schemas, tables, distribution keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, Unity Catalog, and Apache Atlas to maintain data integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining … scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance ...

Russell - and we want you to shape it with us. Your role will involve: Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 Applying modern software engineering practices: version control, CI/… modular design, and automated testing Contributing to the development of a lakehouse architecture using Apache Iceberg Collaborating with business teams to translate requirements into data-driven solutions Building observability into data flows and implementing basic quality checks Participating in code reviews, pair programming, and architecture discussions Continuously learning ...

FICC options trading. Experience with Linux-based, concurrent, low-latency systems. Familiarity with Airflow/Dagster (pipeline orchestration), Kafka (streaming), Delta Lake/Apache Iceberg (data lakes), and relational databases. Exceptional communication skills, comfortable working directly with both engineers and business stakeholders. Degree in Computer Science, Mathematics, Engineering ...