1 to 25 of 26 Apache Iceberg Jobs in the UK

support the tooling to create pipelines that are used for real time decision making in the milliseconds range. Some of the technologies we use: Apache Flink Apache Iceberg K8s operators Kafka Streams What do you need? We are fully aware that it is uncommon for a candidate ...

support the tooling to create pipelines that are used for real time decision making in the milliseconds range. Some of the technologies we use: Apache Flink Apache Iceberg K8s operators Kafka Streams What do you need? We are fully aware that it is uncommon for a candidate ...

create pipelines that are used for real time decision making in the milliseconds range. Some of the technologies we use: \n \n \n Apache Flink \n \n Apache Iceberg \n \n K8s operators \n \n Kafka Streams \n\n What do you need? \n We are fully ...

create pipelines that are used for real time decision making in the milliseconds range. Some of the technologies we use: \n \n \n Apache Flink \n \n Apache Iceberg \n \n K8s operators \n \n Kafka Streams \n\n What do you need? \n We are fully ...

Build and operate batch and streaming data pipelines with strong scalability, performance, and fault tolerance Develop and manage workflow orchestration using tools such as Apache Airflow to support reliable, observable, and well-scheduled data movement and transformations Implement and optimize data models and warehouse structures to support analytics … Beam, or similar) Experience automating deployment, releases, and testing in continuous integration and continuous delivery pipelines Experience with lakehouse patterns and table formats (e.g., Apache Iceberg) Experience with federated query engines such as Trino Experience designing automated tests (unit, component, integration, and end-to-end), including ...

Build and operate batch and streaming data pipelines with strong scalability, performance, and fault tolerance Develop and manage workflow orchestration using tools such as Apache Airflow to support reliable, observable, and well-scheduled data movement and transformations Implement and optimize data models and warehouse structures to support analytics … Beam, or similar) Experience automating deployment, releases, and testing in continuous integration and continuous delivery pipelines Experience with lakehouse patterns and table formats (e.g., Apache Iceberg) Experience with federated query engines such as Trino Experience designing automated tests (unit, component, integration, and end-to-end), including ...

operate batch and streaming data pipelines with strong scalability, performance, and fault tolerance \n Develop and manage workflow orchestration using tools such as Apache Airflow to support reliable, observable, and well-scheduled data movement and transformations \n Implement and optimize data models and warehouse structures to support analytics … similar) \n Experience automating deployment, releases, and testing in continuous integration and continuous delivery pipelines \n Experience with lakehouse patterns and table formats (e.g., Apache Iceberg) \n Experience with federated query engines such as Trino \n Experience designing automated tests (unit, component, integration, and end-to-end), including ...

operate batch and streaming data pipelines with strong scalability, performance, and fault tolerance \n Develop and manage workflow orchestration using tools such as Apache Airflow to support reliable, observable, and well-scheduled data movement and transformations \n Implement and optimize data models and warehouse structures to support analytics … similar) \n Experience automating deployment, releases, and testing in continuous integration and continuous delivery pipelines \n Experience with lakehouse patterns and table formats (e.g., Apache Iceberg) \n Experience with federated query engines such as Trino \n Experience designing automated tests (unit, component, integration, and end-to-end), including ...

validation (e.g., schema tests, data quality checks). Manage data documentation and lineage within DBT. Design and develop scalable data pipelines using Databricks and Apache Spark. Build and optimize data workflows for batch and real-time processing. Transform and process large datasets using PySpark, SQL, and Delta Lake. Implement … terraform enterprise , Snowflake terraform provider knowledge. Snowflake : Snow sight , Python SDK for snowflake , Stage , storage integration , Data marketplace , direct shares , listings , catalog linked database , Apache Iceberg , external tables , Catalog integrations , Snowpipe , external volume , Cortex ai ,privatelink. Airflow : Dag creation , operators , connections , deployment on Kubernetes , Astronomer. DBT. ...

Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats, as well as batch and streaming processing Knowledge of data quality, governance, cataloguing and observability tools (e.g. Datadog), with ...

markets experience Term structure modelling, stochastic calculus or Monte Carlo methods Interest rate curve bootstrapping Algorithmic execution experience Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) We’re people without borders—without judgement or prejudice, too. We want to work with the best people, no matter their background. ...

calculus or Monte Carlo methods \n \n Interest rate curve bootstrapping \n \n Algorithmic execution experience \n \n Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) \n\n We’re people without borders — without judgement or prejudice, too. We want to work with the best people, no matter ...

calculus or Monte Carlo methods \n \n Interest rate curve bootstrapping \n \n Algorithmic execution experience \n \n Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) \n\n We’re people without borders — without judgement or prejudice, too. We want to work with the best people, no matter ...

markets experience Term structure modelling, stochastic calculus or Monte Carlo methods Interest rate curve bootstrapping Algorithmic execution experience Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) We’re people without borders — without judgement or prejudice, too. We want to work with the best people, no matter their background. ...

markets experience Term structure modelling, stochastic calculus or Monte Carlo methods Interest rate curve bootstrapping Algorithmic execution experience Data lake or warehouse experience (Snowflake, Iceberg, Spark etc.) We re people without borders without judgement or prejudice, too. We want to work with the best people, no matter their background. ...

Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code No-Code Data Science solutions (Dataiku, Knime), Data Virtualisation (Dataiku, Ab Initio, Starburst), Data Visualisation (Power ...

execute. You have deep experience designing, building, and operating production data pipelines, including owning reliability, monitoring, and failure recovery for orchestration systems such as Apache Airflow (or equivalent). You are fluent in modern data and cloud ecosystems, with hands-on experience (or the ability to ramp quickly … technologies such as Iceberg, Spark, PostgreSQL, and cloud-native infrastructure on AWS (or equivalent). You write clean, readable, and testable Python code, applying sound abstractions, naming, and review discipline to build systems that scale beyond the first version. You bring strong analytical and problem-solving skills ...

technical direction within your team Required Experience: Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other … Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes We appreciate you may not be an expert ...

Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability \n Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations \n Model and transform data for analytics using SQL and dbt to support business intelligence … with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) \n Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt) \n Experience designing and operating orchestration pipelines using ...

Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability \n Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations \n Model and transform data for analytics using SQL and dbt to support business intelligence … with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) \n Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt) \n Experience designing and operating orchestration pipelines using ...

PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence … with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt) Experience designing and operating orchestration pipelines using Airflow ...

PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence … with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar) Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt) Experience designing and operating orchestration pipelines using Airflow ...

with large-scale and unstructured datasets. Python development experience, including technologies such as PySpark, Pandas and PyArrow. Expertise in distributed data processing frameworks, particularly Apache Spark. Experience building and maintaining ETL pipelines using technologies such as Apache Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience … including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch, S3 and Data Lake architectures. Containerisation and orchestration experience using Docker, Kubernetes and/or OpenShift. Knowledge of testing frameworks, engineering standards ...

cloud-first environment built on Google Cloud Platform, with workloads deployed on GKE and leveraging technologies such as Spark, Python, SQL, Trino, Databricks SQL, Apache Arrow, Apache Kafka and Iceberg. The role involves close collaboration with other engineering and data teams in a professional setting that values reliability … data processing solutions on cloud infrastructure, particularly within GCP and GKE environments. Drive the adoption and effective use of Databricks SQL, Trino and Apache Arrow to improve performance, reliability and developer productivity. Manage streaming and real-time data processing solutions using Apache Kafka, ensuring resilient, low-latency data ...

cloud-first environment built on Google Cloud Platform, with workloads deployed on GKE and leveraging technologies such as Spark, Python, SQL, Trino, Databricks SQL, Apache Arrow, Apache Kafka and Iceberg. The role involves close collaboration with other engineering and data teams in a professional setting that values reliability … data processing solutions on cloud infrastructure, particularly within GCP and GKE environments. Drive the adoption and effective use of Databricks SQL, Trino and Apache Arrow to improve performance, reliability and developer productivity. Manage streaming and real-time data processing solutions using Apache Kafka, ensuring resilient, low-latency data ...