6 of 6 Permanent Apache Iceberg Jobs in the South East

business. This role is ideal for someone with strong AWS experience and a background working with modern data tooling including dbt, PySpark, Airflow, Redshift, Iceberg, OpenSearch, Knowledge Graphs, Python, and CircleCI . Key Responsibilities Design and develop scalable ETL/ELT data pipelines using Python and PySpark Build … maintain data transformation frameworks using dbt Develop and orchestrate workflows using Apache Airflow Deliver high-performance data warehouse solutions within Amazon Redshift Support the implementation and optimisation of Apache Iceberg lakehouse architectures Develop and enhance search capabilities using OpenSearch Work with Knowledge Graph technologies to improve data ...

based data platform. Key Skills Required Strong AWS data engineering experience Hands-on expertise with DBT and PySpark Proven Python development skills Experience with Apache Airflow for orchestration Strong knowledge of Amazon Redshift Experience with Apache Iceberg and modern data lake architectures Familiarity with OpenSearch for search ...

Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats, as well as batch and streaming processing Knowledge of data quality, governance, cataloguing and observability tools (e.g. Datadog), with ...

with machine learning engineers on model development and deployment Desirable : Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt , Apache Iceberg, Trino, Dagster , Dask ) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What ...

with machine learning engineers on model development and deployment Desirable : Direct experience with elements of our technology stack (Azure IoT Edge, Azure Storage, dbt , Apache Iceberg, Trino, Dagster , Dask ) Experience with IoT data processing or edge computing environments Familiarity with time-series data and acoustic signal processing What ...

driven architectures or data pipelines. Also Welcome Kubernetes. Deploying, running or debugging workloads, including K3s, RKE2 or OpenShift. Data at scale. Spark, Trino, Parquet, Iceberg or similar columnar and distributed query tooling. GPU workloads and serving models on-premise. Open source contributions or a portfolio worth a look. Mentoring ...