8 of 8 Part-Time Apache Jobs in London

Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability \n Develop and operate workflow orchestration (e.g., Apache Airflow) to schedule, monitor, and manage data movement and transformations \n Model and transform data for analytics using SQL and dbt to support business intelligence ...

Django, Docker \n Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo \n Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. \n Data acquisition and development of data sets and improving data quality \n Preparing data for predictive and prescriptive modelling ...

with distributed event stores and stream-processing platforms such as Kafka of Kinesis. ● Experience working with batch processing frameworks, such as DBT, Argo Workflows, Apache Airflow, etc. ● Familiarity with Docker, Kubernetes, Amazon EKS ● Familiarity with Continuous Integration with GitHub Actions ● Familiarity with Test-Driven Development and XP Our commitment ...

Django, Docker \n Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo \n Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. \n Data acquisition and development of data sets and improving data quality \n Preparing data for predictive and prescriptive modelling ...

Owning the cloud infrastructure underpinning data systems through a DevOps approach \n Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop \n Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data ...

houses and data mesh \n Strong understanding of best practice DataOps and MLOps \n Up-to-date understanding of various data engineering technologies including Apache Spark, Databricks and Hadoop \n Strong understanding of agile ways of working \n Up-to-date understanding of various programming languages including Python, Scala ...

operate batch and streaming data pipelines with strong scalability, performance, and fault tolerance \n Develop and manage workflow orchestration using tools such as Apache Airflow to support reliable, observable, and well-scheduled data movement and transformations \n Implement and optimize data models and warehouse structures to support analytics … similar) \n Experience automating deployment, releases, and testing in continuous integration and continuous delivery pipelines \n Experience with lakehouse patterns and table formats (e.g., Apache Iceberg) \n Experience with federated query engines such as Trino \n Experience designing automated tests (unit, component, integration, and end-to-end), including ...

Experience with one of Azure/AWS/GCP \n ETL tools like Informatica, Alteryx and Business Glossary tools like Collibra, Azure Purview or Apache Atlas. \n TDD/BDD, Experience working in an Agile development environment \n Identity management and synchronisation will ...