3 Luigi Jobs in London

data tools: Hadoop, Spark, Kafka, etc.· Experience with relational SQL and NoSQL databases, particularly Postgres.· Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.· Experience with AWS cloud services: EC2, EMR, RDS, Redshift.· Experience with multiple data architecture paradigms (relational, non-structured, streaming)· Knowledge of various data more »

or NoSQL, and Cloud versions AWS (/Azure/GCP) 1st class Degree Numerate with expert problem solving skills Desired Workflow mgmt systems: Airflow, Luigi, Kedro Visualization tools: Tableu, Alteryx, Celonis FEnd exp: Angular, React more »

models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client … SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data more »