3 of 3 Permanent Luigi Jobs in London

Proficiency in SQL and relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity or experience with classical NLP techniques (BERT, topic More ❯

projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive More ❯

Experience building and maintaining extremely large-scale ETL pipelines. Proficient in Python and Bash; familiarity with C++. Knowledge of computer networking fundamentals. Experience with ETL orchestration frameworks (e.g., Airflow, Luigi, Dagster). Experience with distributed computing environments (e.g., Slurm, Celery, HTCondor). Preferred: Experience with binary market data specifications (e.g., ITCH, MDP3). Understanding of high-performance filesystems and columnar More ❯