10 of 10 Permanent Luigi Jobs in London

projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based Working collaboratively with the client and cross-functional teams to … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc Data acquisition and development of data sets and improving data quality Preparing data for predictive More ❯

Snowflake, Redshift). Strong data modeling skills , including experience with dimensional modeling and designing for analytics. Solid experience building and maintaining data pipelines using orchestration tools (e.g., Airflow, Prefect, Luigi) and transformation frameworks (e.g., dbt or custom SQL-based workflows). Proficiency in Python , especially for data-related scripting and workflow automation. Comfort with cloud platforms (e.g., GCP, AWS, or More ❯

R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with big data tools (Hadoop, Spark, Kafka), cloud platforms (Azure, AWS, GCP), and workflow tools (Airflow, Luigi) Bonus: experience with BI tools , API integrations , and graph databases Why Join Us? Work with large-scale, high-impact data Solve real-world problems with a top-tier team Flexible More ❯

R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with big data tools (Hadoop, Spark, Kafka), cloud platforms (Azure, AWS, GCP), and workflow tools (Airflow, Luigi) Bonus: experience with BI tools , API integrations , and graph databases Why Join Us? Work with large-scale, high-impact data Solve real-world problems with a top-tier team Flexible More ❯

experience required (experience building on top of dbt core libraries would be awesome) Experience with Snowflake desired (or other cloud database platform) Experience with workflow management frameworks like Airflow, Luigi, Dagster, etc You are proficient in Python and/or another data centric language You have experience building highly observable data systems You are familiar with dimensional data modeling techniques More ❯

and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such as Python Reporting tools More ❯

Snowflake, Redshift). Strong data modelling skills , including experience with dimensional modelling and designing for analytics. Solid experience building and maintaining data pipelines using orchestration tools (e.g., Airflow, Prefect, Luigi) and transformation frameworks (e.g., dbt or custom SQL-based workflows). Proficiency in Python , especially for data-related scripting and workflow automation. Comfort with cloud platforms (e.g., GCP, AWS, or More ❯

R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with big data tools (Hadoop, Spark, Kafka), cloud platforms (Azure, AWS, GCP), and workflow tools (Airflow, Luigi) Bonus: experience with BI tools , API integrations , and graph databases Why Join Us? Work with large-scale, high-impact data Solve real-world problems with a top-tier team Flexible More ❯

or game engines technologies Preferred Qualifications * Designing and implementing real-time pipelines. * Designing and implementing data pipelines for CV/ML systems. * Experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M). * Experience with data quality and validation. * Experience querying massive datasets using Spark, Presto, Hive, Impala More ❯

significant impact you have had on a business through the application of technology Proven experience of data engineering across the following (or similar) technologies: Python, data orchestration platforms (Airflow, Luigi, Dagster, etc...), data quality frameworks, data lakes/warehouses Ability to design and implement scalable and resilient data systems Excellent communication skills and ability to collaborate effectively in a cross More ❯