tools: Hadoop, Spark, Kafka, etc. · Experience with relational SQL and NoSQL databases, particularly Postgres . · Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. · Experience with AWS cloud services: EC2, EMR, RDS, Redshift. · Experience with multiple data architecture paradigms (relational, non-structured, streaming) · Knowledge of various data more »
as Jenkins, Azure Pipelines. Good understanding of a cloud-based microservice architecture, Experience with specialized Python data management libraries, including SQLAlchemy, DBT, Airflow/Luigi, Pandera. Practical experience with SQL database development and data domain modelling. Good technical writing and documentation skills. Fluent English If you have a passion for more »
