6 of 6 Apache Airflow Jobs in Fife

following tools: NiFi, Hbase, Bash, Assist, Putty, Neo4J, Spark , Kafka, HDFS, Oozie, Git Hub, Unix, Hadoop, Impala, DoJo, Flume, Elastic, Logstash, Kibana, Airflow, Glue, Big Query, Athena, CML, Hive, Informatica, CuteFTP Ability to explain and communicate technical concepts in non-technical language. Explain the types of communication that ...

Proven experience writing highly maintainable, performant Python and JavaScript code; Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar); Understanding of Data Modelling patterns; Deep knowledge of complex SQL, with emphasis on Common Table Expressions, window functions, and their ...

. Deep understanding of neural networks, reinforcement learning, and generative models . Experience with cloud platforms (AWS, GCP, Azure) and MLOps tools (MLflow, Kubeflow, Airflow, Docker, Kubernetes). Strong knowledge of SQL/NoSQL databases and data engineering practices . Soft Skills: Excellent problem-solving, communication, and leadership abilities. ...

habits. Is highly capable with Python and SQL in real data engineering environments. Has experience with modern data tooling such as Snowflake, dbt, Dagster, Airflow, AWS, or similar. Understands data modelling principles and can apply them pragmatically. Cares about testing, monitoring, alerting, and data quality. Thrives in a startup ...

Kubernetes and modern containerised deployment patterns Strong experience with CI/CD pipelines, infrastructure-as-code and workflow orchestration Experience with tools such as Airflow or similar platform and orchestration technologies Good understanding of model observability, data quality, feature pipelines, lineage and reproducibility Experience designing scalable infrastructure ...

culture of engineering excellence, continuous learning, and cross-pollination of knowledge. Own the technical roadmap for Airalo’s data infrastructure (GCP, BigQuery), orchestration (Dagster, Airflow), and ingestion (Fivetran, custom APIs). Drive data-platform architecture decisions, turning ambiguous business problems into scalable, production-grade technical designs. Bridge the data … background with major cloud platforms (GCP preferred) and cloud-native data warehouses (BigQuery preferred, or Snowflake/Redshift). Strong experience with orchestration tools (Airflow, Dagster), ELT pipelines (Fivetran, dbt), and distributed data processing frameworks (Apache Spark, Flink). Hands-on experience using AI tools to accelerate engineering ...