2 of 2 Remote Oozie Jobs

in Python programming. Knowledge of agile development methodologies. Prior work on cloud computing platforms. Hands-on experience with other big data tools such as Oozie, YARN, Spark, SparkSQL, Flume, Sqoop2, Pig, Drill, Kafka, Elastic. Familiar with the financial services industry and/or regulatory environments. Able to demonstrate active More ❯

Responsibilities • Assist in developing, deploying, and managing data pipelines using CI/CD practices. • Support the orchestration of data pipelines with tools like Airflow, Oozie, or Azure Data Factory. • Support developing Spark jobs for data processing using Python or Scala. • Gather and analyse pipeline requirements with guidance. • Learn and … Data Engineer. • Proven experience with Python or Scala • Knowledge in Data Warehousing, Data Lake and Lakehouse paradigms • Experience with orchestration tools like Airflow or Oozie • Ability to design and implement DevOps strategies for CI/CD with tools such as GitHub Action, Azure DevOps, AWS CI/CD Pipelines More ❯