251 to 275 of 868 Permanent Apache Airflow Jobs

models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

well as present complex findings clearly to both technical and non-technical audiencesProficient in using Tech Stack such as Amazon S3, Lambda function, Kafka, Apache Airflow or Bloomberg Teck Stack in production environmentExceptional problem-solving skills, numerical proficiency and high attention to detailAbility to work independently as well ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

asubject, preferred knowledge of AI infrastructure. Proficiencyin programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

preferred knowledge of AI infrastructure. Good proficiencyin programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Significant experience ...

seeking a data engineer to design, build, and scale data pipelines powering its next-generation digital content platform. You’ll work with DataBricks, Snowflake, Airflow, dbt (SQL), and Python within AWS to deliver robust data solutions. Join a collaborative team and contribute to platform optimization, governance, and scalable architectures ...

site work three days per week. You’ll own scalable data pipelines, streaming and batch processing, and work with Python, Kafka, Spark, Docker, Kubernetes, Airflow, and IaC tools to deliver reliable data platforms with governance and #J-18808-Ljbffr ...

timely delivery while collaborating with engineers, analysts and compliance teams. The role requires strong Python/Java, SQL and AWS experience, familiarity with Airflow, dbt and Spark, and a practical understanding of CI/CD and Agile delivery in a fast-paced financial services environment. #J-18808-Ljbffr ...

teams across multiple brands. Ideal candidates have 5+ years in data engineering, strong SQL and data modelling, and experience with dbt, Spark, Airflow, AWS, Kafka or Flink. #J-18808-Ljbffr ...

team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data pipelines Strong data modelling, CI/CD, Git, and Terraform knowledge Experience ...

Master Data Integration & Ingestion – Skill Data Manipulation and Processing – Skill GITHUB, Action, Azure DevOps – Skill Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest – SkillOptional skills: Experience in project management, running a scrum team. Experience working with BPC, Planning. Exposure to working with external ...

success, and field teams. Bias for action, strong ownership, and comfort operating in ambiguous, fast-moving environments. Nice to Have Experience with Snowflake, dbt, Airflow, BI platforms, semantic layers, or adjacent cloud data platform ecosystems. Experience creating technical enablement for SQL developers, analytics engineers, or modern data teams. Familiarity ...

Data Scientists use (we don't expect applicants to have experience with all of these):Python and Databricks for Data Science, Spark, MLFlow and Airflow for ML Workflows, Google Cloud Platform for our analytics infrastructure, dbt and BigQuery for data modelling and warehousing. Discover more about our Analytics Community ...

architectures, or agentic systems. Experience designing external-facing APIs, including versioning, backwards compatibility, and OpenAPI/REST standards. Familiarity with data infrastructure such as Airflow, Spark, Iceberg, or Kafka. Experience with energy markets. Modo Energy is an equal opportunity employer. Employment decisions are made on the basis of qualifications ...

. Experience withInfrastructure as Code (Terraform or CloudFormation).Automation/Al: Proficiency in Python scripting for automation. Experience with workflow orchestration tools (e.g., Airflow, Step Functions). Basic experience integrating Al/ML models into : Basic understanding of Cl/CD pipelines, containerization (Docker), and cloud security best practices. ...

. Experience withInfrastructure as Code (Terraform or CloudFormation).Automation/Al: Proficiency in Python scripting for automation. Experience with workflow orchestration tools (e.g., Airflow, Step Functions). Basic experience integrating Al/ML models into : Basic understanding of Cl/CD pipelines, containerization (Docker), and cloud security best practices. ...

development (React/JavaScript or similar) and web framework (Flask/Django/FastAPI) Highly capable in data pipelining using tools like Airflow & DBT, and data extraction, manipulation and reporting using Python & SQL. Experience with code versioning, optimisation and associated best practices, including Git, pull requests, unit testing ...

/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.)PySparkAWS cloud infrastructure: EMR, ECS, Athena, etcMLOps/DevOps: Terraform, Docker, Airflow, MLFlowMonitoring and evaluation platforms including New Relic and BraintrustMore information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy ...

advanced analytics - ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with ...

advanced analytics - ideally in a hybrid PLG/sales-led SaaS environment Strong Python and SQL; experience with data modelling and pipeline tools (dbt, Airflow, Dagster) Deep expertise in predictive modelling, causal inference, survival analysis, and experimentation (A/B, diff-in-diff, instrumental variables) Experience working directly with ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...

similar). Experience with unit, integration testing for ML models, including data validation, correctness checks, and reproducibility. Experience with CI/CD, Orchestration tools (Airflow, MLflow, Kubernetes, Terraform) and ML/data platforms(SageMaker, Databricks, Unity Catalog, Snowflake/Snowpark) to build scalable ML data pipelines and model workflows. ...