26 to 50 of 92 Remote Apache Airflow Jobs

reproducibility, dataset versioning, and efficient access Working knowledge of cloud platforms (AWS, GCP, or Azure) and modern MLOps tooling (e.g. MLflow, Weights & Biases, DVC, Airflow) Strong experience with Python and associated scientific software packages such as PyTorch, OpenCV, Pandas, SciPy, NumPy, SciKit-learn, etc. Strong software engineering practices including ...

engineering mindset and experience building production-grade systems Experience developing ETL processes and large-scale financial data pipelines Strong Azure experience Docker and Kubernetes Apache Airflow GitHub and CI/CD (GitHub Actions) Experience building cloud-native research or production platforms Experience working with market data, security master ...

skills using Python. (Nice to have) \n *Proficient with Pandas for handling and transforming complex datasets. (nice to have) \n *Hands-on experience with Apache Airflow for data orchestration and pipeline scheduling. \n Experience of mentoring junior developers. \n Preferred Qualifications \n *Experience in cloud-based environments (especially ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

model versioning Hands-on experience with Databricks Model Serving for production ML deployments Proficiency with GenAI frameworks/tools and technologies such as Apache Airflow, Spark, Flink, Kafka/Kinesis, Snowflake, and Databricks. Demonstrable experience in parameter-efficient fine-tuning, model quantization, and quantization-aware fine-tuning ...

join their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources. Automate and optimise workflows using tools like Airflow, dbt, and Spark. Support data modelling for analytics, dashboards, and A/B testing. Collaborate with cross-functional teams to deliver data-driven insights. Work ...

learning services. Experience with machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn. Knowledge of pipeline orchestration and data workflow tools such as Airflow, Dataform, or dbt. Experience delivering advanced measurement and modelling solutions, including marketing mix modelling, incrementality testing, causal impact analysis, attribution modelling, propensity modelling, churn ...

platform as the business continues to invest Tech Environment: Azure Python SQL Server Azure Data Services Data Warehousing Data Engineering & ETL Workflow orchestration (Airflow, Luigi or similar) You'll probably be someone who: Has experience leading or mentoring Data Engineers Still enjoys writing code and solving engineering problems ...

including governance Who you are Strong in SQL and Python, with real pipeline experience, not just querying Comfortable with Spark or PySpark, dbt and Airflow for orchestration Experience with at least one major cloud platform (AWS, GCP or Azure) You've worked with vector databases or feature stores ...

MLOps principles with experience deploying models in production Proficiency in Python and tools/platforms such as Azure, AWS, GCP, Databricks, MLFlow, and Airflow Strong communication skills with the ability to engage business and technical stakeholders We offer/Benefits EPAM Employee Stock Purchase Plan (ESPP) Protection benefits including ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

Model Serving for production ML deployments Knowledge of multimodal AI (text, image, audio integration) Proficiency with GenAI frameworks/tools and technologies such as Apache Airflow, Spark, Flink, Kafka/Kinesis, Snowflake, and Databricks. Demonstrable experience in parameter-efficient fine-tuning, model quantization, and quantization-aware fine-tuning ...

Strong hands‐on background with modern cloud data platforms (AWS/GCP/Azure) Expertise across Python, SQL and data orchestration tools such as Airflow Experience building scalable data pipelines and data platforms in a fast‐paced fintech or technology environment A collaborative leadership style with the ability ...

Strong hands-on background with modern cloud data platforms (AWS/GCP/Azure) Expertise across Python, SQL and data orchestration tools such as Airflow Experience building scalable data pipelines and data platforms in a fast-paced fintech or technology environment A collaborative leadership style with the ability ...

Terraform, Bicep or Pulumi) Implementing monitoring and observability for production systems, including metrics, alerting, logging, and dashboarding (e.g. Prometheus, Grafana) Pipeline orchestration using Dagster, Airflow, Prefect, or similar Bonus points if you have: Practical experience with model serving infrastructure – batch and/or real‐time inference at scale. Experience ...

monitoring infrastructure that catches drift and quality degradation before business KPIs move. You'll work on a GCP-native stack — Vertex AI, BigQuery, dbt, Airflow, and Terraform — on problems that matter from day one, with the autonomy to shape how the function scales and who joins it next. ...

visualisation languages and libraries (SQL, python, matplotlib, etc.) as well as some of the supporting tools and platforms (e.g. git, MLFlow, Kubernetes, Kubeflow, Trino, AirFlow). A strong understanding of statistical concepts (hypothesis testing, sampling, probability distributions). Excellent communication and collaboration skills to effectively bridge the gap between ...

operating large‐scale data transfer pipelines at multi‐TB or PB scale. Experience orchestrating parallelised transfer jobs: Flyte preferred; other workflow orchestration tools (e.g. Airflow, Prefect) will be considered. Experience building reliable, observable data systems , including retry strategies, backfills, data integrity checks, lifecycle/state tracking and operational alerting. ...

unstructured data sources including Cassandra HBase Kafka and Spark* Strong ETL and data pipeline experience particularly with modern big data toolsets such as Airflow and Nifi or equivalent* Strong programming background in either Java Python or Scala* Experience in modern engineering practices and technologies* Good working knowledge of data ...

data platform, including data access patterns, integration with ML workflows, and performance-aware data consumption. Experience with workflow orchestration tools such as Prefect, Airflow, Dagster, or similar. Strong experience implementing IaC and CI/CD pipelines for software, data, and machine learning workflows. Strong Python engineering skills and experience ...

Cloud Run), AWS (Bedrock, SageMaker) Experience building and automating AI/ML pipelines using tools such as MLflow, Kubeflow, Azure ML, Vertex Pipelines, Airflow or Google ADK Hands-on experience with Generative and Agentic AI frameworks such as LangChain, LlamaIndex, CrewAI, Autogen, Google ADK, or similar. Ability to design ...