351 to 375 of 885 Apache Airflow Jobs

business intelligence in a security-conscious environment. The role requires 3+ years in data engineering, strong experience with Spark, Python, Kafka, SQL and Airflow, and a willingness to work hybrid in London or Cheltenham. You will contribute to client engagements and growth of the company. #J-18808-Ljbffr ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow #J-18808-Ljbffr ...

equivalent. Experience with big data sets and big data warehouses Experience with proxies, anti-bot measures and scraper monitoring. Experience with Dagster, Airflow, Prefect or another data orchestrator. Comfort working with TypeScript/Node.js. A pragmatic, hands-on approach and strong problem-solving skills. Desirable: Geospatial data experience (PostGIS ...

building data pipelines Proficient in SQL, Python, AWS and other data management technologies Familiarity with version control systems like Git and orchestration tools like Airflow Ability to test and troubleshoot data platforms reliably. A track record of improving data reliability and quality Excellent communication skills and the ability ...

Master Data Integration & Ingestion Skill Data Manipulation and Processing Skill GITHUB, Action, Azure DevOps Skill Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest Skill Optional skills Experience in project management, running a scrum team. Experience working with BPC, Planning. Exposure to working with ...

tools such as make and CMake, and automated build systems such as spack or easybuild Experience with workflow orchestration tools such as Argo Workflow, Airflow, Nextflow, Snakemake, VisTrails, or Cromwell Experience with application performance tuning and optimization in parallel and distributed computing, including MPI, OpenMP, or Gloo Deep understanding ...

agile methodologies such as CI/CD, Applicant Resiliency, and Security, Jules, Jenkins, Git/Stash Preferred qualifications, capabilities, and skills Knowledge of Airflow, Data Mesh architecture Experience with data analysis #J-18808-Ljbffr ...

similar databases. Experience designing data models, schemas and transformation layers for complex datasets. Experience with directed acyclic graph–based orchestration tools such as Airflow, Dagster, Prefect or similar systems. Familiarity with data warehouses, object storage, queues, APIs and cloud infrastructure. Experience with data quality testing, lineage, observability, versioning ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow ABOUT US J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

product partners Preferred Qualifications, Capabilities, and Skills Experience building agentic tools and AI agents that support engineering workflows in production environments Experience with Airflow ABOUT US J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy ...

Terraform, Bicep or Pulumi) Implementing monitoring and observability for production systems, including metrics, alerting, logging, and dashboarding (e.g. Prometheus, Grafana) Pipeline orchestration using Dagster, Airflow, Prefect, or similar Bonus points if you have: Practical experience with model serving infrastructure – batch and/or real‐time inference at scale. Experience ...

track record of delivering impact Desirable: Experience with GenAI/LLM evaluation, AI safety, prompt engineering, experimentation frameworks or data pipeline technologies such as Airflow or Dagster. What we’ll provide you This is a unique role that will put you in the position to be part ...

monitoring infrastructure that catches drift and quality degradation before business KPIs move. You'll work on a GCP-native stack — Vertex AI, BigQuery, dbt, Airflow, and Terraform — on problems that matter from day one, with the autonomy to shape how the function scales and who joins it next. ...

Batch, ECS, EKS, S3, RDS or Postgres, Athena, SageMaker, Bedrock, or equivalent services. Scientific workflow and data orchestration frameworks such as Nextflow, Dagster, Airflow or similar. Platform security, privacy or governance controls for sensitive biomedical or clinical data. Identity platforms and federation technologies such as Entra ...

unstructured data sources including Cassandra HBase Kafka and Spark* Strong ETL and data pipeline experience particularly with modern big data toolsets such as Airflow and Nifi or equivalent* Strong programming background in either Java Python or Scala* Experience in modern engineering practices and technologies* Good working knowledge of data ...

multi-TB or PB scale Strong software engineering skills Experience delivering & maintaining production systems Experience with workflow orchestration for parallelised jobs; Flyte preferred, but Airflow, Prefect or similar tools are also relevant Experience building reliable, observable data systems, including retry strategies, backfills, data integrity checks, lifecycle/state tracking ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...

components of modern ML platforms-such as experiment tracking, model registries, training pipelines, or deployment systems Familiarity with orchestration and tracking tools (MLflow, WandB, Airflow, Kubeflow, etc.) Proficiency with cloud-native platforms (AWS, GCP, or Azure), containers, and IaC (e.g., CDK, Terraform) Hands-on experience with processing or modeling ...