676 to 700 of 945 Apache Airflow Jobs

Founding Engineer/Senior Software Engineer (Ayama)

Hiring Organisation
career
Location
Santa Rosa, California, United States
Employment Type
Permanent
Salary
USD Annual
Experience with ERP systems, especially SAP (maintenance workflows, master data, integrations) Operations research or constraint programming background Data transformation and orchestration tools (dbt, Prefect, Airflow) B2B SaaS Why Join Ayama: Exclusive Ecosystem: Unparalleled access to AI Fund's experts and Dr. Andrew Ng's network of AI luminaries. Real ...

Scala Engineer SC Cleared London £620 pd

Hiring Organisation
Hays
Location
London, United Kingdom
Employment Type
Contract, Work From Home
Contract Rate
Up to £620 per day + £620 per day (inside IR35)
technologies Awareness of Site Reliability Engineering principles Experience restoring services during outage situations Desirable skills and experience Docker and containerisation principles Jenkins Kibana Grafana Airflow Desired behaviours Proactive and self-motivated User-centric mindset Evidence-driven decision making Strong collaboration and communication skills Comfortable with pairing, demonstrations and knowledge ...

Scala Engineer | SC Cleared | London | £620 pd

Hiring Organisation
Hays Specialist Recruitment Limited
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
£620.00 per day
technologies Awareness of Site Reliability Engineering principles Experience restoring services during outage situations Desirable skills and experience Docker and containerisation principles Jenkins Kibana Grafana Airflow Desired behaviours Proactive and self-motivated User-centric mindset Evidence-driven decision making Strong collaboration and communication skills Comfortable with pairing, demonstrations and knowledge ...

Data Scientist (London)

Hiring Organisation
The Voleon Group
Location
London, UK
Employment Type
Full-time
coursework in financial engineering, or industry internshipsExperience developing in a production-facing environment and familiarity with standard concepts and tooling, e.g., CI/CD, Airflow"Friends of Voleon" Candidate Referral ProgramIf you have a great candidate in mind for this role and would like to have the potential ...

Software Engineer, Engineering Tools

Hiring Organisation
SPINLAUNCH Inc
Location
Los Angeles, California, United States
Employment Type
Permanent
Salary
USD Annual
Experience with the scientific Python stack: NumPy, SciPy, pandas Experience with visualization: matplotlib, Plotly, or web-based dashboards (Streamlit, Dash, Panel) Workflow orchestration (Airflow, Prefect, Dagster, or similar) Time-series or experiment-tracking systems (InfluxDB, TimescaleDB, MLflow, or similar) Containerization (Docker) and reproducible environments Prior experience in fast-moving ...

Software Engineer, Engineering Tools

Hiring Organisation
SPINLAUNCH Inc
Location
Long Beach, California, United States
Employment Type
Permanent
Salary
USD Annual
Experience with the scientific Python stack: NumPy, SciPy, pandas Experience with visualization: matplotlib, Plotly, or web-based dashboards (Streamlit, Dash, Panel) Workflow orchestration (Airflow, Prefect, Dagster, or similar) Time-series or experiment-tracking systems (InfluxDB, TimescaleDB, MLflow, or similar) Containerization (Docker) and reproducible environments Prior experience in fast-moving ...

Software Engineer II

Hiring Organisation
Garner Health
Location
New York City, New York, United States
Employment Type
Permanent
Salary
USD Annual
that operates with intense urgency, a strong sense of individual accountability, and a commitment to authentic feedback. Technologies we use: Claude Code, Kubernetes, AWS, Airflow, dlt, dbt, Python, TypeScript, React, Go This is a unique opportunity to join a fast-growing company in a transformative role, helping shape ...

Software Engineer II

Hiring Organisation
Garner Health
Location
White Plains, New York, United States
Employment Type
Permanent
Salary
USD Annual
that operates with intense urgency, a strong sense of individual accountability, and a commitment to authentic feedback. Technologies we use: Claude Code, Kubernetes, AWS, Airflow, dlt, dbt, Python, TypeScript, React, Go This is a unique opportunity to join a fast-growing company in a transformative role, helping shape ...

Senior Software Engineer - Data Platform

Hiring Organisation
MetTel
Location
New York City, New York, United States
Employment Type
Permanent
Salary
USD Annual
engines. Strong Java or Python - ideally both, as our stream processing is Java and our orchestration is Python. Hands-on production stream processing experience (Apache Flink, Kafka Streams, Spark Structured Streaming, or Beam), with the ability to reason about keyed state, watermarks, checkpointing, and event-time versus processing-time … semantics. Practical Apache Kafka knowledge beyond consumer usage - partitioning, compaction, consumer group behavior, and schema evolution (Avro/Schema Registry). Experience with a workflow or ETL orchestration tool - Dagster preferred, or a comparable orchestrator such as Airflow or Prefect. SQL fluency and production experience with a columnar ...

Senior Software Engineer - Data Platform

Hiring Organisation
MetTel
Location
White Plains, New York, United States
Employment Type
Permanent
Salary
USD Annual
engines. Strong Java or Python - ideally both, as our stream processing is Java and our orchestration is Python. Hands-on production stream processing experience (Apache Flink, Kafka Streams, Spark Structured Streaming, or Beam), with the ability to reason about keyed state, watermarks, checkpointing, and event-time versus processing-time … semantics. Practical Apache Kafka knowledge beyond consumer usage - partitioning, compaction, consumer group behavior, and schema evolution (Avro/Schema Registry). Experience with a workflow or ETL orchestration tool - Dagster preferred, or a comparable orchestrator such as Airflow or Prefect. SQL fluency and production experience with a columnar ...

Senior Data Engineer

Hiring Organisation
CMC Markets
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
/CD experience. Highly Desirable Familiarity with OneTick, PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Order book reconstruction Tick-to-bar aggregation Airflow, Dagster, Prefect or MLflow Experience supporting quantitative research or trading systems Multi-asset market data (Equities, Futures, FX, Options, ETFs, CFDs) What We're Looking … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...

Senior Software Engineer, Data Platform

Hiring Organisation
Crusoe
Location
San Francisco, California, United States
Employment Type
Permanent
Salary
USD Annual
related role. Bonus Points: Experience with Google Cloud Platform (GCP) data services (BigQuery, Dataflow, Pub/Sub, Cloud Storage). Experience with Apache Beam. Background in building infrastructure for AI/ML workloads or cloud computing platforms. Experience on a growing or early-stage data team, contributing to foundational … development. Familiarity with data orchestration tools (e.g., Airflow, Dagster, Prefect). Experience with real-time data processing and streaming architectures. Benefits: Competitive compensation Restricted Stock Units Paid time off & paid holidays Comprehensive health, dental & vision insurance Employer contributions to HSA account Paid parental leave Paid life insurance, short-term ...

Software Engineer III – Data Engineering- Corporate Know Your Customer

Location
Auchentibber, Scotland, United Kingdom
data engineering Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability … hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering ...

Software Engineer III - Data Engineering- Corporate Know Your Customer

Hiring Organisation
Hackajob Ltd
Location
Glasgow, Lanarkshire, Scotland, United Kingdom
Employment Type
Permanent
data engineering Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability … hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with emerging technologies in data engineering ...

Corporate KYC Principle Software Engineer - Executive Director

Hiring Organisation
Hackajob Ltd
Location
Paisley, Renfrewshire, UK
Employment Type
Full-time
/ML, data engineering) Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure … hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with AI evaluation and observability practices ...

Corporate KYC Principle Software Engineer - Executive Director

Hiring Organisation
Hackajob Ltd
Location
Glasgow, Lanarkshire, Scotland, United Kingdom
Employment Type
Permanent
/ML, data engineering) Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure … hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with AI evaluation and observability practices ...

Director of Data and AI

Location
Greater London, England, United Kingdom
including model deployment, monitoring, evaluation, and lifecycle management Strong hands‐on understanding of modern data and AI tooling, ideally including SQL, Python, Snowflake, dbt, Airflow, Metabase, Tableau, and AWS‐based data services Experience with data ingestion, streaming, and change data capture tooling, such as Fivetran, Estuary, or similar platforms … standards, and enablement for analytics engineers Ability to oversee API‐based and batch data extraction processes, particularly those built in Python and orchestrated using Airflow Understanding of machine learning tooling and lifecycle management, ideally including DVC, MLflow, Evidently AI, or equivalent platforms for experiment tracking, versioning, monitoring, and evaluation ...

Platform Engineer IV

Hiring Organisation
Eliassen Group
Location
Greenwood Village, Colorado, United States
Employment Type
Permanent
Salary
USD Annual
use. Coordinate connectivity and firewall requests with upstream data teams and platform teams. Support infrastructure needs for new data onboarding and scheduler maintenance with Airflow and event triggers. Perform other duties as required. Experience Requirements: Expert experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets … integration. Integration against REST APIs and cloud SDKs such as boto3. Preferred: graph databases such as AWS Neptune or Neo4j. Preferred: Apache Kafka or similar streaming platforms. Preferred: Apache Spark with Scala for distributed and streaming processing. Preferred: Airflow or similar orchestration platforms. Preferred: telecommunications or large ...

Platform Engineer IV

Hiring Organisation
Eliassen Group
Location
Englewood, Colorado, United States
Employment Type
Permanent
Salary
USD Annual
use. Coordinate connectivity and firewall requests with upstream data teams and platform teams. Support infrastructure needs for new data onboarding and scheduler maintenance with Airflow and event triggers. Perform other duties as required. Experience Requirements: Expert experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets … integration. Integration against REST APIs and cloud SDKs such as boto3. Preferred: graph databases such as AWS Neptune or Neo4j. Preferred: Apache Kafka or similar streaming platforms. Preferred: Apache Spark with Scala for distributed and streaming processing. Preferred: Airflow or similar orchestration platforms. Preferred: telecommunications or large ...

Software Engineer, Senior

Hiring Organisation
aPriori Technologies Inc
Location
Wichita, Kansas, United States
Employment Type
Permanent
Salary
USD Annual
. Experience with customer-facing, productized APIs and the platform underpinnings that support them is a plus. Familiarity with modern workflow orchestration tools (e.g. Apache Airflow, Temporal, etc) for managing and automating data or processing pipelines is a plus. Self-starter with the ability to work as part ...

Software Engineer, Senior

Hiring Organisation
aPriori Technologies Inc
Location
Indianapolis, Indiana, United States
Employment Type
Permanent
Salary
USD Annual
. Experience with customer-facing, productized APIs and the platform underpinnings that support them is a plus. Familiarity with modern workflow orchestration tools (e.g. Apache Airflow, Temporal, etc) for managing and automating data or processing pipelines is a plus. Self-starter with the ability to work as part ...

Software Engineer, Senior

Hiring Organisation
aPriori Technologies Inc
Location
Asheville, North Carolina, United States
Employment Type
Permanent
Salary
USD Annual
. Experience with customer-facing, productized APIs and the platform underpinnings that support them is a plus. Familiarity with modern workflow orchestration tools (e.g. Apache Airflow, Temporal, etc) for managing and automating data or processing pipelines is a plus. Self-starter with the ability to work as part ...

Software Engineer, Senior

Hiring Organisation
aPriori Technologies Inc
Location
Pittsburgh, Pennsylvania, United States
Employment Type
Permanent
Salary
USD Annual
. Experience with customer-facing, productized APIs and the platform underpinnings that support them is a plus. Familiarity with modern workflow orchestration tools (e.g. Apache Airflow, Temporal, etc) for managing and automating data or processing pipelines is a plus. Self-starter with the ability to work as part ...

Software Engineer, Senior

Hiring Organisation
aPriori Technologies Inc
Location
Boston, Massachusetts, United States
Employment Type
Permanent
Salary
USD Annual
. Experience with customer-facing, productized APIs and the platform underpinnings that support them is a plus. Familiarity with modern workflow orchestration tools (e.g. Apache Airflow, Temporal, etc) for managing and automating data or processing pipelines is a plus. Self-starter with the ability to work as part ...

Software Engineer, Senior

Hiring Organisation
aPriori Technologies Inc
Location
Albuquerque, New Mexico, United States
Employment Type
Permanent
Salary
USD Annual
. Experience with customer-facing, productized APIs and the platform underpinnings that support them is a plus. Familiarity with modern workflow orchestration tools (e.g. Apache Airflow, Temporal, etc) for managing and automating data or processing pipelines is a plus. Self-starter with the ability to work as part ...