101 to 125 of 148 Remote Apache Airflow Jobs

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...

large-scale or regulated environment.* AWS Experience: You have a strong working knowledge of AWS and cloud-first data pipeline orchestration tools (like Airflow, Glue, or EMR).* A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines.* Strong Automation Skills ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

devices and platforms to surface key metrics. The role emphasizes coding in Python, strong SQL, and experience with large data ecosystems (HDFS, Hive, Spark, Airflow). You will influence architecture and own initiatives from concept to delivery. Hybrid work from Cambridge Office. #J-18808-Ljbffr ...

other engineering and product teams. Skills and Experience Strong commercial Data Engineering experience Experience designing and building scalable data pipelines Strong experience with Airflow Experience working with Databricks Experience working closely with Data Science or advanced analytics teams Ability to take ownership of complex technical problems and drive solutions ...

management * Software testing lifecycle/defect management * CI/CD & DevOps practices Desirable: HMRC/public sector experience, AWS/Azure/SAS PaaS, Airflow or SAS Migration Factory experience. If you are interested in this role or wish to apply, please submit your CV. ...

codebase and pipelines Hands-on experience maintaining production ML models: refresh, retrain, monitor, and troubleshoot, rather than building from scratch Working knowledge of Looker, Airflow and Google Cloud Advanced degree in a quantitative discipline (Computer Science, Mathematics, Statistics, Physics, or similar), or equivalent experience Benefits Hybrid working (3 days ...

classification taxonomies. Working with model-derived inputs, understanding that NLP-generated exposures carry measurement error and revise over time. Task orchestration (Dagster or Airflow) and S3-based data flows. AWS fluency and CI/CD discipline. Competitive salary plus EMI share options 25 days holiday + bank holidays Private ...

technologies Awareness of Site Reliability Engineering principles Experience restoring services during outage situations Desirable skills and experience Docker and containerisation principles Jenkins Kibana Grafana Airflow Desired behaviours Proactive and self-motivated User-centric mindset Evidence-driven decision making Strong collaboration and communication skills Comfortable with pairing, demonstrations and knowledge ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than … Salesforce) and sales enablement platforms. Bonus Points If You Have: Experience selling to data teams, developers, or technical buyers. Background in data orchestration or Airflow-related technologies. Prior success in a startup or high-growth environment. The estimated total compensation for this role is up to £225,000, along ...

data analysis packages such as Numpy, Pandas, etc. Experience with SQL and/or other database technologies Knowledge of modern technologies such as AWS, Airflow, Docker, GitLab and Redis Ideally working with data visualization technologies such as Dash, Plotly, You will be joining a progressive and exciting company committed ...

Essential: ScalaPlay or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow #J-18808-Ljbffr ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. #J-18808-Ljbffr ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. ...

FastAPI) a huge plus; Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus; Experience with Airflow a huge plus; Experience with dbt for pipeline modelling also beneficial; Skilled at shaping needs into a solid set of requirements and designing scalable … main programming language Databricks Spark for data processing Databricks/dbt/SQL for data modelling and analytics Streamlit for data applications and visualisations Airflow for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Terraform for our infrastructure ...

skills: - Strong commercial full stack engineering capabilities - node, Typescript, Python, Java etc - Solid front end understanding - React, Next, Vue.js etc - Experience building scalable pipelines (Apache Spark, Airflow, dbt etc) - Experience building data lakes, data warehouses and/or real-time streaming solutions would be a real plus - Strong … enterprise technology environment, then please apply now to be considered. £90,000 - £100,000 + remote working + excellent benefits React, Angular, TypeScript, Spark, Airflow, dbt, Kubernetes, OpenShift, AWS, Azure, PostgreSQL, GitHub, ArgoCD ...

product and the company. Your Contribution Will Be The stack is modern: StarRocks as our primary analytical layer, Flink for processing, DBT for transformation, Airflow for orchestration and various tooling for surfacing insights. The hard work of making it genuinely reliable is still in front of us — and that …/lakehouse architecture patterns. Verbal and written fluency in English is required — we're a distributed team and written communication is important. Preferred Qualifications Airflow for orchestration. Experience with Apache Hudi. Experience with financial, transactional, or payment data. What We Offer at Yuno Competitive Compensation. Remote Work ...

CDO. What you’ll need for this role Hands-on experience designing and operating large-scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real-time streaming architectures Demonstrated experience leading or technically mentoring a team of data engineers ...

simulation platformEffectively integrate machine-learned graphics subsystems into the simulation platformImplement production quality software in PythonAbout youEssential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applicationsExcellent development skills in PythonDeep knowledge of Kubernetes at the user levelGood sense of systems ...

payments or fintech industry. Nice to Have Running multi‐tenant AI platforms or GPU/resource management at scale. Data pipelines and orchestration (Airflow, Prefect) and warehouses like Databricks, Snowflake, or BigQuery. Spanish proficiency. Tech Stack Languages — Python (AI/ML), Go and Kotlin (platform services). AI & LLMs … APIs and open models, agent frameworks, MCP, RAG. AI evaluation & observability — LangFuse, LangSmith, Braintrust, MLflow. Data & retrieval — vector databases, feature stores. Messaging — Apache Kafka, SQS. Databases — PostgreSQL, Redis. Infrastructure — AWS, Kubernetes, Docker, Terraform. Observability — Datadog, OpenTelemetry. CI/CD — GitHub Actions, ArgoCD. Version Control — Git/GitHub. What ...

Talent Partners. Role We’re hiring a Senior Data Engineer to work on the analytics engineering platform at Depop. You’ll work on developing Airflow pipelines, the deployment of dbt models, managing data ingestion through Fivetran and developing internal tooling. You’ll also help enable data scientists … stakeholders on core datasets and key reporting. Responsibilities As a Senior Data Engineer, you can expect to: Build and maintain orchestration pipelines on Astronomer (Airflow), including automated model deployment for dbt users. Design and manage data ingestion and orchestration using Fivetran at scale Contribute to the team’s vision ...

wherever your expertise can have the greatest impact. Our application data lives primarily in CockroachDB, with a modern data platform built around BigQuery, dbt, Airflow and pub/sub. Data flows both ways: into analytics and modelling, and back into the products our customers use. That culture translates into … comfortable working beyond a narrowly defined specialism when that is what the problem requires. Experience that will set you apart Experience with BigQuery, Airflow and dbt, or equivalent modern data technologies. Experience with CockroachDB, Postgres or other distributed/relational databases, including CDC or event-driven data pipelines. Knowledge ...

help strengthen pre and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals ...

document decisions and collaborate across time zones Nice to Have Experience building infrastructure for machine learning or AI systems Familiarity with data processing frameworks (Apache Kafka, Spark, Airflow, or similar) Background in performance optimization, caching strategies, or high-throughput systems Knowledge of authentication, authorization, and security best practices ...