51 to 75 of 154 Apache Airflow Jobs

What they're looking for Strong Python + data engineering fundamentals Experience building scalable data pipelines/platforms Exposure to distributed systems (Kafka, Spark, Airflow etc.) Interest in AI/ML systems is a plus ...

with non-technical teams Experience working with operational or business process data Desirable: Experience with Zendesk or similar customer/operations platforms Familiarity with Airflow Python experience Experience working with operational data ...

with non-technical teams Experience working with operational or business process data Desirable: Experience with Zendesk or similar customer/operations platforms Familiarity with Airflow or similar orchestration tools Python experience for data processing or automation Experience working with operational, transactional, or workflow-driven datasets ...

custom ETL pipelines in a cloud-native environment. • Automating internal processes and integrations across tools and APIs. • Supporting workflow orchestration using technologies such as Airflow or AWS Step Functions. • Containerising and deploying services using Docker. • Collaborating with data scientists to streamline their data workflows. • Contributing to improvements across orchestration ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

based ID resolution, fuzzy match frameworks). Proven experience leading a development team on client lifecycle management products. Familiarity with BPMN tools (e.g., Camunda, Airflow, Drools) related to customization of modeler and engine. Nice to have Experience with enterprise architecture frameworks (TOGAF, Zachman) and threat modeling (STRIDE). Knowledge ...

match/merge, survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature pipelines, self-service data ...

experience (Lightdash, Looker or similar) Experience identifying automation opportunities within data workflows Strong stakeholder engagement skills (non-technical teams) Nice to Have Exposure to Airflow Python experience ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

peer to peer feedback and evolving healthy, curious and humble teams. Tech Stack: Python, Javascript/Typescript, React/React Native, AWS, GraphQL, Snowflake, Airflow, DDD. This is an incredible opportunity for a Senior Software Engineer to join a unique company as they embark on a period of significant ...

healthcare, fintech, or other regulated environments Exposure to LLM infrastructure, model serving, or agentic AI frameworks in production Familiarity with data platforms (BigQuery, Airflow, data pipelines) Experience with CI/CD pipelines (GitHub Actions, Cloud Build) and policy-as-code tools Exposure to observability stacks (OpenTelemetry, Prometheus, Cloud Monitoring ...

build the queries and processes required to migrate it into a new environment. As migration work concludes, the role will transition into leveraging Airflow and other tooling to automate operational and financial processes. This position requires a highly collaborative individual, as you will work closely with engineers and stakeholders … Work with solution architects to design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with ...

build the queries and processes required to migrate it into a new environment. As migration work concludes, the role will transition into leveraging Airflow and other tooling to automate operational and financial processes. This position requires a highly collaborative individual, as you will work closely with engineers and stakeholders … Work with solution architects to design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale ...

tools including Intelligent Document Processing and LLMs. Required: Strong programming skills i.e Python. Experience working with any front end languages ideally React. Experience with Airflow, Kubernetes, Docker, SQL/NoSQL databases. Must have strong financial serivces background/open to fintech startup firms. Cloud and CI/CD knowledge. ...

into CRM workflows (HubSpot/Salesforce) Shape the core data architecture from day one 🛠️ Tech Stack Python (FastAPI), SQL (PostgreSQL), APIs, Playwright/Apify, Airflow/Prefect Bonus: LLM/AI tooling (e.g. OpenAI) 🎯 What We’re Looking For Strong Python + SQL Experience building end-to-end data ...

experience (Lightdash, Looker or similar) Experience identifying automation opportunities within data workflows Strong stakeholder engagement skills (non-technical teams) Nice to Have Exposure to Airflow Python experience ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

needs to be an IBM Certified TM1 developer as well as have a formal SQL qualification. Intermediate knowledge of Python & Django Intermediate Knowledge of Airflow and its application Awareness of cloud technologies and their application Administrator of Planning Analytics (TM1) and Oracle (systems admin) Experience of coaching & mentoring ...

right questions, and making reasonable bets. Bonus Experience with IoT/telemetry, energy data, or time-series workloads Familiarity with event-driven architectures, GraphQL, Airflow, or Python Personal interest in energy, climate tech, or automation Track record of owning complex systems end-to-end 5+ years of experience This ...

analytical data modeling in BigQuery using dbt . Build reliable data pipelines utilizing SQL, Python, and distributed processing frameworks (Apache Spark, Scio, Beam, or Flink). Develop clear, story-driven dashboards using tools like Looker or Tableau . Champion data quality , implement CI/CD for dbt models … years of experience in analytics or data engineering, with deep expertise in SQL. Extensive experience with dbt, a cloud data warehouse , and workflow orchestrators (Airflow, Dagster, Prefect, or Flyte). Proficiency in Python for data analysis and automation. Bonus: Experience with experimentation, ML/AI metrics, or platform productivity ...

production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design and implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics … documented data products * Nice to Have * Financial markets data - market data feeds (Bloomberg, Refinitiv), tick data, trade history, reference data, or instrument master management * Apache Spark or Flink for large-scale stream and batch processing beyond the Databricks ecosystem * dbt or equivalent SQL transformation layer; experience building and maintaining ...

they build. What You’ll Do Build and own data pipelines that connect product, analytics, and operations Design scalable architectures using tools like dbt , Airflow , and Snowflake/BigQuery Work with engineers and product teams to make data easily accessible and actionable Help evolve their data warehouse and ensure … decisions across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity ...

scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding … management Ability to work in cross functional, agile environments Preferred Qualifications Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding ...

secrets and access control using Azure Key Vault and Azure AD Enable hybrid connectivity between on-premises and cloud environments Support orchestration workflows using Apache Airflow Monitor system performance using tools such as Azure Monitor, Prometheus, and Grafana Collaborate across engineering teams to ensure reproducibility, scalability, and compliance … Solid understanding of cloud networking (hub/spoke, private endpoints) Experience troubleshooting infrastructure and deployment issues Strong collaboration and communication skills Desirable: Experience with Airflow or similar orchestration tools Knowledge of observability tooling (Prometheus, Grafana) Exposure to AI/ML platform environments Qualifications Relevant degree or equivalent industry experience ...