126 to 150 of 153 Apache Airflow Jobs

with analytics, architecture, and delivery stakeholders. Balance operational leadership with longer-term planning and strategy. YOUR SKILLS & EXPERIENCE Essential: Strong experience with Snowflake, AWS, Airflow, and dbt. Proven background leading data engineers in production environments. Experience supporting data platform migrations or major transformations. Confident making technical trade-offs ...

product". Ability to influence senior stakeholders and collaborate effectively with technology architects. Familiarity with contemporary data engineering tooling (e.g. Snowflake-centric stacks, DBT, Airflow, Fivetran). If you'd like to learn more, please contact Jacob Ferdinand ...

product'. Ability to influence senior stakeholders and collaborate effectively with technology architects. Familiarity with contemporary data engineering tooling (e.g. Snowflake-centric stacks, DBT, Airflow, Fivetran). If you'd like to learn more, please contact Jacob Ferdinand ...

cases are developed in a scalable and sustainable way Communicate complex technical decisions clearly to non-technical stakeholders Technical Environment Strong experience required: Snowflake Airflow dbt Nice to have: AWS (lower priority) Ideal Background Senior or Lead Data Engineer who has progressed into a management/technical leadership role ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

What We're Looking For Significant experience with Databricks (including Unity Catalog) Strong skills in Python, Spark, SQL Cloud expertise Knowledge of pipeline tools (Airflow, ADF) Leadership and problem-solving ability Ready to take the next step? Apply now and join us as our Senior Databricks Engineer ...

monitoring. Experience building robust backend systems and APIs to serve ML models at scale. Strong understanding of big data technologies and data orchestration tools (Airflow, DBT). Familiarity with LLM integration and optimisation in production environments. Excellent problem-solving, analytical, and communication skills. Experience fine-tuning LLMs (e.g. Unsloth ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

applied science or complex software systems, especially involving deep learning, machine learning, LLMs that have been successfully delivered Advanced experience with python, ETL pipelines (Airflow preferred), data warehousing concepts Strong software development skills, particularly in Python, with experience working with AI frameworks and tools in cloud environments; Knowledge ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … monitoring. Required Skills 3 10 years experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift, EMR/Spark Apache Iceberg Python/SQL Experience in telecom data pipelines and handling large-scale structured/semi-structured data. Strong problem-solving, optimization, and debugging skills. ...

scheduling using workflow tools Build and deploy containerised and serverless data solutions Apply software engineering fundamentals to data engineering challenges Technology Stack Snowflake dbt Airflow SQL (strong focus) Cloud platforms (AWS, Azure, or GCP) Containers and Function Apps SQLMesh (or similar data transformation frameworks) Requirements 2–3 years’ experience … containers and serverless/function-based architectures Good communication skills and a collaborative mindset Nice to Have Experience with Snowflake in production Exposure to Airflow orchestration Understanding of data versioning and testing frameworks Experience working in agile or product-led teams ...

model serving platforms such as BentoML, MLflow, or SageMaker . Hands-on work with streaming and batch data pipelines using tools like Spark, Airflow, or Apache Beam . Background in front-end or mobile development , enabling end-to-end solution thinking. Prior experience in healthcare, life sciences ...

Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model optimisation techniques (quantisation, distillation, efficient inference ...

Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model optimisation techniques (quantisation, distillation, efficient inference ...

scheduling using workflow tools Build and deploy containerised and serverless data solutions Apply software engineering fundamentals to data engineering challenges Technology Stack Snowflake dbt Airflow SQL (strong focus) Cloud platforms (AWS, Azure, or GCP) Containers and Function Apps SQLMesh (or similar data transformation frameworks) Requirements 2-3 years' experience … containers and serverless/function-based architectures Good communication skills and a collaborative mindset Nice to Have Experience with Snowflake in production Exposure to Airflow orchestration ...

Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need … engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus 25 days holiday Pension ...

digital products used at scale. What you'll do: Build and maintain ETL/ELT pipelines using Python and SQL Orchestrate workflows with Airflow Work with cloud data platforms (AWS/GCP, BigQuery/Redshift) Improve data quality, monitoring, and reliability Collaborate with analysts and engineers to deliver trusted … data What we're looking for: 3+ years' experience in data engineering Strong SQL and Python skills Experience with Airflow or similar orchestration tools Cloud data experience (AWS or GCP) Solid understanding of modern data engineering best practices Nice to have: dbt, Terraform, or Docker experience Exposure ...

models for ML, insights, and search pipelines Design production-ready data pipelines delivering high-quality datasets to partner teams Work with Databricks, AWS, dbt, Airflow, and Looker to implement robust solutions Lead technically complex initiatives and contribute to the team's roadmap Improve engineering efficiency through internal tooling … Requirements Proven track record delivering production-ready data engineering projects end-to-end Strong SQL and Python skills, with experience on platforms like Databricks, Airflow, dbt, and Looker Experience in data modelling, data warehousing, and performance/cost optimisation Skilled in stakeholder management, documentation, and project planning Experience developing ...

objects (databases, schemas, tables, views, tasks, streams, resource monitors). ETL/ELT Pipelines: Develop and maintain robust data pipelines using tools like dbt, Airflow, Azure Data Factory, or similar. Data Modelling: Implement dimensional models (star/snowflake schemas), handle SCDs, and design efficient structures for analytics. Performance Tuning … Degree in IT Strong SQL skills (complex queries, performance tuning) and proficiency in Python for data processing. Experience with ETL/ELT tools (dbt, Airflow, ADF, Informatica, Matillion). Solid understanding of data warehousing concepts (Kimball, Data Vault, normalization). Familiarity with cloud platforms (Azure preferred; AWS/ ...

objects (databases, schemas, tables, views, tasks, streams, resource monitors). ETL/ELT Pipelines: Develop and maintain robust data pipelines using tools like dbt, Airflow, Azure Data Factory, or similar. Data Modelling: Implement dimensional models (star/snowflake schemas), handle SCDs, and design efficient structures for analytics. Performance Tuning … Degree in IT Strong SQL skills (complex queries, performance tuning) and proficiency in Python for data processing. Experience with ETL/ELT tools (dbt, Airflow, ADF, Informatica, Matillion). Solid understanding of data warehousing concepts (Kimball, Data Vault, normalization). Familiarity with cloud platforms (Azure preferred; AWS/ ...

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group ...