101 to 125 of 134 Permanent Apache Airflow Jobs

improving data literacy across the business Acting as an SQL subject matter expert (Postgres, Cloud SQL, BigQuery, Redshift) Using orchestration tools such as Airflow to deliver reliable, automated pipelines Contributing to IaC and CI/CD pipelines via GitHub Collaborating across engineering, analytics, data science, and product teams Experience ...

designing and owning data and analytics platforms in cloud environments. Dealing with huge volumes of data in a modern stacks (e.g. Snowflake, dbt, Airflow) and CI/CD practices. Whilst having microservices experience within a cloud environment, ideally AWS. If you have domain experience, great ...

designing and owning data and analytics platforms in cloud environments. Dealing with huge volumes of data in a modern stacks (e.g. Snowflake, dbt, Airflow) and CI/CD practices. Whilst having microservices experience within a cloud environment, ideally AWS. If you have domain experience, great ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

technologies including the Python scientific stack (NumPy, Pandas, SciPy, etc.), frameworks such as OpenCV, PyTorch, TensorFlow and JAX, data pipeline tools such as Airflow or Prefect and data processing tools such as Spark or Databricks. The Company The Python Developer will be joining a company whose platform has been ...

collaborate closely with client stakeholders to translate ambiguous requirements into clean, maintainable solutions that drive real impact. Familiarity with tools such as Airflow, DBT, Databricks, dashboarding frameworks, and Typescript is a strong plus as you help deliver end-to-end production-ready systems. Interview Process Teams conversation (introductory chat ...

Centers of Excellence (CoE)and align technical execution with enterprise strategy. Proficiency withPython, SQL, cloud-native AI platforms, and modern data stack (Databricks, Snowflake, Airflow, MLflow, etc.). Demonstrated success influencing senior executives and leading cross-functional AI transformations. Desired Experience withresponsible AI, governance frameworks, and regulatory compliance (HIPAA ...

especially thrilled if you: Experienced in data protection policies and compliance practices. Can read and write code in Python. Have experience with Apache Airflow. Have experience with Tableau or Power BI. By checking this box, I agree to allow JetBrains to retain my data for future opportunities for employment ...

solutions end-to-end Experience working with large datasets and complex data ecosystems Familiarity with modern data platforms and tools (e.g., Snowflake, dbt, GCP, Airflow) is a plus, but not a requirement Strong analytical and problem-solving skills, with a keen eye for detail and data quality Excellent communication ...

distributed data processing systems (Spark, Flink, Hadoop) and query languages (SQL/HiveQL). Hands on experience with ML pipeline orchestration tools (e.g., Airflow, Kubeflow, MLflow). Experience with containerization and deployment platforms (Docker, Kubernetes, TensorFlow Serving, TorchServe). Familiarity with experiment design, A/B testing, and model ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI) Experience with CI/CD pipelines and automation tools ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI) Experience with CI/CD pipelines and automation tools ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

What We're Looking For Significant experience with Databricks (including Unity Catalog) Strong skills in Python, Spark, SQL Cloud expertise Knowledge of pipeline tools (Airflow, ADF) Leadership and problem-solving ability Ready to take the next step? Apply now and join us as our Senior Databricks Engineer ...

monitoring. Experience building robust backend systems and APIs to serve ML models at scale. Strong understanding of big data technologies and data orchestration tools (Airflow, DBT). Familiarity with LLM integration and optimisation in production environments. Excellent problem-solving, analytical, and communication skills. Experience fine-tuning LLMs (e.g. Unsloth ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

applied science or complex software systems, especially involving deep learning, machine learning, LLMs that have been successfully delivered Advanced experience with python, ETL pipelines (Airflow preferred), data warehousing concepts Strong software development skills, particularly in Python, with experience working with AI frameworks and tools in cloud environments; Knowledge ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … monitoring. Required Skills 3 10 years experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift, EMR/Spark Apache Iceberg Python/SQL Experience in telecom data pipelines and handling large-scale structured/semi-structured data. Strong problem-solving, optimization, and debugging skills. ...

scheduling using workflow tools Build and deploy containerised and serverless data solutions Apply software engineering fundamentals to data engineering challenges Technology Stack Snowflake dbt Airflow SQL (strong focus) Cloud platforms (AWS, Azure, or GCP) Containers and Function Apps SQLMesh (or similar data transformation frameworks) Requirements 2–3 years’ experience … containers and serverless/function-based architectures Good communication skills and a collaborative mindset Nice to Have Experience with Snowflake in production Exposure to Airflow orchestration Understanding of data versioning and testing frameworks Experience working in agile or product-led teams ...

model serving platforms such as BentoML, MLflow, or SageMaker . Hands-on work with streaming and batch data pipelines using tools like Spark, Airflow, or Apache Beam . Background in front-end or mobile development , enabling end-to-end solution thinking. Prior experience in healthcare, life sciences ...