51 to 75 of 181 Permanent Apache Airflow Jobs

Tech Stack Cloud: Azure, sometimes GCP & AWS Data Platform: Databricks, Snowflake, BigQuery Data Engineering tools: Pyspark, Polars, DuckDB, Malloy, SQL Infrastructure-as-code: Terraform, Pulumi Data Management and Orchestration: Airflow, dbt Databases and Data Warehouses: SQL Server, PostgreSQL, MongoDB, Qdrant, Pinecone GenAI: OpenAI APIs, HuggingFace, LangChain, Talk-to-data Monitoring: Datadog About You We are looking for someone who More ❯

processes. Monitor integration health and implement alerting, logging, and performance tracking. Contribute to continuous improvement of integration architecture and practices. Key Skills & Experience Experience with workflow orchestration tools (e.g., Apache Airflow). Proven backend development skills using Node.js, Python, Java, or similar. Strong understanding of API design and integration techniques (REST, Webhooks, GraphQL). Familiarity with authentication protocols More ❯

for internal tooling Experience with real-time data processing and analytics Background in building developer tools or internal platforms Familiarity with AI/ML operations (MLOps) practices (Experience using airflow) Experience building MCP servers and integrating with AI assistants Knowledge of structured data exchange protocols and API design for AI systems. Location: Austin, TX (Hybrid; Tues-Thurs onsite) Duration More ❯

driven development experience Proven experience in solution design and applying best design practices Data modeling and ER/UML diagram skills Experience with orchestration/enterprise scheduler platforms like Airflow, Tidal etc Experience with implementing API based data integration pipelines Experience with source control and DevOps for CI/CD Experience working in Agile/scrum methodologies Experience with More ❯

experience in data engineering, warehousing, or platform leadership. Proven track record of delivering large-scale data warehouse migrations (BigQuery experience strongly preferred). Hands-on expertise with SQL, Python, Airflow, DBT/Dataform, Terraform , and modern data architecture. Strong leadership and stakeholder management skills. Experience driving complex data projects in agile, cross-functional teams. Nice-to-haves: Background in More ❯

deep expertise in ETL and data warehousing (especially BigQuery). Hands-on competence with Looker (LookML) or similar BI tools. Strong SQL skills and familiarity with orchestration tools like Airflow (or similar). A thoughtful approach to data modeling, query optimization, and performance tuning. Excellent analytical problem-solving skills and the ability to drive projects in a fast-paced More ❯

charts. BI tools. Desirable PowerBI A/B testing. Split principles, test planning, logging. Desirable hard skills Python. Data analysis, pandas, numpy, scipy, statsmodels, seaborn, matplotlib etc. ETL processes. Airflow, Pentaho etc. IT understanding. Client-server processes. API. Back-end and front-end. Parsing. Algorithms and data structures. Management. Sprints, AGILE. Waterfall. Jira etc. Other skills Required fluent English. More ❯

charts. BI tools. Desirable PowerBI A/B testing. Split principles, test planning, logging. Desirable hard skills Python. Data analysis, pandas, numpy, scipy, statsmodels, seaborn, matplotlib etc. ETL processes. Airflow, Pentaho etc. IT understanding. Client-server processes. API. Back-end and front-end. Parsing. Algorithms and data structures. Management. Sprints, AGILE. Waterfall. Jira etc. Other skills Required fluent English. More ❯

frameworks : LangChain, LlamaIndex (or similar) Cloud & Dev : Azure/AWS/GCP, Docker, REST APIs, GitHub Actions/CI Data & MLOps : BigQuery/Snowflake, MLflow/DVC, dbt/Airflow (nice to have) Front ends (for internal tools) : Streamlit/Gradio/basic React Must-have experience 7+ years in Data Science/ML, including hands-on delivery of More ❯

Cloud Data Warehouse - Snowflake AWS Data Solutions - Kinesis, SNS, SQS, S3, ECS, Lambda Data Governance & Quality - Collate & Monte Carlo Infrastructure as Code - Terraform Data Integration & Transformation - Python, DBT, Fivetran, Airflow CI/CD - Github Actions/Jenkins Business Intelligence - Looker Experience and Attributes we'd like to see Platform Engineering Expertise Extensive experience in platform engineering; designing, building, and More ❯

record of building and managing talent pipelines in competitive markets. Technical Understanding Solid grasp of modern tech stacks including Python, React.js, cloud platforms (AWS, Azure), and data tools (dbt, Airflow, Snowflake) from a recruitment perspective. Ability to assess technical skills through structured interviews and practical assessments. Understanding of software development practices, agile methodologies, and DevOps culture. Familiarity with AI More ❯

improvement and operational excellence. Deep expertise in data compliance frameworks, cost management, and platform optimisation. Strong hands-on experience with modern cloud data warehouses (Databricks, Snowflake, AWS), SQL, Spark, Airflow, Terraform. Advanced Python skills with orchestration tooling; solid experience in CI/CD (Git, Jenkins). Proven track record in data modelling, batch/real-time integration, and large More ❯

members to deliver outcome Highly motivated, with strong problem-solving skills and business acumen Desirable Skills Experience with data visualization tools (e.g., Looker, Tableau, Power BI) Familiarity with dbt, Airflow, or other modern data tools Exposure to marketing or e-commerce industries Additional Information Publicis Groupe operates a hybrid working pattern with full time employees being office-based three More ❯

Desirable Skills Background in e-commerce, marketing, or operations analytics Experience with data visualization tools (e.g., Looker, Tableau, Power BI) Familiarity with modern data stack tools such as dbt, Airflow, and Git-based workflows Experience contributing to data product development, working closely with engineers and product managers Additional Information Publicis Groupe operates a hybrid working pattern with full time More ❯

applicable. Essential Skills & Experience Proven experience owning and operating production data platforms within AWS. Strong understanding of AWS core services: EventBridge, Lambda, EC2, S3, and MWAA (Managed Workflows for Apache Airflow). Experience with infrastructure reliability, observability tooling, and platform automation. Solid experience with CI/CD pipelines, preferably Bitbucket Pipelines. Familiarity with Snowflake administration and deployment practices. More ❯

fine-tuning techniques including LoRA, QLoRA, and parameter efficient methods - Multi-modal AI systems combining text, image, and structured data - Reinforcement Learning from Human Feedback (RLHF) for model alignment - Apache Airflow/Dagster for ML workflow orchestration and ETL pipeline management - Model versioning and experiment tracking (MLflow, Weights & Biases) - Real-time model serving and edge deployment strategies - A More ❯

fine-tuning techniques including LoRA, QLoRA, and parameter efficient methods - Multi-modal AI systems combining text, image, and structured data - Reinforcement Learning from Human Feedback (RLHF) for model alignment - Apache Airflow/Dagster for ML workflow orchestration and ETL pipeline management - Model versioning and experiment tracking (MLflow, Weights & Biases) - Real-time model serving and edge deployment strategies - A More ❯

fine-tuning techniques including LoRA, QLoRA, and parameter efficient methods - Multi-modal AI systems combining text, image, and structured data - Reinforcement Learning from Human Feedback (RLHF) for model alignment - Apache Airflow/Dagster for ML workflow orchestration and ETL pipeline management - Model versioning and experiment tracking (MLflow, Weights & Biases) - Real-time model serving and edge deployment strategies - A More ❯

and managing cloud infrastructure as code Proficiency in programming languages such as Python, Spark, SQL Strong experience with SQL databases Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF) Experience with cloud platforms (Azure preferred) and related data services Excellent problem-solving skills and attention to detail Inclusive and curious, continuously seeks to build knowledge More ❯

and managing cloud infrastructure as code Proficiency in programming languages such as Python, Spark, SQL Strong experience with SQL databases Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF) Experience with cloud platforms (Azure preferred) and related data services Excellent problem-solving skills and attention to detail Inclusive and curious, continuously seeks to build knowledge More ❯

warehousing concepts and data modelling. Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. Understanding/hands on experience in Orchestration solutions such as Airflow Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability More ❯

role 60% hands-on technically/40% hands-off leadership and strategy Proven experience designing scalable data architectures and pipelines Strong Python, SQL, and experience with tools such as Airflow, dbt, and Spark Cloud expertise (AWS preferred), with Docker/Terraform A track record of delivering in fast-paced, scale-up environments Nice to have: Experience with streaming pipelines More ❯

in data leadership – ideally within fintech, SaaS, or regulated tech environments. Technical depth across data engineering, analytics, or data science. Hands-on familiarity with modern data stacks – SQL, dbt, Airflow, Snowflake, Looker/Power BI. Understanding of the AI/ML lifecycle – including tooling (Python, MLflow) and best-practice MLOps. Comfortable working across finance, risk, and commercial functions. Experience More ❯

in data leadership – ideally within fintech, SaaS, or regulated tech environments. Technical depth across data engineering, analytics, or data science. Hands-on familiarity with modern data stacks – SQL, dbt, Airflow, Snowflake, Looker/Power BI. Understanding of the AI/ML lifecycle – including tooling (Python, MLflow) and best-practice MLOps. Comfortable working across finance, risk, and commercial functions. Experience More ❯

As a Senior Data Engineer you will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising formats and duplication More ❯