251 to 275 of 885 Apache Airflow Jobs

pipeline development, not just scripting Experience with distributed data frameworks like Spark to write and debug data pipelines Experience with workflow orchestration tools (e.g. Airflow, Flyte, or equivalent) Proven ability to design, implement, and maintain production-grade data pipelines and dashboards Good understanding of development processes and best practices ...

languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life CycleAdvanced understanding of agile methodologies, CI/CD, application ...

auction systemsExcellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructureExperience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

improvementRequirementsAdvanced SQL, ETL/ELT frameworks, and cloud data platforms such as Azure, AWS, or GCPData modelling and pipeline orchestration using tools such as Airflow, Data Factory, dbt, or similarIntegrate CDP data sources across digital, CRM, transactional, and behavioural data; support identity resolution, consent handling, audience activation, journey events ...

business environments is a plusWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and AzureFamiliarity with Generative ...

practical experience. Preferred Skills Experience with gradient-boosted tree models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi-cloud experience across AWS, GCP, and Azure. ...

Styled Components), React, Redux, Redux Hooks, and other modern state management libraries. Kotlin on Android and Swift on iOS. Data: SQL, Python, Snowflake, dbt, Airflow & Looker AI at Marshmallow: Sierra.ai for conversational AI, Python and LangChain for agentic AI solutions, Sagemaker and MLflow for Machine Learning, Cursor and Claude ...

models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

well as present complex findings clearly to both technical and non-technical audiencesProficient in using Tech Stack such as Amazon S3, Lambda function, Kafka, Apache Airflow or Bloomberg Teck Stack in production environmentExceptional problem-solving skills, numerical proficiency and high attention to detailAbility to work independently as well ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

asubject, preferred knowledge of AI infrastructure. Proficiencyin programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

preferred knowledge of AI infrastructure. Good proficiencyin programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Significant experience ...

seeking a data engineer to design, build, and scale data pipelines powering its next-generation digital content platform. You’ll work with DataBricks, Snowflake, Airflow, dbt (SQL), and Python within AWS to deliver robust data solutions. Join a collaborative team and contribute to platform optimization, governance, and scalable architectures ...

site work three days per week. You’ll own scalable data pipelines, streaming and batch processing, and work with Python, Kafka, Spark, Docker, Kubernetes, Airflow, and IaC tools to deliver reliable data platforms with governance and #J-18808-Ljbffr ...

timely delivery while collaborating with engineers, analysts and compliance teams. The role requires strong Python/Java, SQL and AWS experience, familiarity with Airflow, dbt and Spark, and a practical understanding of CI/CD and Agile delivery in a fast-paced financial services environment. #J-18808-Ljbffr ...

teams across multiple brands. Ideal candidates have 5+ years in data engineering, strong SQL and data modelling, and experience with dbt, Spark, Airflow, AWS, Kafka or Flink. #J-18808-Ljbffr ...

team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data pipelines Strong data modelling, CI/CD, Git, and Terraform knowledge Experience ...

Master Data Integration & Ingestion – Skill Data Manipulation and Processing – Skill GITHUB, Action, Azure DevOps – Skill Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, PyTest – SkillOptional skills: Experience in project management, running a scrum team. Experience working with BPC, Planning. Exposure to working with external ...

success, and field teams. Bias for action, strong ownership, and comfort operating in ambiguous, fast-moving environments. Nice to Have Experience with Snowflake, dbt, Airflow, BI platforms, semantic layers, or adjacent cloud data platform ecosystems. Experience creating technical enablement for SQL developers, analytics engineers, or modern data teams. Familiarity ...

Data Scientists use (we don't expect applicants to have experience with all of these):Python and Databricks for Data Science, Spark, MLFlow and Airflow for ML Workflows, Google Cloud Platform for our analytics infrastructure, dbt and BigQuery for data modelling and warehousing. Discover more about our Analytics Community ...

architectures, or agentic systems. Experience designing external-facing APIs, including versioning, backwards compatibility, and OpenAPI/REST standards. Familiarity with data infrastructure such as Airflow, Spark, Iceberg, or Kafka. Experience with energy markets. Modo Energy is an equal opportunity employer. Employment decisions are made on the basis of qualifications ...

. Experience withInfrastructure as Code (Terraform or CloudFormation).Automation/Al: Proficiency in Python scripting for automation. Experience with workflow orchestration tools (e.g., Airflow, Step Functions). Basic experience integrating Al/ML models into : Basic understanding of Cl/CD pipelines, containerization (Docker), and cloud security best practices. ...