426 to 450 of 869 Permanent Apache Airflow Jobs

files, webhooks and event streams; Shape the engineering approach across Google Cloud Platform, including BigQuery, Cloud Storage, Pub/Sub, Datastream, Cloud Composer/Airflow, Terraform and infrastructure‐as‐code; Set and champion engineering standards for data modelling, dbt transformations, testing, monitoring, documentation, deployment, version control and cost optimisation … production‐ready data solutions Strong experience with cloud data warehouses, ideally BigQuery, and working knowledge of the wider Google Cloud Platform ecosystem Experience with Airflow/Cloud Composer, dbt, Git/GitHub, CI/CD and Terraform or other infrastructure‐as‐code tooling Understanding of data modelling, dimensional modelling ...

Shape the engineering approach across Google Cloud Platform (GCP) , working with technologies including BigQuery, Cloud Storage, Pub/Sub, Datastream and Cloud Composer/Airflow, alongside Terraform and infrastructure-as-code. Set and champion high engineering standards across data modelling, dbt (data build tool) transformations, testing, monitoring, documentation, deployment … BigQuery, and a good working knowledge of the wider Google Cloud Platform (GCP) ecosystem. Experience with modern data engineering tools and practices such as Airflow/Cloud Composer, dbt, Git/GitHub, CI/CD and Terraform or other infrastructure-as-code tooling . A solid understanding of data ...

database design principles Experience with Microsoft Azure and Azure Data Lake Storage (ADLS) Experience with data engineering tools such as Azure Data Factory, Databricks, Apache Spark, dbt or Airflow Experience with cloud data platforms such as Azure Synapse Analytics or Snowflake Experience using Git for version control Experience ...

Kubernetes - e.g. RDMA, DPUs, Infiniband, many-core CPUs Experience with declarative CI/CD tools such as ArgoCD Experience with workflow engines such as Apache Airflow or Argo Workflows Experience with infrastructure automation Cloud engineering experience with at least one cloud service provider Experience ...

infrastructure. Well versed and proven experiencein programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Longstanding experience ...

join our Data Engineering team in the UK. You will build and govern data infrastructure powering our platforms, using Python ingestion pipelines, Airflow orchestration, and Snowflake/Databricks to move data securely from source to decision-ready output. You will implement end-to-end ingestion sources, investigate ...

hybrid role bridging software and data engineering. You will architect and maintain production-grade data products and APIs using Java/Scala, SQL, Spark, Airflow, and Kubernetes to deliver reliable, high-performance solutions. You will collaborate with Finance, Accounting, and Analytics, drive data quality, and contribute to AI-powered ...

ideal candidate will have strong experience in a lead data engineering position, extensive GCP know-how (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow), and proficiency in Python and SQL. A focus on scalable data pipelines and CI/CD is essential. #J-18808-Ljbffr ...

platform products at scale Excellent written and verbal communication; comfortable engaging directly with clients Right to work in the UK Required skills Snowflake dbt Airflow Python Benefits at SREEYAMSOFT Top‐of‐market pay with annual reviews and performance bonuses. £2,000/year for certifications, conferences and learning. Modern ...

Axiom (plus) and regulatory reporting flows (plus) Excellent communication; proven stakeholder engagement Ability to learn/adapt to new technologies Skilled PySpark, HDFS, SQL, Airflow, data modeling, and ETL processing. Familiarity with GitLab and Jupyter Notebook is preferred, and knowledge of Java will be considered an added advantage. ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

happens next. Technical Mastery: You bring expert-level SQL skills and are fully comfortable building and maintaining your own robust data pipelines using dbt, Airflow, and Snowflake. Beyond querying, you use Python for advanced automation and forecasting, and you apply statistical rigor (e.g., Bayesian statistics, causal inference) to solve ...

integration and deployment Experience supporting production systems Experience with any of the following: gRPC microservices, Postgres, Pandas, Golang, R, Git, Jenkins, Bazel, Prometheus, Grafana, Airflow, Kubernetes “Friends of Voleon” Candidate Referral Program If you have a great candidate in mind for this role and would like to have ...

focused on what works in production. Comfortable owning ambiguity and making trade-overs. Languages: English A plus, but not required: workflow orchestration tools (Temporal, Airflow, Step Functions); experience building internal tools or agents; familiarity with regulated or enterprise environments; exposure to MLOps or AI evaluation frameworks. Why Planet Planet ...

computational improvements Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others Acting as an expert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping ...

understanding of functional paradigms and type theory. Confident JVM knowledge. Modern programming languages knowledge in our primary languages (Java, Python, Clojure). Experience with Airflow or other Python‐based workflow orchestration tools. Proficiency in domain‐driven design and domain modeling. Exposure to Kubernetes, Docker, Linux, Kafka, RabbitMQ, or git. ...

tuning. Stay hands-on: design reviews, architecture decisions, and code where it matters most. What you’ll work with Compute & orchestration: Spark, Flink, Beam, Airflow, Dagster, Kafka, PubSub Storage & analytics: data lake and warehouse architectures, Parquet, Iceberg, Delta Lake, BigQuery, Snowflake Metadata & data quality: lineage systems, metadata management, Great ...

techniques such as DDP or FSDP.Experience with observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry. Experience with data pipeline orchestration tools such as Airflow, Flyte, Ray, Metaflow, or Argo Workflows. Experience with containerisation and infrastructure tooling such as Docker, Kubernetes, or Terraform. Experience profiling or optimising ML systems ...

such as DDP or FSDP. Experience with observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry. Experience with data pipeline orchestration tools such as Airflow, Flyte, Ray, Metaflow, or Argo Workflows. Experience with containerisation and infrastructure tooling such as Docker, Kubernetes, or Terraform.Experience profiling or optimising ML systems ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...