126 to 148 of 148 Remote Apache Airflow Jobs

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and "infrastructure as a code" tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment #J-18808-Ljbffr ...

deployments Troubleshoot integration failures, data inconsistencies, and production issues Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

Lead Data Engineer Location: West Midlands | Hybrid 3 days per week onsite The Role Were looking for an experienced Lead Data Engineer to provide hands-on technical leadership within a data engineering team for a ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools … partners across the organization via Technical Design Documents. This is a great opportunity to further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform & Google Cloud Platform. Benefits Hybrid working Long contract Award winning work environment ...

communicator, detail oriented, and thrives both independently and in team settings. Key Skills (Must Have): Advanced Python (OOP, multi threading, reusable packages, ETL automation, Airflow DAGs) Strong SQL (complex queries, performance optimization, Snowflake preferred) AWS expertise (S3, ECS, IAM, cloud security best practices) AI implementation experience with solution designing …/CD with GitHub, testing frameworks (Python unit/integration, DBT tests) Data pipeline orchestration, error handling, and monitoring Nice to Have: Airflow orchestration, DBT modeling, AWS Lambda, API integrations, CloudWatch/DataDog monitoring ...

needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking … experience with TerraformExperience in creating workflows for Apache Airflow#LI-GL1What's Roku's approach to hybrid working? Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned ...

engineering & the platform Build and maintain ingestion and transformation pipelines across our stack. We use a modern data stack, such as AWS, Redshift, and Airflow Write production‐quality Python for extraction, transformation, and automation tasks that fall outside dbt’s remit Help us modernise: we’re actively evolving this … plain language Ownership: you’re comfortable being the first and only person in this role, and building things properly from scratch Nice‐to‐haves Airflow or similar orchestration tools, and familiarity with data ingestion tools such as dlt or Airbyte Warehouse cost and performance tuning, particularly on Redshift Fintech ...

Python and Node.js Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and cloud services Storage/search: MongoDB, OpenSearch Orchestration: Airflow, Dagster, NiFi Tooling: GitHub, GitHub Actions, Rundeck, Jira, Confluence Deployment/config: Ansible (physical), Terraform/Argo CD/Helm (Kubernetes) Development environment: MacBook … Strong fundamentals: data structures, testing, version control, Linux basics Nice to have: Spark/PySpark experience Hadoop ecosystem exposure (HDFS/HBase) Workflow orchestration (Airflow/Dagster/NiFi) Search/indexing (OpenSearch, MongoDB) Kubernetes and infrastructure‐as‐code Degree in Computer Science or numerical degree Competitive salary ...

migrate data sets into their AWS Snowflake platform. Designing and implementing dbt models that power clean, consistent metrics. Buidl out orchestartion pipelines using Airflow Creating clear documentation for dashboards, metrics, and models. Ensuring optimal performance and cost efficiency across Snowflake Supporting a stakeholder-first approach to data usability … access. KEY SKILLS AND REQUIREMENTS Extensive experience operating within Snowflake environments Airflow for data orchestration. Proficiency in SQL and dbt, with a strong understanding of data modeling best practices. Strong communication skills with the ability to translate complex needs into elegant data solutions. Focus on usability, documentation, and data ...

Company DescriptionWise is a global technology company, building the best way to move and manage the world's money. Min fees. Max ease. Full speed. Whether people and businesses are sending money to another country ...

driven user experience. Hybrid role with three on-site days in City of London. Responsibilities include building scalable data pipelines (BigQuery, Dataflow/Apache Beam, Airflow), ensuring data quality and observability (Looker, Monte Carlo), and collaborating with product engineering and data science teams to plan data tracking ...

Inside IR35 Location: London - Hybrid, 3 days per week onsite Duration: 6 months The role will focus on GCP, BigQuery, Python, Airflow/Cloud Composer, dbt, Terraform and CI/CD, working closely with architects, engineers, product and governance teams to deliver secure, scalable data solutions. Key experience … BigQuery Python, Airflow & dbt Terraform & CI/CD Data platforms/lakehouse environments Kubernetes AWS alongside GCP Strong stakeholder management If this sounds relevant to you, please drop me a message or send your CV Thanks, Callum ...

growth payments platform. You will modernize the stack and mentor engineers on data quality and reliability. Responsibilities Design and maintain ELT with DBT and Airflow Scale batch and streaming with Spark Define data contracts with product and engineering Improve lineage, testing and observability Requirements 5+ years in data engineering … with Python DBT and Airflow in production Experience with Spark or similar frameworks Great communication and documentation habits Remote within UK or EU time zones Learning budget and conference allowance #J-18808-Ljbffr ...

United Kingdom to design, build, and maintain data pipelines on a modern AWS-native stack. You will use Spark/PySpark for distributed processing, Airflow for orchestration, and Terraform for infrastructure as code in a hybrid work arrangement with weekly travel to Newcastle office. You will contribute to data ...

FullRemoteTalent is seeking a Data Engineer to own pipelines and analytics for a high-growth payments platform. This role involves modernizing the stack, mentoring engineers on data quality and reliability, and scaling batch and streaming ...

backend systems and data-intensive applications. You are experienced with Scala or Java and at least one distributed data processing framework such as Scio, Apache Beam, Spark, or Flink. You know how to design and build reliable backend services and scalable data pipelines that support business-critical workflows. … have experience designing data models that enable accurate, high-volume financial processes. You have worked with workflow orchestration platforms such as Flyte, Airflow, or similar technologies. You care deeply about engineering fundamentals, including continuous delivery, automated testing, monitoring, and writing production-quality code. You enjoy collaborating with cross-functional ...

Foundry or AI Search, with Docker and Kubernetes Understanding of schema validation frameworks (e.g., JSON Schema, Pydantic) and MLOps tools such as MLflow or Airflow Strong communication ability to explain trade-offs around cost, latency and accuracy to technical and non-technical audiences Nice to have Experience using Azure … agent and tool interoperability Hands-on work with vector databases like Pinecone, Weaviate, Qdrant or pgvector Familiarity with distributed systems, workflow engines (Temporal, Airflow or Dagster) and event-driven architectures Experience with open-source LLMs or Small Language Models for custom deployments Knowledge of AI safety and governance: guardrails ...

SENIOR SCALA ENGINEER £590 per day via Umbrella 6-12 month contract Stratford, London – hybrid remote working SC clearance required ABOUT THE CLIENT Our client is a major UK public sector organisation delivering digital services ...

design and develop data foundations that enable data science and analytics products at scale. You will build scalable pipelines and orchestration workflows using Airflow and Databricks, taking ownership of complex technical problems while collaborating closely with Data Scientists and product teams to deliver production-ready solutions. #J-18808-Ljbffr ...