201 to 225 of 309 Remote/Hybrid Apache Airflow Jobs

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

including web scraping, parsing, proxy management, and structured feed ingestion. Pipeline Architect: Hands-on experience with batch-style data workflows using tools like dbt, Airflow, or similar equivalents. Cloud Native: Deep expertise in AWS infrastructure (RDS, ECS, S3, Lambda, OpenSearch). Observability Minded: Familiar with modern stacks for performance ...

design, build, and maintain data pipelines and infrastructure to support secure, reliable, and scalable public sector services. You will work with AWS, Terraform, Spark, Airflow, Docker, and GitLab CI/CD within a hybrid model, contributing to secure coding practices and collaborating across cross-functional teams. #J-18808-Ljbffr ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

join our dynamic, expanding team. Over the last few years we've built a solid data foundation using best in class technologies (dbt, BigQuery, Airflow) and are just at the start of our journey to leverage this data in a more sophisticated way. About Zapp: Zapp is London ...

ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong Automation Skills: Comfortable using Python and Shell ...

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...

large-scale or regulated environment.* AWS Experience: You have a strong working knowledge of AWS and cloud-first data pipeline orchestration tools (like Airflow, Glue, or EMR).* A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines.* Strong Automation Skills ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

devices and platforms to surface key metrics. The role emphasizes coding in Python, strong SQL, and experience with large data ecosystems (HDFS, Hive, Spark, Airflow). You will influence architecture and own initiatives from concept to delivery. Hybrid work from Cambridge Office. #J-18808-Ljbffr ...

management * Software testing lifecycle/defect management * CI/CD & DevOps practices Desirable: HMRC/public sector experience, AWS/Azure/SAS PaaS, Airflow or SAS Migration Factory experience. If you are interested in this role or wish to apply, please submit your CV. ...

classification taxonomies. Working with model-derived inputs, understanding that NLP-generated exposures carry measurement error and revise over time. Task orchestration (Dagster or Airflow) and S3-based data flows. AWS fluency and CI/CD discipline. Competitive salary plus EMI share options 25 days holiday + bank holidays Private ...

technologies Awareness of Site Reliability Engineering principles Experience restoring services during outage situations Desirable skills and experience Docker and containerisation principles Jenkins Kibana Grafana Airflow Desired behaviours Proactive and self-motivated User-centric mindset Evidence-driven decision making Strong collaboration and communication skills Comfortable with pairing, demonstrations and knowledge ...

technologies Awareness of Site Reliability Engineering principles Experience restoring services during outage situations Desirable skills and experience Docker and containerisation principles Jenkins Kibana Grafana Airflow Desired behaviours Proactive and self-motivated User-centric mindset Evidence-driven decision making Strong collaboration and communication skills Comfortable with pairing, demonstrations and knowledge ...

related role. Bonus Points: Experience with Google Cloud Platform (GCP) data services (BigQuery, Dataflow, Pub/Sub, Cloud Storage). Experience with Apache Beam. Background in building infrastructure for AI/ML workloads or cloud computing platforms. Experience on a growing or early-stage data team, contributing to foundational … development. Familiarity with data orchestration tools (e.g., Airflow, Dagster, Prefect). Experience with real-time data processing and streaming architectures. Benefits: Competitive compensation Restricted Stock Units Paid time off & paid holidays Comprehensive health, dental & vision insurance Employer contributions to HSA account Paid parental leave Paid life insurance, short-term ...

use. Coordinate connectivity and firewall requests with upstream data teams and platform teams. Support infrastructure needs for new data onboarding and scheduler maintenance with Airflow and event triggers. Perform other duties as required. Experience Requirements: Expert experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets … integration. Integration against REST APIs and cloud SDKs such as boto3. Preferred: graph databases such as AWS Neptune or Neo4j. Preferred: Apache Kafka or similar streaming platforms. Preferred: Apache Spark with Scala for distributed and streaming processing. Preferred: Airflow or similar orchestration platforms. Preferred: telecommunications or large ...

use. Coordinate connectivity and firewall requests with upstream data teams and platform teams. Support infrastructure needs for new data onboarding and scheduler maintenance with Airflow and event triggers. Perform other duties as required. Experience Requirements: Expert experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets … integration. Integration against REST APIs and cloud SDKs such as boto3. Preferred: graph databases such as AWS Neptune or Neo4j. Preferred: Apache Kafka or similar streaming platforms. Preferred: Apache Spark with Scala for distributed and streaming processing. Preferred: Airflow or similar orchestration platforms. Preferred: telecommunications or large ...

data analysis packages such as Numpy, Pandas, etc. Experience with SQL and/or other database technologies Knowledge of modern technologies such as AWS, Airflow, Docker, GitLab and Redis Ideally working with data visualization technologies such as Dash, Plotly, You will be joining a progressive and exciting company committed ...

Essential: ScalaPlay or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow #J-18808-Ljbffr ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. #J-18808-Ljbffr ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow Please send CV for full details and immediate interviews. We are a preferred supplier to the client. ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. ...

what's at stake for real people, and that's what gives our intensity its purpose. Technologies we use: Claude Code, Kubernetes, AWS, Airflow, dlt, dbt, Python, TypeScript, React, Go Compensation Transparency: The target salary range for this position is $200,000 - $255,000. Individual compensation for this role ...