AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
services. Experience of Dremio is a nice to have Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the more »
Spark or other distributed big data systems (e.g. Hadoop, Pig, Hive, etc.) Stream-processing frameworks (e.g. Kafka) Data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster, etc.) Job Requirements: Bachelor's/Master's in Computer Science, a related field, or equivalent work experience Fluency in Portuguese and English Experience more »
being a great bonus. The core skillset: Python/PySpark for building scalable & robust data pipelines Experience with Airflow or other orchestration tools (CloudComposer, Dagster etc) Demonstrable cloud experience developing in AWS, GCP, or Azure Proven level of SQL expertise for interacting with data and transformations Beyond this core more »
Bethesda, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Washington, Washington DC, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Gaithersburg, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Hyattsville, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Rockville, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Arlington, Virginia, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Glen Echo, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Silver Spring, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Takoma Park, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Chevy Chase, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms. Must more »
Bethesda, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Rockville, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Hyattsville, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Gaithersburg, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Arlington, Virginia, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Washington, Washington DC, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Silver Spring, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Chevy Chase, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
Takoma Park, Maryland, United States Hybrid / WFH Options
Leidos
such as MSSQL, MySQL, PostgreSQL, Redis, FAISS, Milvus, Qdrant, etc. Experience designing and maintaining ETL and ELT pipelines with technologies such as Spark, Airflow, Dagster, Prefect, Argocd, Metaflow, Kubeflow, etc. Experience with DevOps/MLOps, using CI/CD methodology with data pipelines, and cloud-native deployment paradigms Must more »
