1 to 25 of 276 Apache Jobs

design, scalability, and clean coding practices. Familiarity with application monitoring solutions Data Engineering 5+ years building scalable and reliable data pipelines using Databricks and Apache Spark. We need both. Experience with cloud data warehouse/data lake architectures and tooling. Experience building solutions using cloud providers, preferably Azure ...

however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Platform&Application Testing • Test and validate distributed data engineering applications across Cloudera Manager components: Kafka, Spark, HBase, Hive, Solr, NiFi, Hue, Livy, Unravel. • Test Apache NiFi pipelines including processors, flow configurations, data lineage, provenance, NiFi registry flows, and integration with downstream systems. • Validate ingestion pipelines, streaming jobs, batch ...

lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please get in touch with ARC IT Recruitment today. ...

Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please get in touch with ARC IT Recruitment today. ...

lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please get in touch with ARC IT Recruitment today. ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...