1 to 25 of 214 Apache Jobs

design, scalability, and clean coding practices. Familiarity with application monitoring solutions Data Engineering 5+ years building scalable and reliable data pipelines using Databricks and Apache Spark. We need both. Experience with cloud data warehouse/data lake architectures and tooling. Experience building solutions using cloud providers, preferably Azure ...

however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Azure, or another cloud services 1+ years of experience using AWS Glue or Lambda 1+ years of experience SQL querying in Snowflake or Apache Spark 3+ years of experience in open source frameworks 2+ years of experience in Agile practices At this time, Capital One will not sponsor ...

Platform&Application Testing • Test and validate distributed data engineering applications across Cloudera Manager components: Kafka, Spark, HBase, Hive, Solr, NiFi, Hue, Livy, Unravel. • Test Apache NiFi pipelines including processors, flow configurations, data lineage, provenance, NiFi registry flows, and integration with downstream systems. • Validate ingestion pipelines, streaming jobs, batch ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake ...