1 to 25 of 59 Spark Streaming Jobs

experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients. Big data tools: Hadoop, Spark, Kafka, etc. Relational SQL and NoSQL databases and experience working with relational databases AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda … DynamoDB, DocumentDB, Redshift, Aurora, Athena Data Platforms: Databricks Data streaming systems: Batch,Kafka, Storm, Spark-Streaming, etc. Languages: Python, R, Scala, Go Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks. Extensive knowledge of data ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...

support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud services … including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team ...