76 to 100 of 172 Remote Apache Spark Jobs

Data Engineer III

Hiring Organisation
eSimplicity
Location
Fort Wayne, Indiana, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Charleston, West Virginia, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Fort Worth, Texas, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Bismarck, North Dakota, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Little Rock, Arkansas, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
El Paso, Texas, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Kansas City, Missouri, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Saint Paul, Minnesota, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Santa Clara, California, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Providence, Rhode Island, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Salt Lake City, Utah, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Rapid City, South Dakota, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer III

Hiring Organisation
eSimplicity
Location
Sioux Falls, South Dakota, United States
Employment Type
Permanent
Salary
USD Annual
that support data transformation, workload management, data structures, dependency and metadata Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and Postgres; workflow management and pipeline tools such as Apache Airflow, and AWS Step Function; AWS cloud … services including Redshift, RDS, EMR and EC2; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, Java and Python.? Flexible and willing to accept a change in priorities as necessary. Ability to work in a fast-paced, team-oriented environment ...

Data Engineer

Hiring Organisation
GRVTY
Location
McLean, Virginia, United States
Employment Type
Permanent
Salary
USD Annual
Pandas, numpy, scipy, scikit-learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place … PDFs. Experience with data validation/data quality after ETLing to be sure it's ready for end users Docker Jenkins Hadoop/Spark Kibana Kafka NiFi ElasticSearch Why Choose GRVTY The toughest national security challenges demand vision and ingenuity, not just resources. We deliver mission and technical expertise ...

Data Engineer

Hiring Organisation
Hexegic
Location
City of London, London, United Kingdom
data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Senior Data Scientist

Hiring Organisation
Formula
Location
London Area, United Kingdom
data science or statistical role. Expertise in advanced analytics techniques including machine learning, optimisation and segmentation. Strong proficiency in Python, SQL and Spark SQL. Experience working with large datasets and distributed computing tools such as Azure Synapse and Snowflake. Familiarity with data transformation tools (Databricks, Azure Data Factory ...

Data Engineer - Products

Hiring Organisation
RealityMine
Location
Trafford Park, Greater Manchester, UK
manage multiple priorities and respond calmly to issues. • Self-motivated with a collaborative approach. Preferred: • Familiarity with AWS data tooling such as S3, Athena, Spark or notebooks. • Experience supporting data products or client-facing datasets. • Understanding of release testing, UAT or production support processes. • Exposure to Jira/Agile ...

Data Engineer - Products

Hiring Organisation
RealityMine
Location
Trafford Park, England, United Kingdom
manage multiple priorities and respond calmly to issues. • Self-motivated with a collaborative approach. Preferred: • Familiarity with AWS data tooling such as S3, Athena, Spark or notebooks. • Experience supporting data products or client-facing datasets. • Understanding of release testing, UAT or production support processes. • Exposure to Jira/Agile ...

Senior Data Engineer

Hiring Organisation
eSimplicity
Location
Boston, Massachusetts, United States
Employment Type
Permanent
Salary
USD Annual
compliance and Data Quality Assessment status Building data processing workflows on AWS (S3, Glue, EMR, Athena, RDS/Redshift) and, where applicable, Databricks, Spark, and Hive for big-data processing Creating data products that feed Power BI dashboards and Salesforce reports, ensuring consistent definitions, refresh schedules, snapshot management … discipline Strong understanding of AWS data services including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Athena, QuickSight, and Amazon SNS Experience with Spark and Hive for big-data processing Experience building job workflows on Databricks or comparable platforms Familiarity with workflow orchestration tools such as Airflow, Luigi ...

Senior Data Engineer

Hiring Organisation
eSimplicity
Location
Phoenix, Arizona, United States
Employment Type
Permanent
Salary
USD Annual
compliance and Data Quality Assessment status Building data processing workflows on AWS (S3, Glue, EMR, Athena, RDS/Redshift) and, where applicable, Databricks, Spark, and Hive for big-data processing Creating data products that feed Power BI dashboards and Salesforce reports, ensuring consistent definitions, refresh schedules, snapshot management … discipline Strong understanding of AWS data services including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Athena, QuickSight, and Amazon SNS Experience with Spark and Hive for big-data processing Experience building job workflows on Databricks or comparable platforms Familiarity with workflow orchestration tools such as Airflow, Luigi ...

Senior Data Engineer

Hiring Organisation
eSimplicity
Location
Chicago, Illinois, United States
Employment Type
Permanent
Salary
USD Annual
compliance and Data Quality Assessment status Building data processing workflows on AWS (S3, Glue, EMR, Athena, RDS/Redshift) and, where applicable, Databricks, Spark, and Hive for big-data processing Creating data products that feed Power BI dashboards and Salesforce reports, ensuring consistent definitions, refresh schedules, snapshot management … discipline Strong understanding of AWS data services including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Athena, QuickSight, and Amazon SNS Experience with Spark and Hive for big-data processing Experience building job workflows on Databricks or comparable platforms Familiarity with workflow orchestration tools such as Airflow, Luigi ...

Senior Data Engineer

Hiring Organisation
eSimplicity
Location
Atlanta, Georgia, United States
Employment Type
Permanent
Salary
USD Annual
compliance and Data Quality Assessment status Building data processing workflows on AWS (S3, Glue, EMR, Athena, RDS/Redshift) and, where applicable, Databricks, Spark, and Hive for big-data processing Creating data products that feed Power BI dashboards and Salesforce reports, ensuring consistent definitions, refresh schedules, snapshot management … discipline Strong understanding of AWS data services including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Athena, QuickSight, and Amazon SNS Experience with Spark and Hive for big-data processing Experience building job workflows on Databricks or comparable platforms Familiarity with workflow orchestration tools such as Airflow, Luigi ...

Senior Data Engineer

Hiring Organisation
eSimplicity
Location
Nashville, Tennessee, United States
Employment Type
Permanent
Salary
USD Annual
compliance and Data Quality Assessment status Building data processing workflows on AWS (S3, Glue, EMR, Athena, RDS/Redshift) and, where applicable, Databricks, Spark, and Hive for big-data processing Creating data products that feed Power BI dashboards and Salesforce reports, ensuring consistent definitions, refresh schedules, snapshot management … discipline Strong understanding of AWS data services including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Athena, QuickSight, and Amazon SNS Experience with Spark and Hive for big-data processing Experience building job workflows on Databricks or comparable platforms Familiarity with workflow orchestration tools such as Airflow, Luigi ...

Senior Data Engineer

Hiring Organisation
eSimplicity
Location
Philadelphia, Pennsylvania, United States
Employment Type
Permanent
Salary
USD Annual
compliance and Data Quality Assessment status Building data processing workflows on AWS (S3, Glue, EMR, Athena, RDS/Redshift) and, where applicable, Databricks, Spark, and Hive for big-data processing Creating data products that feed Power BI dashboards and Salesforce reports, ensuring consistent definitions, refresh schedules, snapshot management … discipline Strong understanding of AWS data services including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Athena, QuickSight, and Amazon SNS Experience with Spark and Hive for big-data processing Experience building job workflows on Databricks or comparable platforms Familiarity with workflow orchestration tools such as Airflow, Luigi ...

Senior Data Engineer

Hiring Organisation
eSimplicity
Location
Austin, Texas, United States
Employment Type
Permanent
Salary
USD Annual
compliance and Data Quality Assessment status Building data processing workflows on AWS (S3, Glue, EMR, Athena, RDS/Redshift) and, where applicable, Databricks, Spark, and Hive for big-data processing Creating data products that feed Power BI dashboards and Salesforce reports, ensuring consistent definitions, refresh schedules, snapshot management … discipline Strong understanding of AWS data services including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Athena, QuickSight, and Amazon SNS Experience with Spark and Hive for big-data processing Experience building job workflows on Databricks or comparable platforms Familiarity with workflow orchestration tools such as Airflow, Luigi ...