24 of 24 Remote/Hybrid Amazon EMR Jobs

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL used for querying, transformation, and validation across data stores PySpark for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark understanding of distributed data processing architecture and execution Apache ...

Proactive, collaborative, and delivery-focused mindset Desirable Skills Knowledge of open table formats (Iceberg, Delta) Experience with additional AWS services (CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis) Data modelling Job scheduling and orchestration tools Data virtualisation tools (e.g. Denodo) ALM tools (Jira, Confluence) CI/CD tooling (GitLab, Terraform) Reporting ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

teams Cloud-native data platforms supporting real-time and batch processing Big-data and distributed processing tools AWS services such as S3, Lambda, Athena, EMR, Kinesis, and EC2 Advanced analytics, visualisation, and data-science workflows Emerging technologies across AI and machine learning Why Join? Work on data platforms that ...

large-scale cloud data engineering programme, operating across a modern AWS-native technology stack including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, and DynamoDB. You will own testing across automated pipelines, data workflows, and cloud infrastructure - identifying risks, championing test frameworks, and coaching colleagues in quality … test frameworks Enhance existing frameworks to improve testing confidence and coverage Pipeline & Data Testing Validate data pipelines using Apache Airflow, AWS Glue, Athena, and EMR Ensure data integrity, transformation accuracy, and performance under load Analyse data in multiple formats to validate new functionality Perform production data analysis to identify ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

facing experience with enterprise clients Strong proficiency in Python, Java, or Scala and advanced SQL skills Hands-on experience with Snowflake, Databricks, Redshift, or EMR and distributed/cloud data platforms (AWS, Azure, GCP) Familiarity with streaming tools (Kafka, Spark), orchestration (Airflow), and data integration technologies (Fivetran, Matillion ...

required to evidence your clearance) Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure ...

required to evidence your clearance) Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure ...

required to evidence your clearance) Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure ...

Understanding of data processing using Apache Spark Use of Python, SQL, and familiarity with PySpark Experience using Apache Airflow for task orchestration Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify … changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB, LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab ...