1 to 25 of 44 Amazon EMR Jobs

Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing frameworks ...

data sources. Document test results and provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data ...

experience in data engineering or a similar role. • Hands-on experience with core AWS data services (for example S3, Glue, Athena, Lambda, IAM, EMR). • Strong SQL skills (joins, window functions, optimization). • Solid Python for data processing. • Experience building production ETL/ELT pipelines. • Working knowledge of security ...

frameworks. Key Responsibilities Design and develop scalable, testable data pipelines utilizing Python and Apache Spark. Orchestrate data workflows using AWS services including Glue, EMR Serverless, Lambda, and S3. Apply industry-standard software engineering practices such as version control, CI/CD, modular design, and automated testing. Contribute ...

have: experience with ThoughtSpot, automotive or adjacent domains Tech Stack (experience We Value) Heavily AWS‐based (e.g., S3, Lake Formation, Glue, Athena/Redshift, EMR, Kinesis); transformation and modelling (SQL, dbt, Spark); orchestration (Airflow/Dagster/Prefect); languages (Python/SQL); CI/CD & IaC (GitHub/GitLab ...

implementations. Strong experience with SQL, python and Pyspark Good understanding of Data ingestion and data processing frameworks Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture) Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as?appropriate. Should be able ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

data systems. Proficiency in Python, Java, or Scala - comfortable writing robust, testable, and scalable code. Deep experience with AWS (Lambda, ECS/EKS, EMR, Step Functions, S3, IAM, etc.). Strong knowledge of distributed systems and streaming/data pipelines (Kafka, Spark, Delta, Airflow, etc.). Familiarity with infrastructure ...

using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.Experience with Spark programming (pyspark or scalaHands on experience with AWS components like (EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environmentsStrong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.Experience using ETL tools for data ...

/BSS workflows. Key Responsibilities 1. Data Engineering & ETL Development Design, develop, and maintain ETL/ELT pipelines using AWS-native services (Glue, Lambda, EMR, Step Functions). Implement data ingestion from telecom systems like OSS/BSS, CDRs, mediation systems, CRM, billing, network logs . Optimize ETL workflows … Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high performance for petabyte-scale telecom datasets (CDRs, tower logs, subscriber activity). 4. Querying & Analytics (Athena) Develop and optimize Athena ...

technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, EMR and integrate with our internal Archival Service Platform for efficient data purging and Life Cycle management. Collaborate with the data engineering team to continuously ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...