1 to 25 of 74 Amazon EMR Jobs

Data Engineer to design and optimize large-scale data processing on AWS with Spark and Kubernetes. The role will implement containerized workloads on EMR on EKS, build scalable data pipelines, and improve performance, reliability, and observability. The engineer will collaborate with cross-functional teams, apply Spark tuning expertise … maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala. Architect and deploy containerized big data workloads on Amazon EMR on EKS. Design and implement Kubernetes-based infrastructure for running Spark applications at scale. Implement scalable ingestion, storage, transformation, and analysis solutions. Stay current with ...

Proactive, collaborative, and delivery-focused mindset Desirable Skills Knowledge of open table formats (Iceberg, Delta) Experience with additional AWS services (CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis) Data modelling Job scheduling and orchestration tools Data virtualisation tools (e.g. Denodo) ALM tools (Jira, Confluence) CI/CD tooling (GitLab, Terraform) Reporting ...

with Product, Analytics, and Business teams. Drive data quality, lineage, and observability frameworks . Cloud & Platform Engineering Develop solutions on AWS : S3, Glue, Lambda, EMR, Redshift Implement CI/CD pipelines and infrastructure-as-code (Terraform/CloudFormation). Ensure security and compliance (FINRA, SEC considerations). Required Qualifications ...

years of experience in data engineering or data platform development within enterprise environments Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building ...

technologies, S3, Athena, Redshift Experience in snowflake is an added bonus. Familiarity with the following technologies: Hadoop, Kafka, Airflow, Hive, Presto, Athena, S3, Aurora, EMR, Spark Ability to drive, contribute to, and communicate solutions to technical product challenges Ability to roll-up your sleeves and work in process ...

data engineers, ensuring best practices in coding, architecture, and performance optimization. Architect data lake and data warehouse solutions leveraging AWS Glue, Redshift, S3, Athena, EMR, and Lambda. Drive development of ETL/ELT processes using PySpark, Python, and SQL. Implement and enforce data governance, quality checks, and security standards ...

purpose storage/compute. Hands-on experience with AWS data engineering, including several of the following: S3, IAM, KMS, VPC, CloudWatch Glue, Athena, EMR, Lambda, Step Functions Redshift (or alternative warehouse) Kinesis/MSK (streaming) and/or EventBridge (eventing) Practical understanding of data reliability practices: testing, CI/ ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

Spark, Kafka, etc. Relational SQL and NoSQL databases and experience working with relational databases AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena Data Platforms: Databricks Data streaming systems: Batch,Kafka, Storm, Spark-Streaming, etc. Languages: Python, R, Scala, Go Ability ...

Agile, multidisciplinary teams Strong analytical and problem-solving skills Clear communicator and collaborative team player Desirable Python, Docker, Airflow Big data tools (e.g. Spark, EMR) Experience with data platforms or risk/fraud systems How You'll Work Deliver value iteratively and early Collaborate closely across disciplines Write simple ...

focus on Databricks. Proficiency in Databricks, including the ability to build and optimize Spark applications. Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others. Strong knowledge of Unity Catalog and its application in managing and securing data assets. Strong knowledge of data modeling ...

focus on Databricks. Proficiency in Databricks, including the ability to build and optimize Spark applications. Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others. Strong knowledge of Unity Catalog and its application in managing and securing data assets. Strong knowledge of data modeling ...

years with cloud-based solutions. Expertise in Databricks, Apache Spark, Delta Lake , and distributed data processing frameworks. Strong knowledge of AWS (Glue, S3, Redshift, EMR), Azure (Synapse, Data Lake, Purview), or GCP (BigQuery, Dataflow, Dataproc) . Experience designing data lakes, data warehouses, and streaming/real-time data architectures ...

Lakehouse architectures using Delta Lake, S3, ADLS Gen2, Snowflake, Redshift and Synapse Analytics. Engineered large-scale distributed processing workloads using Apache Spark, PySpark, Databricks, EMR, Hive and HDFS, processing billions of records for enterprise analytics. Orchestrated complex data workflows using Apache Airflow, Databricks Workflows, AWS Step Functions and Azure ...

Data Science, Computer Science, Statistics, or a related field Experience in healthcare data analytics or hospital operations. Familiarity with EHR/EMR data or healthcare interoperability standards. Knowledge of time-series modeling and ensemble methods. Exposure to data visualization tools (e.g., Tableau, Power BI). Understanding of Agile methodologies ...

degree focused in distributed systems Experience working with other technical teams across multiple organizational boundaries Experience with relational databases, MySQL, NiFi, Kafka, Elastic MapReduce (EMR) Hbase, Elastic, Splunk, Spring Experience with Kubernetes Experience with Spark Experience programming with distributed computing Experience with large scale ETL from multiple sources What ...

healthcare-related field Experience in healthcare, senior housing, assisted living, or skilled nursing environments Familiarity with healthcare data systems and standards (EHR/EMR, claims data, MDS, CMS quality metrics) Experience with cloud platforms (AWS, Azure, or GCP) Experience with data visualization tools (Tableau, Power BI, Looker) Understanding ...

Simulation environments. Experience with geospatial engineering Experience with Big Data processing tools, such as Spark/Hadoop, Google's BigQuery, AWS's Athena, and EMR Experience with public clouds such as AWS, Google, Azure Strong data visualization skills Benefits GEODELPHI BENEFITS Medical, Dental, and Vision plans Unlimited PTO Federal ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

Nice-to-have skills: Knowledge of Open Table Formats (Iceberg/Delta). AWS Tools: Experience with Amazon CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis. Data modelling Job scheduling/orchestration Data virtualisation tools (Denodo) ALM Tooling (Jira, Confluence) CI/CD toolsets (GitLab, Terraform) Reporting tools (Business ...

Nice-to-have skills: Knowledge of Open Table Formats (Iceberg/Delta). AWS Tools: Experience with Amazon CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis. Data modelling Job scheduling/orchestration Data virtualisation tools (Denodo) ALM Tooling (Jira, Confluence) CI/CD toolsets (GitLab, Terraform) Reporting tools (Business ...

version control systems Experience with extract, transform and load (ETL) development for data ingest pipelines Experience with relational databases, MySQL, NiFi, Kafka, Elastic MapReduce (EMR) Hbase, Elastic, Splunk, Spring Experience with CI/CD pipelines Ability to, or demonstrated experience, researching and evaluating the latest emerging technologies and applying ...

data platforms Deep expertise in Snowflake architecture Hands-on experience with Airflow/MWAA and dbt Strong knowledge of AWS data services (S3, EMR, PySpark) Experience designing Data Lakehouse architectures (Iceberg preferred) Expertise in performance tuning and optimisation Nice to Have CI/CD and DevOps practices Terraform/ ...

have hands-on experience with Spark (PySpark/SparkSQL) and understand how to tune jobs for performance in a cloud environment (AWS/EMR). Modeling Intuition: You understand the difference between a "raw table" and a "semantic layer." You've worked with modern modeling tools (like ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...