1 to 25 of 77 Amazon EMR Jobs

Databricks Certified Data Engineer Professional AWS Proficiency with AWS Tools: Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions. Programming Skills: Strong experience ...

This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DESCRIPTION: Shape the future of data and analytics for the world's largest and most complex financial institutions. … executive level stakeholders or clients PREFERRED QUALIFICATIONS: - Experience with AWS analytics and data services (e.g. Amazon Redshift, AWS Glue, Amazon EMR, Amazon Athena, Amazon Kinesis, AWS Lake Formation) - Experience with analytics and visualization tools (e.g. Amazon QuickSight, Tableau, PowerBI ...

Data Engineer to design and optimize large-scale data processing on AWS with Spark and Kubernetes. The role will implement containerized workloads on EMR on EKS, build scalable data pipelines, and improve performance, reliability, and observability. The engineer will collaborate with cross-functional teams, apply Spark tuning expertise … maintain large-scale data processing pipelines using Hadoop, Spark, Python, and Scala. Architect and deploy containerized big data workloads on Amazon EMR on EKS. Design and implement Kubernetes-based infrastructure for running Spark applications at scale. Implement scalable ingestion, storage, transformation, and analysis solutions. Stay current with ...

This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DESCRIPTION: Amazon Web Services (AWS) is the pioneer and recognized leader in Cloud Computing. Our web services … pharmaceuticals, and technology. Want to make history? Come and join the AWS Analytics team - the creators of Amazon Redshift, Amazon EMR, and Amazon Athena. Thousands of customers run managed databases on Amazon's industry leading cloud computing platform. Key job responsibilities ...

Proactive, collaborative, and delivery-focused mindset Desirable Skills Knowledge of open table formats (Iceberg, Delta) Experience with additional AWS services (CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis) Data modelling Job scheduling and orchestration tools Data virtualisation tools (e.g. Denodo) ALM tools (Jira, Confluence) CI/CD tooling (GitLab, Terraform) Reporting ...

years of experience in data engineering or data platform development within enterprise environments Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building ...

technologies, S3, Athena, Redshift Experience in snowflake is an added bonus. Familiarity with the following technologies: Hadoop, Kafka, Airflow, Hive, Presto, Athena, S3, Aurora, EMR, Spark Ability to drive, contribute to, and communicate solutions to technical product challenges Ability to roll-up your sleeves and work in process ...

Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices code reviews, testing frameworks ...

purpose storage/compute. Hands-on experience with AWS data engineering, including several of the following: S3, IAM, KMS, VPC, CloudWatch Glue, Athena, EMR, Lambda, Step Functions Redshift (or alternative warehouse) Kinesis/MSK (streaming) and/or EventBridge (eventing) Practical understanding of data reliability practices: testing, CI/ ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

focus on Databricks. Proficiency in Databricks, including the ability to build and optimize Spark applications. Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others. Strong knowledge of Unity Catalog and its application in managing and securing data assets. Strong knowledge of data modeling ...

focus on Databricks. Proficiency in Databricks, including the ability to build and optimize Spark applications. Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others. Strong knowledge of Unity Catalog and its application in managing and securing data assets. Strong knowledge of data modeling ...

Spark, Kafka, etc. Relational SQL and NoSQL databases and experience working with relational databases AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena Data Platforms: Databricks Data streaming systems: Batch,Kafka, Storm, Spark-Streaming, etc. Languages: Python, R, Scala, Go Ability ...

Agile, multidisciplinary teams Strong analytical and problem-solving skills Clear communicator and collaborative team player Desirable Python, Docker, Airflow Big data tools (e.g. Spark, EMR) Experience with data platforms or risk/fraud systems How You'll Work Deliver value iteratively and early Collaborate closely across disciplines Write simple ...

Databricks, including Delta Lake, Unity Catalog, MLflow, and workflows. Deep knowledge of AWS cloud architecture and data/AI services (S3, IAM, Glue, Lambda, EMR, ECS/EKS, Step Functions, CloudWatch). Hands‐on experience designing large‐scale distributed data platforms and AI/ML pipelines. Proven capability ...

This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DESCRIPTION: What is the Amazon Marketplace? Amazon is the largest marketplace on earth. Millions … least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS - Experience with big data technologies such as: Hadoop, Hive, Spark, EMR PREFERRED QUALIFICATIONS: - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions - Experience providing technical ...

healthcare-related field Experience in healthcare, senior housing, assisted living, or skilled nursing environments Familiarity with healthcare data systems and standards (EHR/EMR, claims data, MDS, CMS quality metrics) Experience with cloud platforms (AWS, Azure, or GCP) Experience with data visualization tools (Tableau, Power BI, Looker) Understanding ...

Simulation environments. Experience with geospatial engineering Experience with Big Data processing tools, such as Spark/Hadoop, Google's BigQuery, AWS's Athena, and EMR Experience with public clouds such as AWS, Google, Azure Strong data visualization skills Benefits GEODELPHI BENEFITS Medical, Dental, and Vision plans Unlimited PTO Federal ...

degree focused in distributed systems Experience working with other technical teams across multiple organizational boundaries Experience with relational databases, MySQL, NiFi, Kafka, Elastic MapReduce (EMR) Hbase, Elastic, Splunk, Spring Experience with Kubernetes Experience with Spark Experience programming with distributed computing Experience with large scale ETL from multiple sources What ...

version control systems Experience with extract, transform and load (ETL) development for data ingest pipelines Experience with relational databases, MySQL, NiFi, Kafka, Elastic MapReduce (EMR) Hbase, Elastic, Splunk, Spring Experience with CI/CD pipelines Ability to, or demonstrated experience, researching and evaluating the latest emerging technologies and applying ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

have hands-on experience with Spark (PySpark/SparkSQL) and understand how to tune jobs for performance in a cloud environment (AWS/EMR). Modeling Intuition: You understand the difference between a "raw table" and a "semantic layer." You've worked with modern modeling tools (like ...

Nice-to-have skills: Knowledge of Open Table Formats (Iceberg/Delta). AWS Tools: Experience with Amazon CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis. Data modelling Job scheduling/orchestration Data virtualisation tools (Denodo) ALM Tooling (Jira, Confluence) CI/CD toolsets (GitLab, Terraform) Reporting tools (Business ...

data platforms Deep expertise in Snowflake architecture Hands-on experience with Airflow/MWAA and dbt Strong knowledge of AWS data services (S3, EMR, PySpark) Experience designing Data Lakehouse architectures (Iceberg preferred) Expertise in performance tuning and optimisation Nice to Have CI/CD and DevOps practices Terraform/ ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...