15 of 15 Amazon EMR Jobs

people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also … need experience with several of the following: Amazon Redshift, AWS Lambda, Amazon Athena, Amazon RDS, Amazon EMR, Amazon EventBridge, Amazon Kinesis, AWS Step Functions, Amazon SQS/SNS and AWS CloudWatch. These roles are outside ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

Lakes & Data Warehousing Git, CI/CD & Performance Optimization Cloud & Modern Data Technologies Experience with any of the following is highly preferred: AWS: S3, EMR, Glue, Redshift, Lambda Azure: ADLS, Databricks, Azure Data Factory, Synapse GCP: BigQuery, Dataproc, Cloud Storage Databricks Snowflake Apache Airflow What We're Looking ...

platform experience across compute, storage, networking, security, provisioning, and automation. Hands-on with services including EC2, ECS, EKS, ELB, S3, Lambda, API Gateway, Glue, EMR, ElastiCache, CloudWatch, and CodeDeploy. Infrastructure provisioning expertise using Terraform (advanced techniques), including implementing/configuring AWS RDS and Aurora via Terraform. Administer, optimize ...

technical findings clearly. Experience working with cloud data platforms such as Snowflake, AWS, S3, or similar technologies. Preferred Experience: Healthcare data experience involving EHR, EMR, Practice Management Systems, clinical, financial, or claims data. Knowledge of FHIR or healthcare interoperability standards. Experience working with HIPAA-protected data. Familiarity with healthcare ...

technical findings clearly. Experience working with cloud data platforms such as Snowflake, AWS, S3, or similar technologies. Preferred Experience: Healthcare data experience involving EHR, EMR, Practice Management Systems, clinical, financial, or claims data. Knowledge of FHIR or healthcare interoperability standards. Experience working with HIPAA-protected data. Familiarity with healthcare ...

technical findings clearly. Experience working with cloud data platforms such as Snowflake, AWS, S3, or similar technologies. Preferred Experience: Healthcare data experience involving EHR, EMR, Practice Management Systems, clinical, financial, or claims data. Knowledge of FHIR or healthcare interoperability standards. Experience working with HIPAA-protected data. Familiarity with healthcare ...

technical findings clearly. Experience working with cloud data platforms such as Snowflake, AWS, S3, or similar technologies. Preferred Experience: Healthcare data experience involving EHR, EMR, Practice Management Systems, clinical, financial, or claims data. Knowledge of FHIR or healthcare interoperability standards. Experience working with HIPAA-protected data. Familiarity with healthcare ...

technical findings clearly. Experience working with cloud data platforms such as Snowflake, AWS, S3, or similar technologies. Preferred Experience: Healthcare data experience involving EHR, EMR, Practice Management Systems, clinical, financial, or claims data. Knowledge of FHIR or healthcare interoperability standards. Experience working with HIPAA-protected data. Familiarity with healthcare ...

Kafka, Databricks, and cloud environments and with other enterprise messaging systems. Preferred Qualifications Databricks experience (SQL). AWS experience, including services such as: S3 EMR Glue Lambda ECS/EKS Experience supporting large-scale cloud migration initiatives. Experience with lakehouse architectures and modern data platform patterns. Experience handling multi ...

Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify … changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB and LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab ...

Experience with Amazon Bedrock, generative AI, LLM fine-tuning, or RAG systems. Experience with streaming and big data tools (Kinesis, Kafka, Spark, EMR). Familiarity with model monitoring and explainability tools (SageMaker Model Monitor, Clarify, MLflow). Experience in regulated or public-sector environments (FedRAMP, GovCloud, compliance ...

plans, run rigorous unit/integration tests, and deliver reproducible, well-documented results. Design and maintain AI-enabled, PySpark data pipelines on AWS primarily EMR, Glue, Athena, DynamoDB, and S3 to process large datasets at scale. Harden and tune jobs for performance, cost, and compliance, and manage data partitioning … years in any occupation in which the required experience was gained. Position requires two years in the following: 1. Build PySpark ETL on AWS EMR/Glue reading/writing S3 (partitioning, predicate pushdown, broadcast joins) to deliver analytics-ready fact/dimension tables on schedule. 2. Author ...

experimenting with and integrating emerging trends and tools in data engineering Belangrijkste vereisten 3-5 years in data engineering Experience with AWS (Redshift, Glue, EMR) or GCP (BigQuery, Dataflow, Pub/Sub) Strong coding abilities in Python/Java Advanced SQL skills Hands-on experience with Spark and Kafka … Proactive and adaptable mindset in dynamic environments Proactive and adaptable Strong collaboration with cross-functional teams Clear written and verbal communication AWS: Redshift, Glue, EMR GCP: BigQuery, Dataflow, Pub/Sub Python ...