1 to 25 of 57 Amazon EMR Jobs

Databricks Certified Data Engineer Professional**AWS*** Proficiency with AWS Tools: Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions.* Programming Skills: Strong experience ...

people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also … need experience with several of the following: Amazon Redshift, AWS Lambda, Amazon Athena, Amazon RDS, Amazon EMR, Amazon EventBridge, Amazon Kinesis, AWS Step Functions, Amazon SQS/SNS and AWS CloudWatch. These roles are outside ...

Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/prod), naming standards … cloud platform, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, and related security, networking, and monitoring services.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.* Passion for data and a thirst ...

source-code management. Strong troubleshooting and problem-solving skills. AWS Experience Candidates should have practical experience with relevant AWS data services, such as: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Amazon Athena Amazon RDS AWS IAM Amazon CloudWatch Experience with services such as Kinesis, EMR, Step Functions or MWAA/Airflow would be advantageous. AWS data engineering roles commonly use services such as S3, Glue, Redshift, Lambda, Kinesis ...

production‐ready AI solutions in complex professional environments. Strong consulting, stakeholder engagement, problem‐solving, and technical leadership capabilities. Desirable AWS Tools & Technologies experience: Amazon SageMaker - ML development, training, deployment & MLOps Amazon … Scalable data storage & data lakes AWS Glue - Data integration, ETL & preparation Amazon Redshift & Athena - Data warehousing & serverless analytics Amazon EMR - Big data processing & Spark Amazon Bedrock - Generative AI & foundation models AWS Lambda - Serverless data & AI workflows Amazon QuickSight - BI, dashboards & visualisation ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured, analytically trusted … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

experience in Data Engineering* Strong expertise in Python and extensive experience with PySpark and distributed data processing* Expert-level knowledge of AWS services including EMR, Glue, Lambda, S3, Athena, Redshift, ECS/EKS, Step Functions, EventBridge, IAM, CloudWatch, and SNS/SQS* Hands-on experience building data lakes ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

Server to AWS, including target modelling, cutover approach, reconciliation strategy and technical risk management. Design and build the real‐time data architecture using Amazon MSK/Apache Kafka and PySpark Structured Streaming (evaluating Apache Flink where it is the better fit), including event schema governance, exactly‐once semantics … Essentials: Deep, hands‐on expertise across core AWS data services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR, with the ability to make and defend architectural decisions. Advanced proficiency in Python and SQL, including PySpark for large‐scale batch and streaming processing ...

ways of working. It’s a plus if you also have these skills Experience using AWS or another major cloud platform. Our environment includes EMR, Athena, Lambda, S3, Glue and Step Functions, but we're open to transferable experience solving similar problems. Experience with Snowflake, Spark, Scala or Airflow ...

Strong experience testing cloud-native platforms on AWS . Hands-on experience with services such as: o AWS S3 o Lambda o Glue o EMR o ECS/EKS o RDS o IAM o CloudWatch Understanding of cloud architecture, distributed systems, and microservices. Experience validating infrastructure, platform services, APIs ...

Implement batch workflows and ETL processes adhering to modern engineering standards. Develop Cloud-Based Workflows Orchestrate data workflows using AWS services such as Glue, EMR Serverless, Lambda, and S3. Contribute to the evolution of lakehouse architecture leveraging Apache Iceberg. Apply Software Engineering Best Practices Use version control, CI/ ...

emerging technologies could improve engineering quality, productivity and ways of working. Additional assets Experience using AWS or another major cloud platform. Our environment includes EMR, Athena, Lambda, S3, Glue and Step Functions, but we're open to transferable experience solving similar problems. Experience with Snowflake, Spark, Scala or Airflow ...

Kafka and a programming language (e.g., Python or Java) for building data workflows and automation. Familiarity with AWS services such as S3, Glue, Lambda, EMR, or streaming tools like MSK/Kinesis. Experience with basic data governance, data quality checks, and security practices (e.g., RBAC, encryption, handling PII). ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence Preferred Qualifications Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions Experience with non-relational databases/data stores (object storage, document or key-value stores, graph … highly available, distributed systems of data extraction, ingestion, and processing of large data sets Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting ...

Spark Strong skills in Python and SQL, with solid data modeling experience Extensive knowledge of AWS/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB, EMR, Athena) Hands-on experience with orchestration and workflow tools (Docker, Kubernetes, Airflow, Prefect, Dagster) Familiar with CI/CD pipelines, infrastructure as code ...

mesh, data fabric). Hands-on experience with one or more cloud data ecosystems: Azure (Data Factory, Synapse, Fabric, ADLS, Databricks) AWS (Glue, Redshift, EMR) GCP (BigQuery, Dataflow) Databricks (Spark/PySpark) Snowflake (SQL, Snowpark, performance tuning) Strong SQL and/or Python capability, and familiarity with tools such ...

scale data solutions Hands-on expertise in Apache Spark development using Java or Scala (Python experience considered) Strong proficiency in AWS cloud services (S3, EMR, Glue, IAM, etc.) and cloud-native architecture principles Advanced SQL development skills for performance-critical data transformations Practical knowledge of ETL/ELT pipelines ...

initiatives. Requirements Proven commercial experience as an AWS Data Engineer or Data Platform Engineer. Strong experience working with AWS services including S3, Glue, Athena, EMR and Lambda. Advanced SQL and Python skills. Strong data modelling expertise, including dimensional modelling and analytics-ready data design. Experience delivering ...

initiatives. Requirements Proven commercial experience as an AWS Data Engineer or Data Platform Engineer. Strong experience working with AWS services including S3, Glue, Athena, EMR and Lambda. Advanced SQL and Python skills. Strong data modelling expertise, including dimensional modelling and analytics-ready data design. Experience delivering ...

extension Start Date: ASAP OR 4 weeks. Must-Have Skills: Strong experience building and supporting AWS Data Lakehouse solutions AWS services including S3, Glue, EMR, Athena, Redshift, Lake Formation, EventBridge & Step Functions Advanced Python and SQL skills Strong experience with PySpark and large-scale data processing Hands-on experience ...