1 to 25 of 28 Amazon EMR Jobs

Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/prod), naming standards … cloud platform, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, and related security, networking, and monitoring services.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.* Passion for data and a thirst ...

Skills Expected Candidate should have experience with one or more of the following AWS services: Amazon S3 AWS Glue Amazon EMR AWS Lambda AWS Step Functions Amazon Redshift Amazon Athena Amazon RDS/Aurora AWS IAM AWS KMS Amazon ...

Data Engineer (AWS) - Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader … Nathan Warner at Noir Consulting. (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena, and related services. Implement lakehouse architecture using Databricks, Delta Lake, and AWS S3. Build data ingestion pipelines from ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

DevOps, CI/CD and software testing. • Expertise with one of programming languages such as SQL, or Python. • Have working experience of AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services. • Experience with Data platform tools like Databricks and/or Snowflake. • Be able ...

/Training: Required Qualifications Languages: Scala, Python, SQL, JavaScript Data Processing: Apache Spark, Flink, Airflow Platforms & Tools: Databricks, Hive, Presto, Snowflake Cloud: AWS (S3, EMR, Glue, Lambda) Minimum of 8 years of relevant software engineering, data engineering or data science - preferably with a digital media or digital advertising company ...

/Training: Required Qualifications Languages: Scala, Python, SQL, JavaScript Data Processing: Apache Spark, Flink, Airflow Platforms & Tools: Databricks, Hive, Presto, Snowflake Cloud: AWS (S3, EMR, Glue, Lambda) Minimum of 8 years of relevant software engineering, data engineering or data science - preferably with a digital media or digital advertising company ...

/Training: Required Qualifications Languages: Scala, Python, SQL, JavaScript Data Processing: Apache Spark, Flink, Airflow Platforms & Tools: Databricks, Hive, Presto, Snowflake Cloud: AWS (S3, EMR, Glue, Lambda) Minimum of 8 years of relevant software engineering, data engineering or data science - preferably with a digital media or digital advertising company ...

large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. This role combines hands-on technical leadership with test strategy ownership . You will be responsible for defining … transformation, and processing workflows Ensure data integrity, transformation accuracy, reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis for production data issues and platform defects Risk Management & Reporting ...

level language like Go, Java, JavaScript, Python Distributed Software Architecture exposure in high volume production scenarios Working with Data Mesh, BigData technologies such as EMR, Spark, Databricks Designing, tracking and testing to SLOs and Chaos Engineering toError Budgets Implementing Business Continuity (BCP) and Disaster Recovery (DRP) plans including tracking ...

• Develop and maintain data pipelines using Python, SQL, and Apache Airflow. • Containerise data applications and workflows using Docker. • Build and optimise data solutions using AWS services including: • Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch. ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...

pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python, SQL, DBT, AWS: S3, Glue, EMR, Lambda, Aurora, Airflow, Terraform). Ensure data availability, integrity, and performance as the platform scales globally. Drive best practices in data quality, automated testing … equivalent). Experience integrating with major EHR platforms (Epic, Cerner, Meditech, or similar). Strong command of the AWS data stack: S3, Glue, EMR, Lambda, Aurora, and orchestration tools such as Airflow. Proficiency in Python, SQL, and DBT; familiarity with IaC tooling such as Terraform. Comfortable operating across customer ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...

regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills: You are highly comfortable using ...

regulated environment.* AWS Experience: You have a strong working knowledge of AWS and cloud-first data pipeline orchestration tools (like Airflow, Glue, or EMR).* A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines.* Strong Automation Skills: You are highly comfortable using ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS’s analytics portfolio, including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch. You’ll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges, whether migrating from legacy … workshops, and reference architectures. Key job responsibilities Architect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch). Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud‐native analytics, including ...

120K + Benefits Required Skills & Experience: 10+ years of Python development for Big Data applications 5+ years of hands-on experience with AWS services (EMR, Lambda, EventBridge, Step Functions, Redshift, S3, Glue) Strong experience with Spark, SQL, API integration, data transformation & visualization Hands-on experience with Hadoop/EMR ...

governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks Preferred Qualifications Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure Data security, compliance, and access controls Performance optimization for data processing workloads Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

/60 PM counter granularity and able to write codes for aggregation Build and optimize distributed data processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse Work with Amazon MSK (Kafka) for real‐time ...

doing – your accountabilities -System Design • Architect Distributed AWS Systems: Design scalable, event-driven architectures (SQS, MSK, Lambda, EKS/ECS/EMR, Step Functions) supporting AIOps telemetry ingestion, correlation, and automated remediation across the mobile network estate. • Define Reference Architectures: Set standards for streaming, lakehouse, and microservices patterns handling … customer usage data. • Architect Scalable Data Solutions: Design and implement enterprise-grade data pipelines and architectures using AWS services (e.g. S3, Glue, Lambda, Redshift, EMR, Kinesis,ClickHouse), optimised for analytics and scalability. • Design for Resilience: Own multi-AZ/multi-region strategy, disaster recovery, and chaos-engineering practices ...

doing – your accountabilities -System Design • Architect Distributed AWS Systems: Design scalable, event-driven architectures (SQS, MSK, Lambda, EKS/ECS/EMR, Step Functions) supporting AIOps telemetry ingestion, correlation, and automated remediation across the mobile network estate. • Define Reference Architectures: Set standards for streaming, lakehouse, and microservices patterns handling … customer usage data. • Architect Scalable Data Solutions: Design and implement enterprise-grade data pipelines and architectures using AWS services (e.g. S3, Glue, Lambda, Redshift, EMR, Kinesis,ClickHouse), optimised for analytics and scalability. • Design for Resilience: Own multi-AZ/multi-region strategy, disaster recovery, and chaos-engineering practices ...