1 to 25 of 77 Amazon EMR Jobs

Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/prod), naming standards … cloud platform, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, and related security, networking, and monitoring services.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.* Passion for data and a thirst ...

within UK Central Government. What You'll Be Doing Design, build, and maintain production-grade data pipelines using AWS services including Amazon EMR, S3 and Lambda. Develop scalable data processing solutions using PySpark, Python and SQL with a focus on performance, resilience, testing and observability. Lead … experience delivering data engineering solutions within UK Central Government. Strong commercial experience with Informatica. Hands-on expertise with AWS services including Amazon EMR, S3 and Lambda. Advanced PySpark, Python and SQL skills for large-scale data processing. Experience building and maintaining enterprise-scale batch data pipelines. Strong ...

Data Engineer (AWS) - Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader … Nathan Warner at Noir Consulting. (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

Engineer (AWS) – Manchester(Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer)Our client … Noir Consulting.(Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer)NOIRUKTECHRECNOIRUKREC ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

queuing systems API design, versioning, and service mesh technologies 4+ years of data engineering experience ETL/ELT pipeline development using AWS services (Glue, EMR, Kinesis, Step Functions) Experience with data lakes, data warehousing, and analytics platforms Real-time data processing and streaming architectures 3+ years with AWS cloud ...

skills, including supporting business users and translating technical concepts into business outcomes.Desirable Criteria• A cloud (AWS/Azure) delivery background. • Knowledge in the following: EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune, VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMSFurther Location InformationPlease ensure that you only apply ...

skills, including supporting business users and translating technical concepts into business outcomes.Desirable Criteria• A cloud (AWS/Azure) delivery background. • Knowledge in the following: EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune, VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMSFurther Location InformationPlease ensure that you only apply ...

skills, including supporting business users and translating technical concepts into business outcomes.Desirable Criteria• A cloud (AWS/Azure) delivery background. • Knowledge in the following: EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune, VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMSFurther Location InformationPlease ensure that you only apply ...

manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best … practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark ...

Lambda, API Gateway, and SQS or SNS •Demonstrated hands-on experience implementing data pipelines or analytics workflows using AWS-native services (Glue, Athena, EMR, S3) •Demonstrated experience optimizing AWS costs using best practices such as right-sizing, storage tiering, and workload-aware architecture decisions. •Demonstrated hands-on experience with ...

agent workflows and connect to internal platforms. Write clean, tested, and documented code while setting engineering standards. Work within AWS services such as Athena, EMR, S3, and Lambda and integrate with the existing data stack. Experience Requirements: 3+ years of software engineering experience with production applications using TypeScript/ ...

agent workflows and connect to internal platforms. Write clean, tested, and documented code while setting engineering standards. Work within AWS services such as Athena, EMR, S3, and Lambda and integrate with the existing data stack. Experience Requirements: 3+ years of software engineering experience with production applications using TypeScript/ ...

distributed data systems and tools such as Apache Flink, Apache Hudi, and Apache Iceberg. Preferred: Kafka and Schema Registry, Step Functions, SNS, SQS, Aurora, EMR, Redshift, CloudWatch, CloudTrail, Concourse, Vault or similar, cloud migration, observability and monitoring. Effective communication with technical and non-technical stakeholders in distributed teams. Recruitment ...

Software Dev Engineer, Amazon Security Automation Job ID: 10498444 | Amazon UK Services Ltd. At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon … development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2 Experience developing, deploying and managing AI products at scale Amazon is an equal opportunities employer. We believe passionately ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

with Airflow and event triggers. Perform other duties as required. Experience Requirements: Expert experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets Manager, and CloudWatch. Strong infrastructure as code experience with Terraform or CloudFormation. Background in cross-account AWS architectures, VPC peering, PrivateLink, and transit ...

with Airflow and event triggers. Perform other duties as required. Experience Requirements: Expert experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets Manager, and CloudWatch. Strong infrastructure as code experience with Terraform or CloudFormation. Background in cross-account AWS architectures, VPC peering, PrivateLink, and transit ...

JavaCommercial experience in client-facing projects is a plus, especially within multi-disciplinary teamsDeep knowledge of database technologies:Distributed systems (e.g., Spark, Hadoop, EMR)RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL)NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j)Solid understanding of software engineering best practices – code reviews, testing frameworks ...

integrated toolingProficiency in Python, Scala, or Java in a production data platform contextSolid understanding of cloud-native data infrastructure (AWS preferred — Glue, Athena, S3, EMR, Lambda, or equivalents)Track record of managing, recruiting, and developing high-performing remote engineering teamsAbility to translate long-term platform vision into executable quarterly ...