1 to 25 of 49 Amazon EMR Jobs

Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/prod), naming standards … cloud platform, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, and related security, networking, and monitoring services.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.* Passion for data and a thirst ...

within UK Central Government. What You'll Be Doing Design, build, and maintain production-grade data pipelines using AWS services including Amazon EMR, S3 and Lambda. Develop scalable data processing solutions using PySpark, Python and SQL with a focus on performance, resilience, testing and observability. Lead … experience delivering data engineering solutions within UK Central Government. Strong commercial experience with Informatica. Hands-on expertise with AWS services including Amazon EMR, S3 and Lambda. Advanced PySpark, Python and SQL skills for large-scale data processing. Experience building and maintaining enterprise-scale batch data pipelines. Strong ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best … practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

Software Dev Engineer, Amazon Security Automation Job ID: 10498444 | Amazon UK Services Ltd. At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon … development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2 Experience developing, deploying and managing AI products at scale Amazon is an equal opportunities employer. We believe passionately ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

experience in data engineering or business intelligence roles3-5 years of SQL experienceAbility to work efficiently within AWS cloud technologies such as S3, EMR preferred1+ years experience in Agile SDLC1+ years dbt experience preferredSolid understanding of ETL/ELT methodologiesProficiency with Python and scripting languages preferredSolid understanding of industry ...

data engineering or business intelligence roles 3-5 years of SQL experience Ability to work efficiently within AWS cloud technologies such as S3, EMR preferred 1+ years experience in Agile SDLC 1+ years dbt experience preferred Solid understanding of ETL/ELT methodologies Proficiency with Python and scripting languages ...

integrated toolingProficiency in Python, Scala, or Java in a production data platform contextSolid understanding of cloud-native data infrastructure (AWS preferred — Glue, Athena, S3, EMR, Lambda, or equivalents)Track record of managing, recruiting, and developing high-performing remote engineering teamsAbility to translate long-term platform vision into executable quarterly ...

building and supporting ETL/ELT frameworks. Strong understanding of data warehousing concepts and dimensional modelling. AWS experience, including services such as S3, Glue, EMR, or PySpark . Knowledge of data governance, quality controls, and testing practices. Experience working within large-scale enterprise environments. Desirable Knowledge of Iceberg ...

Linux skills and proficiency in Python for automation and integrationFamiliarity with infrastructure as code, using Terraform or AnsibleDeep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAAExperience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetryStrong problem-solving skills ...

exposure to the following will be good to have else we will be enable you with the required trainingAWS Glue and Data Catalog, EMR, Athena, S3, Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure ...

Languages English (Preferred) Spanish (Preferred) Hard Skills Practical experience with AWS cloud architecture, including services like S3, IAM, VPC, KMS, CloudWatch, CloudTrail, Glue, Athena, EMR, Lambda, Step Functions, and SageMaker. (Preferred) Skilled in SQL and NoSQL databases for implementing data warehouses and data lakes. (Preferred) Experienced in data ingestion … processing, transformation, and delivery using batch, streaming, and real‐time methods. (Preferred) Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). ...

Languages English (Preferred) Spanish (Preferred) Hard Skills Practical experience with AWS cloud architecture, including services like S3, IAM, VPC, KMS, CloudWatch, CloudTrail, Glue, Athena, EMR, Lambda, Step Functions, and SageMaker. (Preferred) Skilled in SQL and NoSQL databases for implementing data warehouses and data lakes. (Preferred) Experienced in data ingestion … processing, transformation, and delivery using batch, streaming, and real‐time methods. (Preferred) Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). ...

platform experience across compute, storage, networking, security, provisioning, and automation. Hands-on with services including EC2, ECS, EKS, ELB, S3, Lambda, API Gateway, Glue, EMR, ElastiCache, CloudWatch, and CodeDeploy. Infrastructure provisioning expertise using Terraform (advanced techniques), including implementing/configuring AWS RDS and Aurora via Terraform. Administer, optimize ...

computing frameworksExperience with enterprise-scale implementations of cloud-native data platforms such as Databricks and SnowflakeGood understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutionsExperience navigating complex data governance ...

data modelling experience. Strong understanding of ETL/ELT architecture and data integration frameworks. AWS experience including services such as S3, Glue, EMR, and PySpark . Experience defining data standards, governance frameworks, and architectural roadmaps. Desirable Experience with Iceberg and modern lakehouse architectures. Exposure to AI-enabled data platforms ...

considering effort, impact, and scalability trade-offs; Nice to have: Apache Spark, Iceberg, Kafka, dbt, Scikit-Learn, XGBoost, PyTorch, MLFlow, GraphFrames, Ray, AWS S3, EMR, SageMaker, Lakeformation, Terraform, Docker, GitHub CI/CD, Knowledge Graphs, RAG, graph ML, probabilistic programming, A/B testing. Условия No conditions specified #J ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...