13 of 13 Amazon EMR Jobs

people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also … need experience with several of the following: Amazon Redshift, AWS Lambda, Amazon Athena, Amazon RDS, Amazon EMR, Amazon EventBridge, Amazon Kinesis, AWS Step Functions, Amazon SQS/SNS and AWS CloudWatch. These roles are outside ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

technical stakeholders Experience supporting machine learning or AI workloads through production-grade data engineering solutions Highly Desirable Strong AWS data platform experience (S3, Glue, EMR, Redshift, Athena, Lambda, Bedrock, SageMaker or equivalent) Experience operationalising machine learning models into production environments Experience with MLOps, model deployment, model monitoring, model lifecycle ...

initiatives. Requirements Proven commercial experience as an AWS Data Engineer or Data Platform Engineer. Strong experience working with AWS services including S3, Glue, Athena, EMR and Lambda. Advanced SQL and Python skills. Strong data modelling expertise, including dimensional modelling and analytics-ready data design. Experience delivering ...

initiatives. Requirements Proven commercial experience as an AWS Data Engineer or Data Platform Engineer. Strong experience working with AWS services including S3, Glue, Athena, EMR and Lambda. Advanced SQL and Python skills. Strong data modelling expertise, including dimensional modelling and analytics-ready data design. Experience delivering ...

exposure to the following will be good to have else we will be enable you with the required trainingAWS Glue and Data Catalog, EMR, Athena, S3, Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure ...

Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify … changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB and LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab ...

Experience with Python, Hadoop, HDFS, Hive and other BigData technologies.•Familiarity with Data warehousing and ETL concepts and techniques•Working Knowledge in AWS (Glue EMR) etc. is good to have.•Having expertise in Database concepts and SQL/NoSQL operations.•UNIX shell scripting will be an added advantage ...

similar platforms for application development and data integrationExperience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the ICExperience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems, and with Grafana, Power ...

large-scale data platform or data warehouse migration (cutover, reconciliation, parallel running, decommissioning) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg ...

What they're looking for: Previous experience as a Technical Lead (hands-on) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg ...

field.Experience with large-scale distributed data processing (e.g., Apache Spark) and cloud data infrastructure across GCP and AWS (e.g., Dataproc, Dataflow, GKE, EMR).Experience with TemporalWe use automated decision systems (ADS) as part of our recruitment and hiring process. If you require an accommodation or believe that ...