24 of 24 Amazon EMR Jobs

people with extensive commercial experience with AWS Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also … need experience with several of the following: Amazon Redshift, AWS Lambda, Amazon Athena, Amazon RDS, Amazon EMR, Amazon EventBridge, Amazon Kinesis, AWS Step Functions, Amazon SQS/SNS and AWS CloudWatch. These roles are outside ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

technical stakeholders Experience supporting machine learning or AI workloads through production-grade data engineering solutions Highly Desirable Strong AWS data platform experience (S3, Glue, EMR, Redshift, Athena, Lambda, Bedrock, SageMaker or equivalent) Experience operationalising machine learning models into production environments Experience with MLOps, model deployment, model monitoring, model lifecycle ...

data mesh, data fabric).Hands-on experience with one or more cloud data ecosystems: Azure (Data Factory, Synapse, Fabric, ADLS, Databricks)AWS (Glue, Redshift, EMR)GCP (BigQuery, Dataflow)Databricks (Spark/PySpark)Snowflake (SQL, Snowpark, performance tuning)Desirable ExperienceStrong SQL and/or Python capability, and familiarity with tools ...

schema evolution at scaleBuilding software that processes data at scale on AWS using technologies such as Lambda, containerised services, and, where appropriate, Glue, EMR Serverless, and lakehouse table formats such as Apache IcebergEmbedding observability, automated testing, monitoring, and quality controls so that issues are identified before they affect customersTaking ...

initiatives. Requirements Proven commercial experience as an AWS Data Engineer or Data Platform Engineer. Strong experience working with AWS services including S3, Glue, Athena, EMR and Lambda. Advanced SQL and Python skills. Strong data modelling expertise, including dimensional modelling and analytics-ready data design. Experience delivering ...

initiatives. Requirements Proven commercial experience as an AWS Data Engineer or Data Platform Engineer. Strong experience working with AWS services including S3, Glue, Athena, EMR and Lambda. Advanced SQL and Python skills. Strong data modelling expertise, including dimensional modelling and analytics-ready data design. Experience delivering ...

exposure to the following will be good to have else we will be enable you with the required trainingAWS Glue and Data Catalog, EMR, Athena, S3, Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure ...

TypeScript, Python, Java, etc) in support of Investment Portfolio Management and Construction Utilizing AWS technologies such as Lambda, API Gateway, DynamoDB, S3, Glue, Redshift, EMR, Sagemaker, EKS/ECS. Working in a team with experienced software engineers to identify great projects and features that will help you grow ...

Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify … changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB and LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab ...

Experience with Python, Hadoop, HDFS, Hive and other BigData technologies.•Familiarity with Data warehousing and ETL concepts and techniques•Working Knowledge in AWS (Glue EMR) etc. is good to have.•Having expertise in Database concepts and SQL/NoSQL operations.•UNIX shell scripting will be an added advantage ...

enable advanced analytics and business intelligence across Honda's enterprise. Key Accountabilities Data Pipeline Development: Design and implement ETL pipelines using AWS services (Glue, EMR, DMS, S3, Redshift). Orchestrate workflows with AWS Step Functions, EventBridge, and Lambda. Integrate CI/CD pipelines with GitHub … Logical, and Physical), ETL optimizations, Query optimizations and Performance tuning Other job specific skills: Technical Skills: Programming languages: Python, PySpark, SQL AWS Services: Glue, EMR, EC2, Lambda, DMS, S3, Redshift, RDS Data Governance: Informatica CDGC/CDQ DevOps Tools: Git, GitHub, AWS CDK Security: IAM, encryption policies Monitoring: CloudWatch ...

solve themSome extra skills that are great (but not essential): Experience with MLOps tools: Airflow, MLflow, AWS SageMaker, AWS S3, AWS EMR, CI/CDPrior experience in the fraud domain and a strong understanding of fraud detection techniquesExperience designing and deploying LLM-based solutions in productionWe're people without ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...

digital platformsOur technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.)PySparkAWS cloud infrastructure: EMR, ECS, Athena, etcMLOps/DevOps: Terraform, Docker, Airflow, MLFlowMonitoring and evaluation platforms including New Relic and BraintrustMore information: Enjoy fantastic perks like private healthcare ...

similar platforms for application development and data integrationExperience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the ICExperience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems, and with Grafana, Power ...

large-scale data platform or data warehouse migration (cutover, reconciliation, parallel running, decommissioning) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg ...

What they're looking for: Previous experience as a Technical Lead (hands-on) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg ...

production rather than for novelty. You don't need to know all of it on day one. Data and compute: S3, Athena, Spark on EMR, SQLOrchestration and MLOps: Airflow, MLflow, Docker, ECS, Terraform, GitHub Actions for CI/CDModels: foundation models served through Amazon BedrockAgents: LangGraph … orchestration, deployed and run on Amazon Bedrock AgentCore, with MCP for tool integrationEvaluation: Braintrust for evals, tracing and monitoring agent quality in productionMore information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for-1 share purchase plans, an EV Scheme ...

field.Experience with large-scale distributed data processing (e.g., Apache Spark) and cloud data infrastructure across GCP and AWS (e.g., Dataproc, Dataflow, GKE, EMR).Experience with TemporalWe use automated decision systems (ADS) as part of our recruitment and hiring process. If you require an accommodation or believe that ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS's analytics portfolio including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch. You'll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges whether migrating from legacy … leadership, workshops, and reference architectures. Key job responsibilitiesArchitect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch)Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud-native analytics, including ETL refactoring ...

particular those based on large language models, information retrieval, recommender systems and knowledge graphs, to be tailored to customer needs. You will handle Amazon-scale use cases with significant impact on our customers' experiences. You will collaborate with scientists, engineers, and product partners locally and abroad. Your work … written and verbal communicationPreferred qualification - Experience in defining and creating benchmarks for assessing GenAI model performance- Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Experience working on multi-team, cross-disciplinary projectsAmazon is an equal opportunities employer. We believe passionately that employing a diverse ...

particular those based on large language models, information retrieval, recommender systems and knowledge graphs, to be tailored to customer needs. You will handle Amazon-scale use cases with significant impact on our customers' experiences. You will collaborate with scientists, engineers, and product partners locally and abroad. Your work … communication- Master's degree or above in Math, Statistics, Computer Science, or related science fieldPreferred qualification - Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Experience in defining and creating benchmarks for assessing GenAI model performance- Experience working on multi-team, cross-disciplinary projectsAmazon ...