26 to 50 of 82 Permanent Amazon EMR Jobs

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAA Experience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetry Strong problem‐solving ...

Linux skills and proficiency in Python for automation and integrationFamiliarity with infrastructure as code, using Terraform or AnsibleDeep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAAExperience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetryStrong problem-solving skills ...

performance optimization and live site monitoring Mentor team members through giving and receiving actionable feedback. Our tech stack AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment process based on GitLab A little more about you A Bachelor ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

platform experience across compute, storage, networking, security, provisioning, and automation. Hands-on with services including EC2, ECS, EKS, ELB, S3, Lambda, API Gateway, Glue, EMR, ElastiCache, CloudWatch, and CodeDeploy. Infrastructure provisioning expertise using Terraform (advanced techniques), including implementing/configuring AWS RDS and Aurora via Terraform. Administer, optimize ...

Develop and optimize data models for data warehouse/data lake (Redshift, S3) Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR) Implement data quality checks, validation, and reconciliation processes Optimize pipeline performance and manage compute/storage costs Ensure data security and access control (IAM, KMS, encryption … requirements Document data pipelines, architecture, and operational runbooks SKILLS Must have 5+ years of experience Hands-on experience building data pipelines on AWS (Glue, EMR, Lambda, Step Functions) Strong SQL and experience with data warehousing (Redshift, dimensional modeling) Proficiency in Python or Scala for data engineering Experience with ...

designing metrics and KPIs to verify and automate management of data quality. Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions). Desirable Skills Working experience in Data Lakehouse environments such as Databricks ...

TypeScript, Python, Java, etc) in support of Investment Portfolio Management and Construction Utilizing AWS technologies such as Lambda, API Gateway, DynamoDB, S3, Glue, Redshift, EMR, Sagemaker, EKS/ECS. Working in a team with experienced software engineers to identify great projects and features that will help you grow ...

demonstrated to stakeholders. Architecture design informed through the use of principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...

Experience with enterprise-scale implementations of cloud-native data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutions Experience navigating complex data ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). #J-18808-Ljbffr ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). #J-18808-Ljbffr ...

considering effort, impact, and scalability trade-offs; Nice to have: Apache Spark, Iceberg, Kafka, dbt, Scikit-Learn, XGBoost, PyTorch, MLFlow, GraphFrames, Ray, AWS S3, EMR, SageMaker, Lakeformation, Terraform, Docker, GitHub CI/CD, Knowledge Graphs, RAG, graph ML, probabilistic programming, A/B testing. Условия No conditions specified #J ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...

Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development. Strong communication skills, with the ability ...

technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More information Enjoy fantastic perks like ...

distributed teams in collaborative delivery environments. Deep working knowledge across key AWS Data & Analytics services, including: Building large-scale data lake architectures on Amazon S3 and open table formats Implementing governance and cataloging through AWS Lake Formation. Developing ETL and metadata frameworks using AWS Glue. Leveraging AWS Lambda … serverless data processing. Running distributed data workloads on Amazon EMR. Enabling real-time data pipelines with AWS Kinesis (Data Streams and Firehose). Orchestrating pipelines using AWS Step Functions/Amazon MWAA/similar services. Designing and optimizing schemas and query performance on Amazon ...

digital platformsOur technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.)PySparkAWS cloud infrastructure: EMR, ECS, Athena, etcMLOps/DevOps: Terraform, Docker, Airflow, MLFlowMonitoring and evaluation platforms including New Relic and BraintrustMore information: Enjoy fantastic perks like private healthcare ...

doing for society. First month - some examples of what to expect: Help add further key third party API integrations, including with legacy EMR systems and national APIs like e.g. the electronic prescribing service, allowing Anima to directly issue prescriptions. Iterate on a proprietary graph traversal algorithm to improve patient ...