26 to 50 of 65 Amazon EMR Jobs

Delta Lake, Unity Catalog, and streaming technologies.Broad cloud expertise across Azure (Synapse, ADF, Event Hub, ADLS Gen2, Purview, Key Vault) and AWS (S3, Glue, EMR, Kinesis, Athena, Lake Formation, IAM), with strong multi-cloud experience.Strong understanding of modern engineering practices, including CI/CD for data platforms, automated deployment ...

Lake, Unity Catalog, and streaming technologies. Broad cloud expertise across Azure (Synapse, ADF, Event Hub, ADLS Gen2, Purview, Key Vault) and AWS (S3, Glue, EMR, Kinesis, Athena, Lake Formation, IAM), with strong multi-cloud experience. Strong understanding of modern engineering practices, including CI/CD for data platforms, automated ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAA Experience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetry Strong problem‐solving ...

comprehensive understanding of cloud data warehousing, data pipelines and data transformation (extract, transform, and load) processes and supporting technologies such as Google Dataflow, DBT, EMR, CI/CD Pipelines, Airflow DAGs, and other analytics tools. Experience with cloud-based data infrastructures (Ideally GCP, but AWS or Azure would also ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

transformation patterns. Proficiency in data quality assurance, data governance, and query optimization. Nice to have: Familiarity with the AWS data ecosystem (S3, Glue, EMR/PySpark, Apache Iceberg). Non-Technical Skills & Competencies Proven sense of ownership, commitment, and personal accountability. Meticulous attention to detail with a proactive problem ...

data assets. Define data access, storage, integration and processing patterns across multi-cloud environments. Provide architectural guidance across AWS and Azure services, including EC2, EMR, S3, Lambda and Azure Blob Storage. Work with Cloud and Infrastructure teams to ensure appropriate networking, connectivity, security and access controls. Champion DevOps … performance optimisation and parallel processing. Experience integrating cloud-based platforms with on-premises data sources. Hands-on knowledge of AWS services such as EC2, EMR, S3 and Lambda. Experience with Azure data storage and processing services, including Azure Blob Storage. Good understanding of AWS and Azure networking, security ...

open standards to enable scalable analytics and threat intelligence Define Real Time and batch data using AWS services like S3, Glue, Lambda, Athena, EMR, Redshift & Kinesis as well as engineer integrations with - SIEM platforms, IAM Systems, Cloud Security Posture, Endpoint Protection Platforms & Threat Intelligence Platforms Work in partnership with ...

Proficiency in Python (preferred), with experience in other languages like Java, Scala, or TypeScript Strong knowledge of cloud-based big data tools (AWS, Spark, EMR, Lambda, etc.) Excellent communication and problem-solving skills, with a collaborative mindset A passion for supporting SMEs through innovative, data-led technology Background ...

Preferred Qualifications Knowledge or certification with AWS services, including ECS (Docker), S3, EC2, Lambda, CloudWatch Experience with big data technologies & tools like Spark, Databricks, EMR Experience with Terraform or other infrastructure as code tooling Experience building scalable, fault-tolerant, high-uptime systems Creative and inventive problem solving Experience mentoring ...

TypeScript, Python, Java, etc) in support of Investment Portfolio Management and Construction Utilizing AWS technologies such as Lambda, API Gateway, DynamoDB, S3, Glue, Redshift, EMR, Sagemaker, EKS/ECS. Working in a team with experienced software engineers to identify great projects and features that will help you grow ...

Advanced Python or Scala CI/CD tools (Jenkins, Ansible, Fortify, DevOps pipelines) Microservices and Big Data (Spark, Hadoop/HDFS) AWS services (EC2, EMR, Lambda, S3, Glue) QA automation (Cucumber, Selenium, Karate) Preferred Domain Knowledge Financial data systems: Equity, Commodities, Forex, Futures, and Options. Index/Benchmark ...

practices Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify … changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB and LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab ...

Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify … changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB and LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab ...

practical knowledge of: View21 – Core View and Pre-View Anti-Money Laundering (AML) Way4 Cards Auto Loans AWS PySpark SAP BODS Informatica AWS Glue EMR and Serverless Spark IAM Secrets Manager CloudWatch Microsoft SQL Server You will also have strong SQL, data validation and troubleshooting skills, with experience testing ...

NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala ...

Experience with enterprise-scale implementations of cloud-native data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns with demonstrated experience architecting end-to-end data solutions Experience navigating complex data ...

solve them Some extra skills that are great (but not essential): Experience with MLOps tools: Airflow, MLflow, AWS SageMaker, AWS S3, AWS EMR, CI/CD Prior experience in the fraud domain and a strong understanding of fraud detection techniques Experience designing and deploying LLM-based solutions in production ...

solve them Some extra skills that are great (but not essential): Experience with MLOps tools: Airflow, MLflow, AWS SageMaker, AWS S3, AWS EMR, CI/CD Prior experience in the fraud domain and a strong understanding of fraud detection techniques Experience designing and deploying LLM-based solutions in production ...

technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More information Enjoy fantastic perks like ...

like Erwin or TOAD. AWS Data Stack: Strong working knowledge of the AWS cloud data ecosystem, specifically requiring experience with S3, AWS Glue, PySpark, EMR, and Apache Iceberg. Architecture & Design : Ability to translate complex business requirements into high-level and low-level technical designs (HLD/LLD), ensuring data ...

like Erwin or TOAD. AWS Data Stack: Strong working knowledge of the AWS cloud data ecosystem, specifically requiring experience with S3, AWS Glue, PySpark, EMR, and Apache Iceberg. Architecture & Design : Ability to translate complex business requirements into high-level and low-level technical designs (HLD/LLD), ensuring data ...

Experience with enterprise-scale implementations of cloud-native data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills: Experience navigating complex data governance, security, and compliance ...