1 to 25 of 56 Amazon EMR Jobs

POCs) from ground-up using AWS servicesBig Data & Analytics Platform Development (25%) Implement and optimize big data solutions using Amazon Kinesis, Glue, EMR,Redshift, and Timestream Design data lakes and warehouses for massive IoT data ingestion and analysis Build real-time analytics dashboards and reporting frameworks Optimize … productionenvironments Hands-on experience with AWS AI/ML services (SageMaker, Bedrock, Comprehend,Rekognition) Proven track record with big data technologies (Amazon EMR, Redshift, Spark,Hadoop) Experience deploying machine learning models, deep learning algorithmsIoT & Systems Integration: Deep hands-on IoT knowledge including device connectivity, protocols, and dataingestion ...

with at least one major cloud platform (AWS, Azure, or Google Cloud Expertise in cloud-native data services such as AWS Glue, Lambda, S3, EMR, Redshift, Lake Formation, Azure Synapse, Data Factory, Databricks, or BigQuery. Advanced knowledge of SQL, Python, Spark, PySpark, and distributed data frameworks. Proven background ...

Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing frameworks ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

experience in data engineering or a similar role. • Hands-on experience with core AWS data services (for example S3, Glue, Athena, Lambda, IAM, EMR). • Strong SQL skills (joins, window functions, optimization). • Solid Python for data processing. • Experience building production ETL/ELT pipelines. • Working knowledge of security ...

many of the following: - Expertise in designing production-grade data pipelines using Python, Scala, Spark, and SQL - Deep knowledge of AWS Cloud Platforms (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB) - Experience with data processing across structured and unstructured sources - Strong scripting abilities and API integration skills - Knowledge of data visualization ...

/BSS workflows. Key Responsibilities 1. Data Engineering & ETL Development Design, develop, and maintain ETL/ELT pipelines using AWS-native services (Glue, Lambda, EMR, Step Functions). Implement data ingestion from telecom systems like OSS/BSS, CDRs, mediation systems, CRM, billing, network logs . Optimize ETL workflows … Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high performance for petabyte-scale telecom datasets (CDRs, tower logs, subscriber activity). 4. Querying & Analytics (Athena) Develop and optimize Athena ...

/Tenable, etc.). Advantageous Security certifications such as AWS Security Specialty, AWS Solutions Architect, or equivalent. Experience supporting data platforms on AWS (Glue, EMR, Redshift, Athena, RDS, OpenSearch, Kafka/MSK). Knowledge of secure coding practices in Python/Node/Java or your core development stack. ...

full end to end continuous deployment pipeline. Major elements of our platform include AWS (we make significant use of S3, RDS, Kinesis, EC2, EMR, ElastiCache, ElasticSearch and EKS). Elements of the platform will start to expand into GCP (Compute Engine, Cloud Storage, Google Kubernetes Engine and BigQuery). ...

full end to end continuous deployment pipeline. Major elements of our platform include AWS (we make significant use of S3, RDS, Kinesis, EC2, EMR, ElastiCache, ElasticSearch and EKS). Elements of the platform will start to expand into GCP (Compute Engine, Cloud Storage, Google Kubernetes Engine and BigQuery). ...

Python development. 2+ years hands-on with AWS Lambda, SNS/SQS, S3, KMS, IAM, CloudWatch, EC2, RDS and DynamoDB, AWS CLI, Cloud 9, EMR SPARK, Glue, Athena, Lake Formation Fluency with CI/CD toolsets such as: CloudFormation, BitBucket Working knowledge of AWS Serverless architecture Working knowledge … Python development. 2+ years hands-on with AWS Lambda, SNS/SQS, S3, KMS, IAM, CloudWatch, EC2, RDS and DynamoDB, AWS CLI, Cloud 9, EMR SPARK, Glue, Athena, Lake Formation Fluency with CI/CD toolsets such as: CloudFormation, BitBucket Working knowledge of AWS Serverless architecture Working knowledge ...

Details ETL Data Engineer Tech Stack & Core Skills:Advanced SQL (Big Data focused)Data Visualization (preferably Tableau)AWS (EMR, Lambda, S3, Step Functions, Athena )ETL Data EngineeringData AnalysisHeavyAI Soft Skills:Effective CommunicationAnalysis PresentationSelf-starterCuriousGrowth MindsetCollaboration Additional Preferences:PythonpySparkData ModelingStatistical Analysis We are an equal opportunity employer. All aspects ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees, Random Forest, Gradient Boosted Trees, XGBoost Unsupervised ...

knowledge of AWS, DatabricksUnity catalog, manager cluster, deployment, strong fundamental of DW/DHStrong in troubleshooting'sSpark/Python coding mustDocker, KubernetesAWS(S3, Lambda, EMR)Certified Databricks EngineerUnderstating of Tableau or Qliksense-good to have ...

Build and optimise ETL pipelines and data flows across Snowflake, Oracle, and distributed systems Process large datasets using Spark (Java or Scala) on AWS EMR Develop data-driven services and components using Java and/or Python Contribute to microservices-based architectures Deploy and support cloud-native solutions using … Oracle Solid engineering background in Java and/or Python Hands-on experience with Apache Spark (Java or Scala) Experience with AWS , including EMR and other core services Exposure to Docker and Kubernetes (EKS) Proven experience building scalable ETL pipelines and data processing solutions Familiarity with CI/ ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...

Java). Expertise in Spark and distributed data processing frameworks. Proficiency with ML libraries such as PyTorch and TensorFlow. Experience with cloud platforms (AWS, EMR, Kubernetes, Docker) and ML platforms (Databricks, SageMaker). Familiarity with workflow management tools (e.g., Airflow). Strong understanding of software design principles, data structures ...