20 of 20 Amazon EMR Jobs

Data Engineer: Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem Leverage services such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions ...

Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing frameworks ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

maintaining complex data pipelines and platforms. Technical Expertise: Languages: Strong proficiency in Python and SQL. Cloud Platform: Hands-on experience with AWS services (EMR, Athena, Lambda, S3, Glue, Step Functions). Data Warehousing: In-depth experience with Snowflake. Big Data Processing: Experience with Spark and familiarity with Scala (even ...

data sources. Document test results and provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data ...

experience in data engineering or a similar role. • Hands-on experience with core AWS data services (for example S3, Glue, Athena, Lambda, IAM, EMR). • Strong SQL skills (joins, window functions, optimization). • Solid Python for data processing. • Experience building production ETL/ELT pipelines. • Working knowledge of security ...

implementations. Strong experience with SQL, python and Pyspark Good understanding of Data ingestion and data processing frameworks Good experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture) Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as?appropriate. Should be able ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

data systems. Proficiency in Python, Java, or Scala - comfortable writing robust, testable, and scalable code. Deep experience with AWS (Lambda, ECS/EKS, EMR, Step Functions, S3, IAM, etc.). Strong knowledge of distributed systems and streaming/data pipelines (Kafka, Spark, Delta, Airflow, etc.). Familiarity with infrastructure ...

/BSS workflows. Key Responsibilities 1. Data Engineering & ETL Development Design, develop, and maintain ETL/ELT pipelines using AWS-native services (Glue, Lambda, EMR, Step Functions). Implement data ingestion from telecom systems like OSS/BSS, CDRs, mediation systems, CRM, billing, network logs . Optimize ETL workflows … Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high performance for petabyte-scale telecom datasets (CDRs, tower logs, subscriber activity). 4. Querying & Analytics (Athena) Develop and optimize Athena ...

automate cloud infrastructure using Terraform and/orAWS CDK. Design, build, and operationalize data and ML pipelines using AWS Glue, Step Functions, Lambda, EMR, and SageMaker. Write robust AWS Glue ETL jobs (Python/PySpark) with exception handling, logging, and CloudWatch monitoring. Implement monitoring and dashboards in CloudWatch ...

ability to collaborate across business and technology teams. Key Responsibilities Design, develop, and maintain ETL/ELT data pipelines using AWS services (Glue, EMR, Redshift, S3, Athena, Lambda, Step Functions Develop and optimize large-scale data processing workflows using Python and PySpark. Collaborate with business stakeholders to translate data … planning and backlog grooming. Required Qualifications 10+ years of professional experience as a Data Engineer. Strong hands-on expertise in AWS Data Services: Glue, EMR, Redshift, Athena, S3, Lambda, Step Functions, CloudWatch. Proficiency in Python and PySpark for ETL, transformation, and automation. Strong experience in SQL and data modeling ...

About Reward Founded in 2001, Reward is an industry leader transforming the world of customer engagement and commerce media. Operating in 15 countries across Europe, Middle East and Asia, Reward's cloud-based API platform ...

ability to collaborate across business and technology teams. Key Responsibilities Design, develop, and maintain ETL/ELT data pipelines using AWS services (Glue, EMR, Redshift, S3, Athena, Lambda, Step Functions Develop and optimize large-scale data processing workflows using Python andPySpark. Collaborate with business stakeholders to translate data requirements … planning and backlog grooming. Required Qualifications 10+ years of professional experience as a Data Engineer. Strong hands-on expertise in AWS Data Services: Glue, EMR, Redshift, Athena, S3, Lambda, Step Functions, CloudWatch. Proficiency in Python and PySpark for ETL, transformation, and automation. Strong experience in SQL and data modeling ...

Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees, Random Forest, Gradient Boosted Trees, XGBoost Unsupervised ...

responsibilities:AWS data engineers are responsible for designing and building data pipelines and developing ETL/ELT processes using tools such as AWS Glue, EMR, and Redshift to prepare data for analytics. They integrate data from various sources and create and maintain data models efficient for storage and analysis. … Snowflake is an added advantage.Experience with ETL/ELT process and frameworks is a must.Strong background in AWS cloud services like lambda, glue, s3, emr, sns, sqs, cloudwatch, redshiftExpertise in SQL and experience with relational databases like Oracle, MySql, PostgreSQLProficient in Python programming for data engineering tasks, automationsExperience with ...

Data Engineer (Hybrid) Bristol – Spark, S3, Redshift, Lambda, EMR, Glue Avanti Recruitment is working with a rapidly growing technology business in Bristol to recruit a talented AWS Data Engineer to join their team. You will help build and evolve their AWS cloud-based data infrastructure. You’ll work with … workflows using Apache Spark, Python and AWS Glue, while architecting solutions that make extensive use of AWS services including S3, Redshift, EMR, Lambda, Kinesis, DynamoDB, IAM, CloudWatch and Step Functions. You’ll ensure data quality, troubleshoot pipeline issues and continuously look for ways to improve performance and reliability. ...