17 of 17 Amazon EMR Jobs in the UK

Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing frameworks ...

data sources. Document test results and provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data ...

experience in data engineering or a similar role. • Hands-on experience with core AWS data services (for example S3, Glue, Athena, Lambda, IAM, EMR). • Strong SQL skills (joins, window functions, optimization). • Solid Python for data processing. • Experience building production ETL/ELT pipelines. • Working knowledge of security ...

frameworks. Key Responsibilities Design and develop scalable, testable data pipelines utilizing Python and Apache Spark. Orchestrate data workflows using AWS services including Glue, EMR Serverless, Lambda, and S3. Apply industry-standard software engineering practices such as version control, CI/CD, modular design, and automated testing. Contribute ...

have: experience with ThoughtSpot, automotive or adjacent domains Tech Stack (experience We Value) Heavily AWS‐based (e.g., S3, Lake Formation, Glue, Athena/Redshift, EMR, Kinesis); transformation and modelling (SQL, dbt, Spark); orchestration (Airflow/Dagster/Prefect); languages (Python/SQL); CI/CD & IaC (GitHub/GitLab ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

/BSS workflows. Key Responsibilities 1. Data Engineering & ETL Development Design, develop, and maintain ETL/ELT pipelines using AWS-native services (Glue, Lambda, EMR, Step Functions). Implement data ingestion from telecom systems like OSS/BSS, CDRs, mediation systems, CRM, billing, network logs . Optimize ETL workflows … Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high performance for petabyte-scale telecom datasets (CDRs, tower logs, subscriber activity). 4. Querying & Analytics (Athena) Develop and optimize Athena ...

configuration management with Ansible, and container orchestration via Kubernetes (EKS) and Docker. Experience writing AWS Lambda functions in Python or Node.js, familiarity with ElasticMapReduce (EMR) and/or Spark for data processing would be a bonus. Contribute to the delivery of data ingestion pipelines and platform services supporting ...

Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees, Random Forest, Gradient Boosted Trees, XGBoost - Unsupervised ...

Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees, Random Forest, Gradient Boosted Trees, XGBoost Unsupervised ...

improvements and efficiencies. Driving continuous improvement across pipelines, tooling, automation, and release processes. Main Skills Needed: Strong hands-on AWS experience across Redshift, S3, EMR, Lambda and infrastructure-as-code. Demonstrated ability to align with DevOps while maintaining distinct responsibilities within the BI function. Proficient with CI/… tooling such as Jenkins or GitHub Actions. Advanced Python scripting and solid SQL capability. Experience with large-scale data processing (Spark/EMR) and data warehousing concepts. Knowledge of Docker/Kubernetes and containerised deployment workflows. Familiarity with Jira integrations, release management, and environment refresh processes. Skilled in optimising ...

improvements and efficiencies. Driving continuous improvement across pipelines, tooling, automation, and release processes. Main Skills Needed: Strong hands-on AWS experience across Redshift, S3, EMR, Lambda and infrastructure-as-code. Demonstrated ability to align with DevOps while maintaining distinct responsibilities within the BI function. Proficient with CI/… tooling such as Jenkins or GitHub Actions. Advanced Python scripting and solid SQL capability. Experience with large-scale data processing (Spark/EMR) and data warehousing concepts. Knowledge of Docker/Kubernetes and containerised deployment workflows. Familiarity with Jira integrations, release management, and environment refresh processes. Skilled in optimising ...

improvements and efficiencies. Driving continuous improvement across pipelines, tooling, automation, and release processes. Main Skills Needed: Strong hands-on AWS experience across Redshift, S3, EMR, Lambda and infrastructure-as-code. Demonstrated ability to align with DevOps while maintaining distinct responsibilities within the BI function. Proficient with CI/… tooling such as Jenkins or GitHub Actions. Advanced Python scripting and solid SQL capability. Experience with large-scale data processing (Spark/EMR) and data warehousing concepts. Knowledge of Docker/Kubernetes and containerised deployment workflows. Familiarity with Jira integrations, release management, and environment refresh processes. Skilled in optimising ...

Data Engineer (Hybrid) Bristol – Spark, S3, Redshift, Lambda, EMR, Glue Avanti Recruitment is working with a rapidly growing technology business in Bristol to recruit a talented AWS Data Engineer to join their team. You will help build and evolve their AWS cloud-based data infrastructure. You’ll work with … workflows using Apache Spark, Python and AWS Glue, while architecting solutions that make extensive use of AWS services including S3, Redshift, EMR, Lambda, Kinesis, DynamoDB, IAM, CloudWatch and Step Functions. You’ll ensure data quality, troubleshoot pipeline issues and continuously look for ways to improve performance and reliability. ...

Your role will involve: Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 Applying modern software engineering practices: version control, CI/CD, modular design, and automated testing Contributing to the development … with or is eager to learn Apache Spark for large-scale data processing Is familiar with the AWS data stack (e.g. S3, Glue, Lambda, EMR) Enjoys learning the business context and working closely with stakeholders Works well in Agile teams and values collaboration over solo heroics Nice-to-haves ...