25 of 25 Amazon EMR Jobs

years of experience in data engineering or data platform development within enterprise environments Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing and curating structured and unstructured datasets. Experience with API ingestion, data modelling and optimisation ...

data systems and supporting modern data platforms. Key Requirements: Strong experience in Python and Apache Spark (PySpark) Hands-on with AWS services (S3, Glue, EMR, Redshift, Lambda, Athena) Proficiency in SQL and working with relational & NoSQL databases Knowledge of ETL, data modeling, and data warehousing Experience with ...

event, and data exchange patterns for cross-system interactions. Cloud & Infrastructure Design cloud-native solutions leveraging AWS services such as S3, IAM, Lambda, EMR, Glue, ECS/EKS, Step Functions, CloudWatch, and networking components. Ensure platform scalability, reliability, observability, and high availability. Oversee IAM policies, security controls, and data ...

provide feedback to improve team quality Support production systems and troubleshoot issues Write clean, tested, and maintainable code Tech Stack Python & SQL AWS (EMR, Athena, Lambda) Apache Spark (Scala or PySpark) Big data/distributed processing tools What They’re Looking For Strong experience as a Data Engineer using ...

/CD deployment pipelines such as GitLab CI and Concourse Terraform Big data tooling such as Hadoop, Hive, Spark and ideally Amazon EMR or equivalent Strong Linux experience Kubernetes/EKS or other container services would also be helpful (but as Chris said not a deal breaker … skills AWS -services such as VPC, EC2, EBS, Route 53, AWS WAF, AWS ALB, ELB, Network ACLS, Security Groups, AWS KMS, S3, IAM, Lambda, EMR, Atena, Redshift and any other relevant services from AWS. Network, connectivity and Kong GitHub, Gitlab CI, Terraform, Python, Tenable, Vault Databases such as EMR ...

physical) for data lakes, data warehouses, and analytical platforms • Architect and optimize AWS data services, including: o Amazon S3, Redshift, Athena, Glue, EMR, RDS, DynamoDB o Kinesis, MSK, Lambda, Step Functions • Design data ingestion pipelines from structured and unstructured sources • Establish data governance, security, and compliance standards ...

knowledge of secrets management (AWS Secrets Manager, Parameter Store) and cross-account IAM patterns. Understanding of cost optimization levers for AWS data services (Glue, EMR, Kinesis, S3). Familiarity with monitoring tools: CloudWatch, Grafana, and alerting configuration. Scripting proficiency in Bash, Python, or similar. Experience working in regulated ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

working on Microservices. Good experience on AWS Cloud, MSK, Kinesis, Lamda Good hands-on experience on AWS Glue using Apache Spark, Amazon EMR Good experience on container orchestration system like Kubernetes, ECS Good working knowledge in SPRING Framework & Spring Boot Good experience in Kafka and other messaging ...

based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

design, scheduling, sensors, retries, XComs, task isolation, best practices) Strong across broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets Manager, Athena, EMR (nice to have), Redshift (nice to have) Proven experience delivering multiple end-to-end programs (architecture build test deploy operate) with measurable outcomes (SLAs … statements, success criteria, and measurable outcomes. Languages: Python (PySpark), SQL AWS: Glue, MWAA (Airflow), S3, IAM, KMS, CloudWatch, Lambda, Step Functions, Athena, Redshift (nice), EMR (nice) DevOps: Git, CI/CD (CodePipeline/GitHub Actions), Terraform/CloudFormation, Docker Data Quality/Observability: Great Expectations/Deequ (nice), OpenLineage ...

design, scheduling, sensors, retries, XComs, task isolation, best practices) Strong across broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets Manager, Athena, EMR (nice to have), Redshift (nice to have) Proven experience delivering multiple end-to-end programs (architecture build test deploy operate) with measurable outcomes (SLAs … statements, success criteria, and measurable outcomes. Languages: Python (PySpark), SQL AWS: Glue, MWAA (Airflow), S3, IAM, KMS, CloudWatch, Lambda, Step Functions, Athena, Redshift (nice), EMR (nice) DevOps: Git, CI/CD (CodePipeline/GitHub Actions), Terraform/CloudFormation, Docker Data Quality/Observability: Great Expectations/Deequ (nice), OpenLineage ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...

pipelines and data ingestion workflows using Python and Spark (PySpark). Develop and manage data solutions using AWS services such as S3, Glue, EMR, Redshift, Lambda, and Athena. Implement efficient data modeling, schema design, and partitioning strategies for data lakes and warehouses. Optimize Spark jobs for performance, scalability … including Pandas and PySpark). Hands-on experience with Apache Spark/PySpark for distributed data processing. Proficiency with AWS data services S3, Glue, EMR, Lambda, Redshift, and Athena. Strong SQL skills and understanding of data modeling and schema design. Experience with workflow orchestration tools such as Airflow ...

individual one or part of a team) Architect and optimize ETL/ELT pipelines using services such as: DBT, AWS Glue, Lambda, Kinesis, S3, EMR Design high performance Snowflake data models (3NF, dimensional, Data Vault, etc.) Optimize query performance, clustering, micro-partitioning, and resource consumption Work closely with Data … expertise with Snowflake (architecture, performance tuning, security, Snowpipe, streams/tasks) Strong experience with AWS cloud data ecosystem, ideally including: S3, Glue, Lambda, Redshift, EMR, Kinesis, IAM, CloudWatch Strong SQL skills and proficiency in Python, DBT Understanding of data governance frameworks (e.g., Collibra, Alation is a plus) Hands ...

Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python code using SAS2PY and manual refactoring. Performance Tuning: Optimise Spark … unit testing, and data reconciliation frameworks to ensure "penny-perfect" accuracy. Technical Stack Engine: PySpark (Expert), Python (Clean Code/SOLID principles). AWS: EMR, Glue, S3, Athena, IAM, Lambda. Data Modeling: SCD Type 2, Fact/Dimension tables, Data Vault/Star Schema. Legacy: Proficiency in reading/ ...

Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python code using SAS2PY and manual refactoring. Performance Tuning: Optimise Spark … unit testing, and data reconciliation frameworks to ensure "penny-perfect" accuracy. Technical Stack Engine: PySpark (Expert), Python (Clean Code/SOLID principles). AWS: EMR, Glue, S3, Athena, IAM, Lambda. Data Modeling: SCD Type 2, Fact/Dimension tables, Data Vault/Star Schema. Legacy: Proficiency in reading/ ...

Proficiency in Git-based development workflows Experience working independently and communicating effectively in distributed teams Desirable : Familiarity with (or happy to learn): Apache Spark (EMR) and Delta Lake PostgreSQL (Aurora) CI/CD (Github Actions) and IaC (Helm, CloudFormation) Monitoring (Sentry) Knowledge/interest in research or academic writings … better way for us to communicate, please do let us know. Developer, Programmer, Engineer, Full Stack, FullStack, Full-Stack, Python, AWS, Amazon Web Services, EKS, Elastic Kubernetes Service, Flask, React, TypeScript, Type Script, Type-Script, Remote, Hybrid, London Circle Recruitment is acting as an Employment Agency in relation ...