1 to 25 of 30 Amazon EMR Jobs

years of experience in data engineering or data platform development within enterprise environments Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building ...

performance, security and long-term maintainability. Key experience required: • Active SC Clearance • Deep expertise across AWS data services such as Glue, Lambda, S3, Redshift, EMR, Athena and Step Functions • Strong Python and SQL development capability • Proven experience designing and building ETL or ELT pipelines in cloud environments • Experience working ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

technical decisions clearly. Exposure to CI/CD pipelines for data engineering workloads. AWS & Platform Skills Strong understanding of core AWS services, including: S3, EMR/Glue, Workflows, Athena, IAM Experience building and operating data pipelines on AWS. Big data processing on cloud platforms. Desirable Skills Experience in banking ...

Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing and curating structured and unstructured datasets. Experience with API ingestion, data modelling and optimisation ...

event, and data exchange patterns for cross-system interactions. Cloud & Infrastructure Design cloud-native solutions leveraging AWS services such as S3, IAM, Lambda, EMR, Glue, ECS/EKS, Step Functions, CloudWatch, and networking components. Ensure platform scalability, reliability, observability, and high availability. Oversee IAM policies, security controls, and data ...

diverse projects with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing ...

diverse projects with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

Model: 3 days on site per week in Watford What You'll Do: Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services. Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases. … cloud services and tools to improve deployment speed, operational efficiency, and developer experience. Required Skills: Extensive experience with AWS cloud services (Redshift, S3, Lambda, EMR, CloudFormation/Terraform). Proficiency in CI/CD tools such as Jenkins, GitHub Actions, or similar. Strong scripting skills in Python for automation ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

experience required: Strong Python development, particularly for data ingestion, crawling, parsing, and transformation. Extensive experience working with SQL and analytical databases, ideally including Amazon Redshift or similar time-series platforms. Experience building production data pipelines in AWS cloud environments. Familiarity with Docker containers and CI/CD pipelines. … financial markets. Experience supporting real-time or near-real-time analytics environments. Knowledge of additional AWS services such as S3, Lambda, Athena, Kinesis, EMR, Fargate, or API Gateway. Experience with big data technologies including Spark, Databricks, Hadoop, or Dask. Familiarity with data visualisation tooling such as Plotly. Experience mentoring ...

based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

design, scheduling, sensors, retries, XComs, task isolation, best practices) Strong across broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets Manager, Athena, EMR (nice to have), Redshift (nice to have) Proven experience delivering multiple end-to-end programs (architecture build test deploy operate) with measurable outcomes (SLAs … statements, success criteria, and measurable outcomes. Languages: Python (PySpark), SQL AWS: Glue, MWAA (Airflow), S3, IAM, KMS, CloudWatch, Lambda, Step Functions, Athena, Redshift (nice), EMR (nice) DevOps: Git, CI/CD (CodePipeline/GitHub Actions), Terraform/CloudFormation, Docker Data Quality/Observability: Great Expectations/Deequ (nice), OpenLineage ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...