1 to 25 of 31 Amazon EMR Jobs

years of experience in data engineering or data platform development within enterprise environments Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building ...

performance, security and long-term maintainability. Key experience required: • Active SC Clearance • Deep expertise across AWS data services such as Glue, Lambda, S3, Redshift, EMR, Athena and Step Functions • Strong Python and SQL development capability • Proven experience designing and building ETL or ELT pipelines in cloud environments • Experience working ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

event, and data exchange patterns for cross-system interactions. Cloud & Infrastructure Design cloud-native solutions leveraging AWS services such as S3, IAM, Lambda, EMR, Glue, ECS/EKS, Step Functions, CloudWatch, and networking components. Ensure platform scalability, reliability, observability, and high availability. Oversee IAM policies, security controls, and data ...

technical decisions clearly. Exposure to CI/CD pipelines for data engineering workloads. AWS & Platform Skills Strong understanding of core AWS services, including: S3, EMR/Glue, Workflows, Athena, IAM Experience building and operating data pipelines on AWS. Big data processing on cloud platforms. Desirable Skills Experience in banking ...

Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing and curating structured and unstructured datasets. Experience with API ingestion, data modelling and optimisation ...

diverse projects with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing ...

diverse projects with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

with engineers and stakeholders to deliver reliable, high-quality data solutions Essential skills PySpark: strong hands-on experience building production-grade Spark solutions AWS : EMR, Glue, S3, Athena (and related services) Experience using automated migration tools for large-scale code or data modernisation Strong SQL and data engineering fundamentals ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

/Cloud Operations/IT Operations roles. Strong Linux (RHEL) administration . Hands-on AWS experience: EC2, VPC, ELB, RDS, ECS, EFS, EMR, S3, IAM, Lambda, CloudTrail, Config, EBS. Automation with Ansible, Bash, Python, or PowerShell . Monitoring tools experience ( Datadog preferred ). Good understanding of ITIL processes . ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

experience required: Strong Python development, particularly for data ingestion, crawling, parsing, and transformation. Extensive experience working with SQL and analytical databases, ideally including Amazon Redshift or similar time-series platforms. Experience building production data pipelines in AWS cloud environments. Familiarity with Docker containers and CI/CD pipelines. … financial markets. Experience supporting real-time or near-real-time analytics environments. Knowledge of additional AWS services such as S3, Lambda, Athena, Kinesis, EMR, Fargate, or API Gateway. Experience with big data technologies including Spark, Databricks, Hadoop, or Dask. Familiarity with data visualisation tooling such as Plotly. Experience mentoring ...

Model: 3 days on site per week in Watford What You'll Do: Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services. Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases. … cloud services and tools to improve deployment speed, operational efficiency, and developer experience. Required Skills: Extensive experience with AWS cloud services (Redshift, S3, Lambda, EMR, CloudFormation/Terraform). Proficiency in CI/CD tools such as Jenkins, GitHub Actions, or similar. Strong scripting skills in Python for automation ...

Requirements PySpark (P3): 5+ years of hands-on experience writing scalable, production-grade PySpark/Spark SQL. AWS Data Stack (P3): Strong proficiency in EMR, Glue, S3, Athena, and Glue Workflows. SAS Knowledge (P1): Solid foundation in SAS to enable the understanding and debugging of legacy logic for conversion. ...

hands-on experience. Deep knowledge of Spark optimization (partitioning, tuning) and Data Warehousing (SCDs, Facts/Dimensions). AWS (Expert): Strong proficiency in S3, EMR, Glue, Athena, and IAM. Experience with Git-based CI/CD. SAS (Working Knowledge): Ability to read and debug Base SAS/Macros ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...