22 of 22 Amazon EMR Jobs

Data Engineer: Design, build and maintain scalable data pipelines and architectures within the AWS ecosystem Leverage services such as AWS Glue, Lambda, Redshift, EMR and S3 to support data ingestion, transformation and storage Work closely with data analysts, architects and business stakeholders to translate requirements into robust technical solutions ...

experience with Databricks and Apache Spark • Proficiency in Python (required); SQL (advanced) • Hands-on experience with AWS or Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

technical decisions clearly. Exposure to CI/CD pipelines for data engineering workloads. AWS & Platform Skills Strong understanding of core AWS services, including: S3, EMR/Glue, Workflows, Athena, IAM Experience building and operating data pipelines on AWS. Big data processing on cloud platforms. Desirable Skills Experience in banking ...

/Experience Advanced knowledge of data engineering principles, including data warehousing and data lakes . Proficiency in AWS cloud services (e.g., S3, Redshift, Glue, EMR, Lambda) for data storage, processing, and orchestration. Exposure to machine learning pipelines and integration with data engineering workflows. ...

ideally on AWS using IaC You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analytics You have experience of designing and operating data ingestion pipelines at scale (batch ...

/BSS workflows. Key Responsibilities 1. Data Engineering & ETL Development Design, develop, and maintain ETL/ELT pipelines using AWS-native services (Glue, Lambda, EMR, Step Functions). Implement data ingestion from telecom systems like OSS/BSS, CDRs, mediation systems, CRM, billing, network logs . Optimize ETL workflows … Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high performance for petabyte-scale telecom datasets (CDRs, tower logs, subscriber activity). 4. Querying & Analytics (Athena) Develop and optimize Athena ...

deliver reliable, high-quality data solutions Essential skills PySpark - P3 (Advanced) : strong hands-on experience building production-grade Spark solutions AWS - P3 (Advanced) : EMR, Glue, S3, Athena (and related services) Experience using automated migration tools for large-scale code or data modernisation Strong SQL and data engineering fundamentals Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

Requirements PySpark (P3): 5+ years of hands-on experience writing scalable, production-grade PySpark/Spark SQL. AWS Data Stack (P3): Strong proficiency in EMR, Glue, S3, Athena, and Glue Workflows. SAS Knowledge (P1): Solid foundation in SAS to enable the understanding and debugging of legacy logic for conversion. ...

ideally on AWS using IaC You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analytics You have experience of designing and operating data ingestion pipelines at scale (batch ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

Requirements PySpark (P3): 5+ years of hands-on experience writing scalable, production-grade PySpark/Spark SQL. AWS Data Stack (P3): Strong proficiency in EMR, Glue, S3, Athena, and Glue Workflows. SAS Knowledge (P1): Solid foundation in SAS to enable the understanding and debugging of legacy logic for conversion. ...

hands-on experience. Deep knowledge of Spark optimization (partitioning, tuning) and Data Warehousing (SCDs, Facts/Dimensions). AWS (Expert): Strong proficiency in S3, EMR, Glue, Athena, and IAM. Experience with Git-based CI/CD. SAS (Working Knowledge): Ability to read and debug Base SAS/Macros ...

Champion deployment best practices aligned with regulatory, quality, and compliance standards Architecture & Technical Leadership Design and oversee enterprise healthcare IT architectures integrating PACS, RIS, EMR, AI solutions, and cloud-native services Lead implementation of HL7 v2 and DICOM workflows, with future expansion to FHIR standards Share deployment learnings with ...

full end to end continuous deployment pipeline. Major elements of our platform include AWS (we make significant use of S3, RDS, Kinesis, EC2, EMR, ElastiCache, ElasticSearch and EKS). Elements of the platform will start to expand into GCP (Compute Engine, Cloud Storage, Google Kubernetes Engine and BigQuery). ...

testing methodologies, and experiment design. Solid background in ranking, recommendation, and retrieval systems. Familiarity with large-scale data tools (Hadoop, BigQuery, Amazon EMR, etc.). Experience with BI tools and visualization platforms such as Tableau, Qlik, or MicroStrategy. Bonus: Experience with geospatial data and advanced analytics platforms. ...

required) Proven experience as a Tech Lead or Lead Data Engineer across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced … clearly communicate technical trade-offs Experience working in Agile delivery environments Nice to Have: Experience with AWS Lake Formation, Lambda, Step Functions, Athena, EMR, DataBrew Familiarity with data quality, lineage, or observability tooling Knowledge of GDS ways of working and public sector delivery frameworks Experience with privacy-by-design ...

with Terraform , GitHub Actions , and Spark/PySpark is essential. Key Responsibilities: Architect end to end AWS data platforms (S3, Lake Formation, Glue, Athena, EMR/Spark). Design multi account data governance, security, and access models. Develop scalable ETL/ELT pipelines using Python & PySpark . Implement … GitHub Actions CI/CD implementation skills. Experience with multi-account AWS architectures and governance. Nice-to-Have: Iceberg/Delta/Hudi, DMS, EMR tuning. Data quality & lineage tools (Datahub). Exposure to regulated industries (Banking/Finance). ...

Build and optimise ETL pipelines and data flows across Snowflake, Oracle, and distributed systems Process large datasets using Spark (Java or Scala) on AWS EMR Develop data-driven services and components using Java and/or Python Contribute to microservices-based architectures Deploy and support cloud-native solutions using … Oracle Solid engineering background in Java and/or Python Hands-on experience with Apache Spark (Java or Scala) Experience with AWS , including EMR and other core services Exposure to Docker and Kubernetes (EKS) Proven experience building scalable ETL pipelines and data processing solutions Familiarity with CI/ ...

with Terraform , GitHub Actions , and Spark/PySpark is essential. Key Responsibilities: Architect end to end AWS data platforms (S3, Lake Formation, Glue, Athena, EMR/Spark). Design multi account data governance, security, and access models. Develop scalable ETL/ELT pipelines using Python & PySpark . Implement … GitHub Actions CI/CD implementation skills. Experience with multi-account AWS architectures and governance. Nice-to-Have: Iceberg/Delta/Hudi, DMS, EMR tuning. Data quality & lineage tools (Datahub). xohmjla ...