1 to 25 of 181 Remote Amazon EMR Jobs

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

/Hybrid Duration: 5 months Essential Skills: Informatica Data project experience AWS Azure Desirable Skills: Hands-on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large-scale batch processing. Data engineering at scale in government or similarly complex domains, including ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

extraction solutions using RESTful APIs and modern integration techniques * Work extensively with AWS-native data and analytics services including Glue, Athena, DataBrew, Lake Formation, EMR, MSK and Kinesis * Implement data quality, profiling and validation processes to ensure integrity, accuracy and completeness of datasets * Contribute within an Agile delivery environment ...

Enterprise Data Architect within complex environments Strong expertise across the AWS data ecosystem , including: S3, Redshift, Glue, Lambda Kinesis/streaming architectures Athena, EMR Experience delivering cloud-native data platforms at enterprise scale Strong background within Banking/Financial Services (essential) Experience working in a consultancy or client-facing ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...