1 to 25 of 272 Amazon EMR Jobs

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

Experience working within Azure environments. Strong SQL skills and understanding of modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab ...

/Hybrid Duration: 5 months Essential Skills: Informatica Data project experience AWS Azure Desirable Skills: Hands-on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large-scale batch processing. Data engineering at scale in government or similarly complex domains, including ...

Java a plus). Proven experience with Apache Spark (PySpark) for large-scale processing. Hands-on experience with AWS Glue, S3, Redshift, Athena, EMR, Lake Formation. Strong debugging and performance optimization skills in distributed systems. Hands-on experience with Iceberg, Delta Lake, or other OTF table formats. Experience with ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

technologies, S3, Athena, Redshift Experience in snowflake is an added bonus. Familiarity with the following technologies: Hadoop, Kafka, Airflow, Hive, Presto, Athena, S3, Aurora, EMR, Spark Ability to drive, contribute to, and communicate solutions to technical product challenges Ability to roll-up your sleeves and work in process ...

Code Reviews QA/Testing methodologies Strong experience (At least 3+, prefers 6+ years) with the following technologies and platforms: AWS platform: S3, EC2, EMR, EKS, Glue, Lambda, AppFlow, Cloudwatch etc. AWS certification is big plus Snowflake Data Cloud Account Administration Virtual warehouse strategies Snowflake feature implementation: Data Sharing ...

extraction solutions using RESTful APIs and modern integration techniques * Work extensively with AWS-native data and analytics services including Glue, Athena, DataBrew, Lake Formation, EMR, MSK and Kinesis * Implement data quality, profiling and validation processes to ensure integrity, accuracy and completeness of datasets * Contribute within an Agile delivery environment ...

Spark, Kafka, etc. Relational SQL and NoSQL databases and experience working with relational databases AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena Data Platforms: Databricks Data streaming systems: Batch,Kafka, Storm, Spark-Streaming, etc. Languages: Python, R, Scala, Go Ability ...

Develop lakehouse/data warehousing solutions Improve data quality, performance & scalability Partner with Data Science & Analytics teams Tech stack: AWS (Glue, Lambda, S3, Redshift, EMR) Python, SQL, PySpark Modern ETL/orchestration tools What we’re looking for: Strong AWS data engineering experience Solid Python & SQL skills Experience with ...

focus on Databricks. Proficiency in Databricks, including the ability to build and optimize Spark applications. Extensive experience with AWS services such as S3, Redshift, EMR, Lambda, Glue, and others. Strong knowledge of Unity Catalog and its application in managing and securing data assets. Strong knowledge of data modeling ...

Enterprise Data Architect within complex environments Strong expertise across the AWS data ecosystem , including: S3, Redshift, Glue, Lambda Kinesis/streaming architectures Athena, EMR Experience delivering cloud-native data platforms at enterprise scale Strong background within Banking/Financial Services (essential) Experience working in a consultancy or client-facing ...

hands-on Snowflake experience Solid understanding of modern cloud data architectures and Lakehouse concepts Familiarity with AWS services including S3, Glue, Athena, RDS, and EMR Confident communicator able to work with both technical and non-technical stakeholders Reference Number: BBBH(phone number removed) Rise Technical Recruitment Ltd acts ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...

Server PostgreSQL migration efforts, including schema translation, performance tuning, and data validation Implement and maintain Terraform infrastructure for AWS services (S3, Glue, Lambda, EMR, Redshift, DMS, etc.) Conduct performance and cost optimization reviews of AWS workloads, recommending and implementing improvements Develop frameworks for data quality, monitoring, and reconciliation Collaborate … scale data processing Strong SQL development experience, including query tuning and ETL/ELT design Hands-on experience with AWS data services (S3, Glue, EMR, Lambda, DDB, DMS, CloudWatch, IAM, VPC) Experience with Terraform/Terragrunt (or equivalent IaC) for AWS infrastructure automation Familiarity with SQL Server and PostgreSQL ...