1 to 25 of 34 Amazon EMR Jobs

Data Engineer (AWS) - Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader … Nathan Warner at Noir Consulting. (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

Experience working within Azure environments. Strong SQL skills and understanding of modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab ...

notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena, and related services. Implement lakehouse architecture using Databricks, Delta Lake, and AWS S3. Build data ingestion pipelines from ...

notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena, and related services. Implement lakehouse architecture using Databricks, Delta Lake, and AWS S3. Build data ingestion pipelines from ...

notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena, and related services. Implement lakehouse architecture using Databricks, Delta Lake, and AWS S3. Build data ingestion pipelines from ...

notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena, and related services. Implement lakehouse architecture using Databricks, Delta Lake, and AWS S3. Build data ingestion pipelines from ...

GitLab , and CI/CD pipelines. Understanding of AWS security best practices, IAM, and RBAC. Desirable Skills Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR . Knowledge of Terraform or CloudFormation . Experience in consultancy or client-facing environments. Personal Attributes Strong problem-solving and troubleshooting skills. Excellent communication ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

data analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

data analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

expertise with Infrastructure as Code (Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements ...

experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data technologies including Glue, EMR, Lambda, DynamoDB, S3, EventBridge, Step Functions and related services Proven experience building Data Lakehouse platforms, Data Products and ELT/ETL frameworks supporting analytics ...

experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data technologies including Glue, EMR, Lambda, DynamoDB, S3, EventBridge, Step Functions and related services Proven experience building Data Lakehouse platforms, Data Products and ELT/ETL frameworks supporting analytics ...

Remote (occasional expensed travel to Leeds/Newcastle) Clearance: Active SC Clearance required Rate: Up to £425/day (Inside IR35) Tech Stack: AWS (EMR, S3, Lambda), PySpark, Python, SQL, CI/CD Focus: Building scalable pipelines, modernising ETL, supporting MI/Power BI Level: Mid to Senior - mentoring ...

functional teams to deliver end-to-end solutions Key Skills & Experience: Strong expertise in AWS cloud services, including: CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing … Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/or Amazon Athena for data querying and validation Strong understanding of EMR and log analysis Experience with GitLab for CI/CD pipelines, release tagging, and version control Knowledge of Docker and containerisation Understanding of encryption ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache NiFi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain-driven design approaches and architecture Linux awareness and Scripting skills Postgres/PL/SQL knowledge Key Strengths: Self ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache NiFi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain-driven design approaches and architecture Linux awareness and Scripting skills Postgres/PL/SQL knowledge Key Strengths: Self ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache Nifi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain driven design approaches and architecture Linux awareness and Scripting skills Postgress/PLSQL knowledge Key Strengths: Self starter ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache Nifi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain driven design approaches and architecture Linux awareness and Scripting skills Postgress/PLSQL knowledge Key Strengths: Self starter ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

Job Description AWS Data Engineer (Active SC) Full time/perm Our client is seeking Security Cleared AWS Data Engineers at all levels to design, build, and support scalable cloud-based data solutions. You will ...