19 of 19 Amazon EMR Jobs

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

DevOps, CI/CD and software testing. • Expertise with one of programming languages such as SQL, or Python. • Have working experience of AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services. • Experience with Data platform tools like Databricks and/or Snowflake. • Be able ...

manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best … practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark ...

building and supporting ETL/ELT frameworks. Strong understanding of data warehousing concepts and dimensional modelling. AWS experience, including services such as S3, Glue, EMR, or PySpark . Knowledge of data governance, quality controls, and testing practices. Experience working within large-scale enterprise environments. Desirable Knowledge of Iceberg ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

data modelling experience. Strong understanding of ETL/ELT architecture and data integration frameworks. AWS experience including services such as S3, Glue, EMR, and PySpark .Experience defining data standards, governance frameworks, and architectural roadmaps. Desirable Experience with Iceberg and modern lakehouse architectures. Exposure to AI-enabled data platforms ...

data modelling experience. Strong understanding of ETL/ELT architecture and data integration frameworks. AWS experience including services such as S3, Glue, EMR, and PySpark . Experience defining data standards, governance frameworks, and architectural roadmaps. Desirable Experience with Iceberg and modern lakehouse architectures. Exposure to AI-enabled data platforms ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon's products and services. We offer talented security professionals the chance to accelerate their careers with … development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations- Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Experience developing, deploying and managing AI products at scaleAmazon is an equal opportunities employer. We believe passionately that employing ...

Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi) and Serverless data concepts. Familiarity with mainstream global cloud products such as AWS EMR/Redshift, Google BigQuery, Snowflake, and Databricks., Ability to perform competitive analysis and develop differentiation strategies. Soft Skills: Excellent logical thinking, communication skills ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS's analytics portfolio including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch. You'll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges whether migrating from legacy … leadership, workshops, and reference architectures. Key job responsibilitiesArchitect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch)Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud-native analytics, including ETL refactoring ...

software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics).- Experience with data infrastructures: relational analytic DBMS, Elastic-Search, and Big Data EMR/EC2/Glue/Lambda, or experience with training and deploying machine learning systems to solve large-scale optimizations- Experience communicating across technical … Database, and/or Storage- PhD in computer science, machine learning, engineering, or related fields, or experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Knowledge of general AI tools- Knowledge of data engineering pipelines, cloud solutions, ETL management, databases, visualizations and analytical platforms- Experience ...

career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.Why AWS Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that … Experience communicating across technical and non-technical audiences, including executive level stakeholders or clientsPreferred qualification - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience with one or more analytics visualization tools (e.g., Excel, Tableau, QuickSight, MicroStrategy, PowerBI)- Experience implementing ...

deep passion and desire to engineer and operate the world's largest cloud computing infrastructure to provide a better world for future generations Amazon Web Services (AWS) builds and operates some of the largest internet infrastructure on the planet; providing companies of all sizes with an infrastructure … team helps to support and operate some of the largest distributed database and analytics services in the world. From DynamoDB to OpenSearch, Glue and EMR, the DBS team manage many of the most heavily used services in AWS. If you join us, you'll be part of a world ...