17 of 17 Amazon EMR Jobs in the North of England

Data Engineer (AWS) - Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader … Nathan Warner at Noir Consulting. (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

including data pipelines, ETL/ELT processes, and data integration frameworks. Develop andoptimizedata architectures using AWS services such as S3, Glue, Lambda, Redshift, Kinesis, EMR, Amazon OpenSearch Service, and graph databases such as Amazon Neptune, and related technologies. Ensure solutions follow AWS best practices … Whatyou'llbring Considerable experiencein data engineeringfocused on AWS data platforms and services. Strong hands-on experience withAWS data servicesincluding S3, Glue, Lambda, Redshift, Athena, EMR, Kinesis, Amazon OpenSearch Service, and graph databases such as Amazon Neptune, and related technologies. Proficiencyin programming languages such asPythonandSQL fordata ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured, analytically trusted … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

skills, including supporting business users and translating technical concepts into business outcomes.Desirable Criteria• A cloud (AWS/Azure) delivery background. • Knowledge in the following: EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune, VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMSFurther Location InformationPlease ensure that you only apply ...

skills, including supporting business users and translating technical concepts into business outcomes.Desirable Criteria• A cloud (AWS/Azure) delivery background. • Knowledge in the following: EMR, Lambda, S3, RDS, EC2, EBS, EFS, Neptune, VPC (network layer), APIs, Terraform, Cloudwatch, IAM, KMSFurther Location InformationPlease ensure that you only apply ...

manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best … practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark ...

SQLExperience working with AWS and its data and AI/ML services such as SageMakerExperience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake)Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloadsUnderstanding of Data Security, Data ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

Databricks Mosaic AI, Vector Search and Unity Catalog, or Azure OpenAI, Azure AI Foundry and Azure AI Search. AWS: Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift, S3 data lakes; and, for the AI edge, Amazon Bedrock, Knowledge Bases for Bedrock About Capgemini Hybrid working: The places ...

infrastructure security, scalability, and resource allocation. Deep, hands‐on practical experience configuring, deploying, and managing AWS cloud infrastructure services (IAM, VPC networking, EC2/EMR provisioning, S3 security policies, and serverless compute)/AWS ecosystem, vector databases (for AI/analytics pipelines), and Enterprise Data Platform (EDP) integration frameworks. ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

demonstrated to stakeholders. Architecture design informed through the use of principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...

Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … decision‐making. AI : You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud‐native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human in the Loop and MLOps. Data Architecture Design ...

will translate business needs into traceable technical designs and drive architectural standards. Remote with monthly office presence, Inside IR35. The ideal candidate brings AWS EMR/Spark expertise, design pattern discipline, and familiarity #J-18808-Ljbffr ...

governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks, Experience and technical expertise (design and implementation) in cloud … data center or data center to cloud infrastructure Data security, compliance, and access controls Performance optimization for data processing workloads Big data processing platforms (EMR, Glue) The AWS Professional Services organization is a global team of experts that help customers realize their desired business outcomes when using ...