1 to 25 of 53 Amazon EMR Jobs in the UK

Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/prod), naming standards … cloud platform, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, and related security, networking, and monitoring services.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.* Passion for data and a thirst ...

Data Engineer (AWS) - Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader … Nathan Warner at Noir Consulting. (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Data modelling Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured, analytically trusted … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

PySpark Develop and support large-scale data processing pipelines using Apache Spark Use Apache Airflow for workflow orchestration and task scheduling Work with AWS EMR environments and review logs/output to troubleshoot issues Query, validate and analyse datasets using Jupyter Notebooks and/or Amazon Athena … functionality Follow engineering best practices across delivery team Technical Environment: Programming/Data: Python SQL PySpark Apache Spark Apache Airflow AWS/Cloud: AWS EMR S3 Glue CloudWatch IAM EC2 ECR DynamoDB Lake Formation Amazon Athena AI/Intelligent Document Processing: Amazon Textract Amazon ...

week onsite in Knutsford, UK. Specific skills/experience required: Strong hands-on experience with AWS data services including S3, Glue, Lambda, Redshift, Athena, EMR and DynamoDB Proven experience designing, implementing and troubleshooting enterprise-scale data pipelines Strong expertise in ETL/ELT frameworks and data integration solutions Advanced ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

Familiarity with CI/CD and automated deployment practices. Experience supporting and maintaining production data platforms. Desirable Skills Scikit-Learn or Spark MLlib AWS EMR Apache Airflow Jenkins Hudi or other open table formats Kibana Grafana Understanding of Data Science principles If you receive suspicious outreach claiming ...

Familiarity with CI/CD and automated deployment practices. Experience supporting and maintaining production data platforms. Desirable Skills Scikit-Learn or Spark MLlib AWS EMR Apache Airflow Jenkins Hudi or other open table formats Kibana Grafana Understanding of Data Science principles If you receive suspicious outreach claiming ...

Kafka and a programming language (e.g., Python or Java) for building data workflows and automation. Familiarity with AWS services such as S3, Glue, Lambda, EMR, or streaming tools like MSK/Kinesis. Experience with basic data governance, data quality checks, and security practices (e.g., RBAC, encryption, handling PII). ...

manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best … practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark ...

Software Dev Engineer, Amazon Security Automation Job ID: 10498444 | Amazon UK Services Ltd. At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon … development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2 Experience developing, deploying and managing AI products at scale Amazon is an equal opportunities employer. We believe passionately ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

technologies like Apache Iceberg and Spark.Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.RDBMS: Knowledge of PostgreSQL is a plus.Industry Experience: Proven ...

integrated toolingProficiency in Python, Scala, or Java in a production data platform contextSolid understanding of cloud-native data infrastructure (AWS preferred — Glue, Athena, S3, EMR, Lambda, or equivalents)Track record of managing, recruiting, and developing high-performing remote engineering teamsAbility to translate long-term platform vision into executable quarterly ...

building and supporting ETL/ELT frameworks. Strong understanding of data warehousing concepts and dimensional modelling. AWS experience, including services such as S3, Glue, EMR, or PySpark . Knowledge of data governance, quality controls, and testing practices. Experience working within large-scale enterprise environments. Desirable Knowledge of Iceberg ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Languages English (Preferred) Spanish (Preferred) Hard Skills Practical experience with AWS cloud architecture, including services like S3, IAM, VPC, KMS, CloudWatch, CloudTrail, Glue, Athena, EMR, Lambda, Step Functions, and SageMaker. (Preferred) Skilled in SQL and NoSQL databases for implementing data warehouses and data lakes. (Preferred) Experienced in data ingestion … processing, transformation, and delivery using batch, streaming, and real‐time methods. (Preferred) Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). ...

Languages English (Preferred) Spanish (Preferred) Hard Skills Practical experience with AWS cloud architecture, including services like S3, IAM, VPC, KMS, CloudWatch, CloudTrail, Glue, Athena, EMR, Lambda, Step Functions, and SageMaker. (Preferred) Skilled in SQL and NoSQL databases for implementing data warehouses and data lakes. (Preferred) Experienced in data ingestion … processing, transformation, and delivery using batch, streaming, and real‐time methods. (Preferred) Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the right services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

platform experience across compute, storage, networking, security, provisioning, and automation. Hands-on with services including EC2, ECS, EKS, ELB, S3, Lambda, API Gateway, Glue, EMR, ElastiCache, CloudWatch, and CodeDeploy. Infrastructure provisioning expertise using Terraform (advanced techniques), including implementing/configuring AWS RDS and Aurora via Terraform. Administer, optimize ...