24 of 24 Amazon EMR Jobs in the UK excluding London

Databricks Certified Data Engineer Professional**AWS*** Proficiency with AWS Tools: Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions.* Programming Skills: Strong experience ...

source-code management. Strong troubleshooting and problem-solving skills. AWS Experience Candidates should have practical experience with relevant AWS data services, such as: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Amazon Athena Amazon RDS AWS IAM Amazon CloudWatch Experience with services such as Kinesis, EMR, Step Functions or MWAA/Airflow would be advantageous. AWS data engineering roles commonly use services such as S3, Glue, Redshift, Lambda, Kinesis ...

data processing workflows. Root cause analysis Perform data analysis to identify and resolve root causes of pipeline failures and data quality issues - including reviewing EMR output logs and CloudWatch metrics. Apply understanding of dimensional data models and slowly changing dimensions (SCD) to design and maintain well-structured, analytically trusted … development and data processing SQL - used for querying, transformation, and validation across data stores PySpark - for distributed data processing using Apache Spark on AWS EMR Familiarity with basic data structures for constructing robust, scalable solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache ...

modern analytics architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial ...

Server to AWS, including target modelling, cutover approach, reconciliation strategy and technical risk management. Design and build the real‐time data architecture using Amazon MSK/Apache Kafka and PySpark Structured Streaming (evaluating Apache Flink where it is the better fit), including event schema governance, exactly‐once semantics … Essentials: Deep, hands‐on expertise across core AWS data services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR, with the ability to make and defend architectural decisions. Advanced proficiency in Python and SQL, including PySpark for large‐scale batch and streaming processing ...

Strong experience testing cloud-native platforms on AWS . Hands-on experience with services such as: o AWS S3 o Lambda o Glue o EMR o ECS/EKS o RDS o IAM o CloudWatch Understanding of cloud architecture, distributed systems, and microservices. Experience validating infrastructure, platform services, APIs ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

scale data solutions Hands-on expertise in Apache Spark development using Java or Scala (Python experience considered) Strong proficiency in AWS cloud services (S3, EMR, Glue, IAM, etc.) and cloud-native architecture principles Advanced SQL development skills for performance-critical data transformations Practical knowledge of ETL/ELT pipelines ...

initiatives. Requirements Proven commercial experience as an AWS Data Engineer or Data Platform Engineer. Strong experience working with AWS services including S3, Glue, Athena, EMR and Lambda. Advanced SQL and Python skills. Strong data modelling expertise, including dimensional modelling and analytics-ready data design. Experience delivering ...

extension Start Date: ASAP OR 4 weeks. Must-Have Skills: Strong experience building and supporting AWS Data Lakehouse solutions AWS services including S3, Glue, EMR, Athena, Redshift, Lake Formation, EventBridge & Step Functions Advanced Python and SQL skills Strong experience with PySpark and large-scale data processing Hands-on experience ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

transformation patterns. Proficiency in data quality assurance, data governance, and query optimization. Nice to have: Familiarity with the AWS data ecosystem (S3, Glue, EMR/PySpark, Apache Iceberg). Non-Technical Skills & Competencies Proven sense of ownership, commitment, and personal accountability. Meticulous attention to detail with a proactive problem ...

transformation patterns. Proficiency in data quality assurance, data governance, and query optimization. Nice to have: Familiarity with the AWS data ecosystem (S3, Glue, EMR/PySpark, Apache Iceberg). Non-Technical Skills & Competencies Proven sense of ownership, commitment, and personal accountability. Meticulous attention to detail with a proactive problem ...

Experience: Understanding of data processing using Apache Spark and Apache Airflow for task orchestration Use of Python, SQL, and familiarity with PySpark Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify … changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB and LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab ...

large-scale data platform or data warehouse migration (cutover, reconciliation, parallel running, decommissioning) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg ...

What they're looking for: Previous experience as a Technical Lead (hands-on) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg ...

Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … decision‐making. AI : You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud‐native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human in the Loop and MLOps. Data Architecture Design ...

does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs … need to be the person designing the model Have designed and operated production data pipelines on a modern cloud data platform, AWS (Glue, EMR, Redshift, S3/Lake Formation), Databricks, Snowflake or comparable, and can talk about which of those decisions would travel to a different one, and which ...

does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs … need to be the person designing the model Have designed and operated production data pipelines on a modern cloud data platform, AWS (Glue, EMR, Redshift, S3/Lake Formation), Databricks, Snowflake or comparable, and can talk about which of those decisions would travel to a different one, and which ...

does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs … need to be the person designing the model Have designed and operated production data pipelines on a modern cloud data platform, AWS (Glue, EMR, Redshift, S3/Lake Formation), Databricks, Snowflake or comparable, and can talk about which of those decisions would travel to a different one, and which ...

application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems, and with Grafana, Power … application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems, and with Grafana, Power ...

workloads, including feature stores, model serving infrastructure, MLOps pipelines, and experimentation frameworks.Drive strategic adoption of technologies including Snowflake, Databricks, AWS Athena, EMR, Glue, Snowplow, and Kafka, ensuring robust data governance and quality practices.Partner closely with product and data science teams to ensure the data and AI platform directly enables … SaaS environment.Hands-on background in data platform engineering: data lake architecture, ELT pipelines, and familiarity with Snowflake, Databricks, and AWS data services (Athena, Glue, EMR).Experience building AI/ML infrastructure: feature stores, model serving, MLOps pipelines, and LLM-enabling platform capabilities such as MCP server infrastructure ...