1 to 25 of 40 Amazon EMR Jobs in the UK

within UK Central Government. What You'll Be Doing Design, build, and maintain production-grade data pipelines using AWS services including Amazon EMR, S3 and Lambda. Develop scalable data processing solutions using PySpark, Python and SQL with a focus on performance, resilience, testing and observability. Lead … experience delivering data engineering solutions within UK Central Government. Strong commercial experience with Informatica. Hands-on expertise with AWS services including Amazon EMR, S3 and Lambda. Advanced PySpark, Python and SQL skills for large-scale data processing. Experience building and maintaining enterprise-scale batch data pipelines. Strong ...

Benefits Job typePermData Engineer (AWS) – Manchester(Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer)Our client is a global innovator … Nathan Warner at Noir Consulting.(Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer)NOIRUKTECHRECNOIRUKREC ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best … practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark ...

Delta Lake, Unity Catalog, and streaming technologies.Broad cloud expertise across Azure (Synapse, ADF, Event Hub, ADLS Gen2, Purview, Key Vault) and AWS (S3, Glue, EMR, Kinesis, Athena, Lake Formation, IAM), with strong multi-cloud experience.Strong understanding of modern engineering practices, including CI/CD for data platforms, automated deployment ...

building and supporting ETL/ELT frameworks. Strong understanding of data warehousing concepts and dimensional modelling. AWS experience, including services such as S3, Glue, EMR, or PySpark . Knowledge of data governance, quality controls, and testing practices. Experience working within large-scale enterprise environments. Desirable Knowledge of Iceberg ...

integrated toolingProficiency in Python, Scala, or Java in a production data platform contextSolid understanding of cloud-native data infrastructure (AWS preferred — Glue, Athena, S3, EMR, Lambda, or equivalents)Track record of managing, recruiting, and developing high-performing remote engineering teamsAbility to translate long-term platform vision into executable quarterly ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

Must be held currently). AWS Expertise: Proven hands-on experience with core AWS services (IAM, EC2, S3, CloudWatch, VPC) and AWS Data services ( EMR, Glue ). Infrastructure as Code: Strong experience with Terraform . CI/CD & Scripting: Deep experience with GitLab CI/CD (runners/pipelines ...

Linux skills and proficiency in Python for automation and integrationFamiliarity with infrastructure as code, using Terraform or AnsibleDeep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAAExperience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetryStrong problem-solving skills ...

exposure to the following will be good to have else we will be enable you with the required trainingAWS Glue and Data Catalog, EMR, Athena, S3, Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure ...

data modelling experience. Strong understanding of ETL/ELT architecture and data integration frameworks. AWS experience including services such as S3, Glue, EMR, and PySpark . Experience defining data standards, governance frameworks, and architectural roadmaps. Desirable Experience with Iceberg and modern lakehouse architectures. Exposure to AI-enabled data platforms ...

infrastructure, ideally on AWS using IaCYou have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analyticsYou have experience of designing and operating data ingestion pipelines at scale (batch and streaming ...

ideally on AWS using IaC You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analytics You have experience of designing and operating data ingestion pipelines at scale (batch ...

computing frameworksExperience with enterprise-scale implementations of cloud-native data platforms such as Databricks and SnowflakeGood understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutionsExperience navigating complex data governance ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

infrastructure, ideally on AWS using IaCYou have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analyticsYou have experience of designing and operating data ingestion pipelines at scale (batch and streaming ...

impact-scalability tradeoff into account.Some skills that will make you stand out: Apache Spark, Iceberg, Kafka, dbtScikit-Learn, XGBoost, PyTorch, MLFlow,, GraphFrames, RayAWS (S3, EMR, SageMaker, Lakeformation), Terraform, Docker, GitHub CI/CDKnowledge Graphs (+ RAG), graph ML, probabilistic programming, A/B testingAdditional InformationFor everyone, everywhere. ...

Kotlin/Java programming.Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive.Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue.Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development.Strong communication skills, with the ability to work ...