16 of 16 Amazon EMR Jobs

within UK Central Government. What You'll Be Doing Design, build, and maintain production-grade data pipelines using AWS services including Amazon EMR, S3 and Lambda. Develop scalable data processing solutions using PySpark, Python and SQL with a focus on performance, resilience, testing and observability. Lead … experience delivering data engineering solutions within UK Central Government. Strong commercial experience with Informatica. Hands-on expertise with AWS services including Amazon EMR, S3 and Lambda. Advanced PySpark, Python and SQL skills for large-scale data processing. Experience building and maintaining enterprise-scale batch data pipelines. Strong ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

DevOps, CI/CD and software testing. • Expertise with one of programming languages such as SQL, or Python. • Have working experience of AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services. • Experience with Data platform tools like Databricks and/or Snowflake. • Be able ...

manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python, and DevOps best … practices. Essential Skills & Experience Strong AWS experience, including services such as VPC, EC2, S3, IAM, KMS, Lambda, EMR, Athena, and Redshift. Hands-on experience with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark ...

building and supporting ETL/ELT frameworks. Strong understanding of data warehousing concepts and dimensional modelling. AWS experience, including services such as S3, Glue, EMR, or PySpark . Knowledge of data governance, quality controls, and testing practices. Experience working within large-scale enterprise environments. Desirable Knowledge of Iceberg ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

Must be held currently). AWS Expertise: Proven hands-on experience with core AWS services (IAM, EC2, S3, CloudWatch, VPC) and AWS Data services ( EMR, Glue ). Infrastructure as Code: Strong experience with Terraform . CI/CD & Scripting: Deep experience with GitLab CI/CD (runners/pipelines ...

data modelling experience. Strong understanding of ETL/ELT architecture and data integration frameworks. AWS experience including services such as S3, Glue, EMR, and PySpark . Experience defining data standards, governance frameworks, and architectural roadmaps. Desirable Experience with Iceberg and modern lakehouse architectures. Exposure to AI-enabled data platforms ...

ideally on AWS using IaC You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analytics You have experience of designing and operating data ingestion pipelines at scale (batch ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

PySpark, DLT), GenAI (Agent Core, Copilot Studio, Amazon Bedrock), and Graph Databases (Neo4j). Cloud & Tools: Strong command of AWS (Lambda, Glue, EMR, MWAA, S3), Azure, Airflow, Terraform, Docker, Kubernetes, and Jenkins. Programming: Advanced skills in Python, SQL, Scala, Java, and Shell Scripting. Leadership Competencies Strategic Advisory ...

firewall management, connectivity solutions, infrastructure integration, and cyber security initiatives across clinics and corporate locations. You will play a key role in supporting partnerships, EMR integrations, and infrastructure modernisation programmes, ensuring all solutions remain secure, compliant, and aligned with enterprise standards. The role: Core IT Infrastructure & Network Delivery Cyber … Enterprise Networking Environments Hands-on experience managing firewalls and secure VPN connectivity. Experience working within multi-site or enterprise-scale environments. Desirable Knowledge of EMR/EPR integrations. Understanding of Cyber Essentials, DSPT and Zero Trust security principles. Experience supporting cloud networking environments within Azure and/or AWS. ...