23 of 23 Amazon EMR Jobs in the UK

years of experience in data engineering or data platform development within enterprise environments Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building ...

performance, security and long-term maintainability. Key experience required: • Active SC Clearance • Deep expertise across AWS data services such as Glue, Lambda, S3, Redshift, EMR, Athena and Step Functions • Strong Python and SQL development capability • Proven experience designing and building ETL or ELT pipelines in cloud environments • Experience working ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing and curating structured and unstructured datasets. Experience with API ingestion, data modelling and optimisation ...

event, and data exchange patterns for cross-system interactions. Cloud & Infrastructure Design cloud-native solutions leveraging AWS services such as S3, IAM, Lambda, EMR, Glue, ECS/EKS, Step Functions, CloudWatch, and networking components. Ensure platform scalability, reliability, observability, and high availability. Oversee IAM policies, security controls, and data ...

diverse projects with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing ...

diverse projects with varied tech stacks across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

conditions * identify issues and risks associated with work * analyse and report test activities and results Key Technical Skills/Tech Stack * AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure * Terraform * Databricks * Data Lake, Warehouse, Lakehouse architecture and design * Python/Pyspark * Data platforms ...

experience required: Strong Python development, particularly for data ingestion, crawling, parsing, and transformation. Extensive experience working with SQL and analytical databases, ideally including Amazon Redshift or similar time-series platforms. Experience building production data pipelines in AWS cloud environments. Familiarity with Docker containers and CI/CD pipelines. … financial markets. Experience supporting real-time or near-real-time analytics environments. Knowledge of additional AWS services such as S3, Lambda, Athena, Kinesis, EMR, Fargate, or API Gateway. Experience with big data technologies including Spark, Databricks, Hadoop, or Dask. Familiarity with data visualisation tooling such as Plotly. Experience mentoring ...

based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

design, scheduling, sensors, retries, XComs, task isolation, best practices) Strong across broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets Manager, Athena, EMR (nice to have), Redshift (nice to have) Proven experience delivering multiple end-to-end programs (architecture build test deploy operate) with measurable outcomes (SLAs … statements, success criteria, and measurable outcomes. Languages: Python (PySpark), SQL AWS: Glue, MWAA (Airflow), S3, IAM, KMS, CloudWatch, Lambda, Step Functions, Athena, Redshift (nice), EMR (nice) DevOps: Git, CI/CD (CodePipeline/GitHub Actions), Terraform/CloudFormation, Docker Data Quality/Observability: Great Expectations/Deequ (nice), OpenLineage ...

Engineer Location: London, UK (3 Days/Week Onsite) Type: Fixed Term Contract (6 Months) Mandatory Skills Needed : SQL ( Advanced) , AWS Cloud (Glue,Ethena,EMR), Airflow, Kafka/Kenesis ,Python, Terraform DBT & Snowflake (Basic) AWS Data Engineer Design, develop, and maintain data pipelines for collecting, transforming, and loading data ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Ensure accuracy, quality, and reliability across data transformation processes. Cloud & Data Engineering (AWS-Focused) Build and deploy data pipelines using AWS services such as EMR, Glue, S3, Athena . Optimise Spark workloads for performance, partitioning, cost efficiency, and scalability. Use CI/CD pipelines and Git-based version control … data flows, and architecture. Exposure to CI/CD tooling for data engineering pipelines. AWS & Platform Skills (P3) Strong hands-on experience with: S3 EMR/Glue Glue Workflows Athena IAM Understanding of distributed computing and big data processing on AWS. Experience deploying and operating data pipelines in cloud ...

Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python code using SAS2PY and manual refactoring. Performance Tuning: Optimise Spark … unit testing, and data reconciliation frameworks to ensure "penny-perfect" accuracy. Technical Stack Engine: PySpark (Expert), Python (Clean Code/SOLID principles). AWS: EMR, Glue, S3, Athena, IAM, Lambda. Data Modeling: SCD Type 2, Fact/Dimension tables, Data Vault/Star Schema. Legacy: Proficiency in reading/ ...

Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python code using SAS2PY and manual refactoring. Performance Tuning: Optimise Spark … unit testing, and data reconciliation frameworks to ensure "penny-perfect" accuracy. Technical Stack Engine: PySpark (Expert), Python (Clean Code/SOLID principles). AWS: EMR, Glue, S3, Athena, IAM, Lambda. Data Modeling: SCD Type 2, Fact/Dimension tables, Data Vault/Star Schema. Legacy: Proficiency in reading/ ...

Proficiency in Git-based development workflows Experience working independently and communicating effectively in distributed teams Desirable : Familiarity with (or happy to learn): Apache Spark (EMR) and Delta Lake PostgreSQL (Aurora) CI/CD (Github Actions) and IaC (Helm, CloudFormation) Monitoring (Sentry) Knowledge/interest in research or academic writings … better way for us to communicate, please do let us know. Developer, Programmer, Engineer, Full Stack, FullStack, Full-Stack, Python, AWS, Amazon Web Services, EKS, Elastic Kubernetes Service, Flask, React, TypeScript, Type Script, Type-Script, Remote, Hybrid, London Circle Recruitment is acting as an Employment Agency in relation ...