1 to 25 of 26 Amazon EMR Jobs

years of experience in data engineering or data platform development within enterprise environments Strong expertise in AWS data services (such as S3, Glue, Redshift, EMR, Athena, Lambda or similar) Strong programming experience with Python and SQL Hands-on experience with Spark or distributed data processing frameworks Proven experience building ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

nice to have: Data Engineering & Programming: • Python • SQL • Spark/PySpark • Scala • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

unstructured data from multiple sources using APIs, scripting and cloud-native tooling Design and build robust AWS cloud data platforms using services such as EMR, Glue, Redshift, Kinesis, Lambda and DynamoDB Collaborate cross-functionally with product, design and engineering teams in agile delivery environments Participate in live whiteboarding sessions ...

Proven experience designing and deploying production-grade pipelines (Python, Scala, Java, Spark, SQL). Strong experience working with AWS cloud data technologies (e.g., Glue, EMR, Redshift, Kinesis, Lambda, DynamoDB). Commercial experience ingesting, processing and curating structured and unstructured datasets. Experience with API ingestion, data modelling and optimisation ...

Scripting/automation skills (PowerShell, Python, YAML). · Experience configuring cloud monitoring (Azure Application Insights, Log Analytics/KQL). · AWS experience (EC2, S3, EMR) and cloud data migration. Preferred Qualifications: · Experience in multi-team engineering environments with a core focus on developer enablement. · Familiarity with Team Topologies ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

data platforms Deep expertise in Snowflake architecture Hands-on experience with Airflow/MWAA and dbt Strong knowledge of AWS data services (S3, EMR, PySpark) Experience designing Data Lakehouse architectures (Iceberg preferred) Expertise in performance tuning and optimisation Nice to Have CI/CD and DevOps practices Terraform/ ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

event-level or behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start ...

experience required: Strong Python development, particularly for data ingestion, crawling, parsing, and transformation. Extensive experience working with SQL and analytical databases, ideally including Amazon Redshift or similar time-series platforms. Experience building production data pipelines in AWS cloud environments. Familiarity with Docker containers and CI/CD pipelines. … financial markets. Experience supporting real-time or near-real-time analytics environments. Knowledge of additional AWS services such as S3, Lambda, Athena, Kinesis, EMR, Fargate, or API Gateway. Experience with big data technologies including Spark, Databricks, Hadoop, or Dask. Familiarity with data visualisation tooling such as Plotly. Experience mentoring ...

design, scheduling, sensors, retries, XComs, task isolation, best practices) Strong across broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets Manager, Athena, EMR (nice to have), Redshift (nice to have) Proven experience delivering multiple end-to-end programs (architecture build test deploy operate) with measurable outcomes (SLAs … statements, success criteria, and measurable outcomes. Languages: Python (PySpark), SQL AWS: Glue, MWAA (Airflow), S3, IAM, KMS, CloudWatch, Lambda, Step Functions, Athena, Redshift (nice), EMR (nice) DevOps: Git, CI/CD (CodePipeline/GitHub Actions), Terraform/CloudFormation, Docker Data Quality/Observability: Great Expectations/Deequ (nice), OpenLineage ...

Details ETL Data Engineer Tech Stack & Core Skills:Advanced SQL (Big Data focused)Data Visualization (preferably Tableau)AWS (EMR, Lambda, S3, Step Functions, Athena )ETL Data EngineeringData AnalysisHeavyAI Soft Skills:Effective CommunicationAnalysis PresentationSelf-starterCuriousGrowth MindsetCollaboration Additional Preferences:PythonpySparkData ModelingStatistical Analysis We are an equal opportunity employer. All aspects ...

based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

standard office hours. Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and EMR Build and manage data workflows orchestrated with tools like AWS Step Functions, or similar Implement data transformations using Python, PySpark, or SQL Design … Requirements: Must possess an active Security Clearance Experience in data engineering or ETL development Strong hands-on experience with AWS services (Glue, S3, Lambda, EMR, IAM) Proficiency in Python and SQL Familiarity with CI/CD pipelines and Infrastructure as Code Knowledge of data security, encryption, and IAM best ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python code using SAS2PY and manual refactoring. Performance Tuning: Optimise Spark … unit testing, and data reconciliation frameworks to ensure "penny-perfect" accuracy. Technical Stack Engine: PySpark (Expert), Python (Clean Code/SOLID principles). AWS: EMR, Glue, S3, Athena, IAM, Lambda. Data Modeling: SCD Type 2, Fact/Dimension tables, Data Vault/Star Schema. Legacy: Proficiency in reading/ ...

Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python code using SAS2PY and manual refactoring. Performance Tuning: Optimise Spark … unit testing, and data reconciliation frameworks to ensure "penny-perfect" accuracy. Technical Stack Engine: PySpark (Expert), Python (Clean Code/SOLID principles). AWS: EMR, Glue, S3, Athena, IAM, Lambda. Data Modeling: SCD Type 2, Fact/Dimension tables, Data Vault/Star Schema. Legacy: Proficiency in reading/ ...

individual one or part of a team) Architect and optimize ETL/ELT pipelines using services such as: DBT, AWS Glue, Lambda, Kinesis, S3, EMR Design high performance Snowflake data models (3NF, dimensional, Data Vault, etc.) Optimize query performance, clustering, micro-partitioning, and resource consumption Work closely with Data … expertise with Snowflake (architecture, performance tuning, security, Snowpipe, streams/tasks) Strong experience with AWS cloud data ecosystem, ideally including: S3, Glue, Lambda, Redshift, EMR, Kinesis, IAM, CloudWatch Strong SQL skills and proficiency in Python, DBT Understanding of data governance frameworks (e.g., Collibra, Alation is a plus) Hands ...

data lake solutions Build data pipelines using PySpark and Python Implement and manage Apache Iceberg-based lakehouse architecture Work with AWS services including S3, EMR, Lambda, EKS, MWAA Ensure data quality, integrity, and security Collaborate with data architects and analysts to deliver data solutions Implement workflow orchestration and automation … experience in AWS data engineering Hands-on expertise in PySpark and Python Experience with Apache Iceberg Familiarity with AWS services (IAM, Lambda, EKS, S3, EMR, MWAA) Experience building scalable data pipelines Nice to Have CI/CD pipelines and DevOps practices Terraform/Infrastructure as Code Data quality frameworks ...

Pipelines & Productionisation · Build end-to-end ML pipelines using Python, ensuring reproducibility and scalability across training and inference. · Deploy models to production using Amazon SageMaker (Training Jobs, Batch Transform, and Real-Time Endpoints). · Implement model versioning, lineage tracking, and rollback strategies for safe releases. Data Engineering & Feature … experience with Amazon SageMaker (training, tuning, batch & real-time endpoints). · Experience with AWS data services (S3, Glue, Athena, Redshift, or EMR). · Exposure to containerisation (Docker) and orchestration (Step Functions, Airflow, or similar). Machine Learning Expertise · Strong grounding in supervised and unsupervised learning techniques. · Practical ...

Different Clinical trials are embedded within clinical practice-not run in parallel. Hybrid model blending expert abstraction, AI/NLP/LLMs, and EMR integrations. Strong commitment to rigorous testing, validation, privacy, and ethical AI. Mission driven culture with high collaboration and urgency. Why Join Now AI is essential … alignment. Comprehensive documentation: datasets, experiments, model cards, QA audits. HIPAA aligned safeguards and compliant AI practices. Core Responsibilities Build AI models and pipelines across EMR/EHR, imaging, and clinical documents. Translate ambiguous clinical requirements into measurable ML objectives. Define metrics, design experiments, and estimate/model error. Lead ...