51 to 75 of 82 Permanent Amazon EMR Jobs

data pipelines, and collaboration across global teams from a remote UK setting. You will work with a broad stack including AWS Glue, Redshift, EMR, Kinesis, and Python/PySpark to deliver real business impact for Fortune 1000 #J-18808-Ljbffr ...

framework such as Spring Boot Experience with a public cloud provider, AWS preferred Prior technical leadership or mentoring experience Desirable: Deeper AWS experience: CloudFormation, EMR, S3, EC2, CloudTrail Experience with data visualisation tools such as D3.js, Tableau or Looker Why Apply? Flexible working model based in Belfast Senior Staff ...

pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python, SQL, DBT, AWS: S3, Glue, EMR, Lambda, Aurora, Airflow, Terraform). Ensure data availability, integrity, and performance as the platform scales globally. Drive best practices in data quality, automated testing … equivalent). Experience integrating with major EHR platforms (Epic, Cerner, Meditech, or similar). Strong command of the AWS data stack: S3, Glue, EMR, Lambda, Aurora, and orchestration tools such as Airflow. Proficiency in Python, SQL, and DBT; familiarity with IaC tooling such as Terraform. Comfortable operating across customer ...

based Data Lakes*** Experience with **Apache Airflow/MWAA** for workflow orchestration* Strong knowledge of **dbt (data build tool)** for data transformation* Experience with **EMR/PySpark** for large-scale data processing* Ability to create **Architecture Design Documents (ADDs)*** Deep understanding of **cloud-native design patterns*** Experience in **performance ...

vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, Polars Familiarity with AWS Cloud services such as EMR, Sagemaker Overall knowledge of the Software Development Life Cycle Solid understanding of agile methodologies including CI/CD, application resiliency, and security Preferred Qualifications, Capabilities ...

Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi) and Serverless data concepts. Familiarity with mainstream global cloud products such as AWS EMR/Redshift, Google BigQuery, Snowflake, and Databricks., Ability to perform competitive analysis and develop differentiation strategies. Soft Skills: Excellent logical thinking, communication skills ...

regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills: You are highly comfortable using ...

vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, Polars Familiarity with AWS Cloud services such as EMR, Sagemaker Overall knowledge of the Software Development Life Cycle Solid understanding of agile methodologies including CI/CD, application resiliency, and security Preferred Qualifications, Capabilities ...

regulated environment.* AWS Experience: You have a strong working knowledge of AWS and cloud-first data pipeline orchestration tools (like Airflow, Glue, or EMR).* A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines.* Strong Automation Skills: You are highly comfortable using ...

Responsibilities Design and implement scalable AWS Data Lakehouse solutions Develop and maintain data pipelines using Python and PySpark Work with AWS services including: S3, EMR, Lambda, IAM, EKS, MWAA Build and manage Apache Iceberg tables for efficient data storage and querying Implement CI/CD pipelines for data platform … data analysts, scientists, and DevOps engineersRequired Skills & Experience Strong experience in AWS Data Engineering Hands-on expertise with: AWS services: IAM, Lambda, EKS, S3, EMR, MWAA Apache Iceberg Python & PySpark Solid understanding of data lakehouse architecture principles Experience with CI/CD pipelines and Terraform Knowledge of data quality ...

from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop … maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services including AWS Glue Data Catalog, Athena, Redshift Spectrum, EMR Spark Perform data migration, testing, reconciliation, and unit testing activities to ensure data integrity and successful platform migration. Create and maintain Unix/Linux shell ...

services, with expert-level Databricks and/or Snowflake and an Agile delivery mindset. Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse, Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … decision-making. AI: You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud-native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human in the Loop and MLOps. Data Architecture Design ...

Agile delivery mindset. On AWS, you’re fluent across the core services, for example: Storage & Lakehouse: RDS, DynamoDB, S3, SageMaker Lakehouse Processing & ETL: Glue, EMR, Athena, CDC/DMS, DataBrew, Kinesis, dbt Data management & metadata: Lake Formation, Glue Data Catalog, SageMaker Catalog/DataZone AI: Bedrock (including AgentCore … decision‐making. AI : You understand how AI is built and deployed in modern data platforms (Databricks, Snowflake) and cloud‐native services like Amazon Bedrock, with enough depth to guide teams and advise clients, spanning LLMs and SLMs, agentic automation, Human in the Loop and MLOps. Data Architecture Design ...

governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks Preferred Qualifications Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure Data security, compliance, and access controls Performance optimization for data processing workloads Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks Preferred Qualifications Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure Data security, compliance, and access controls Performance optimization for data processing workloads Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks Preferred Qualifications Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure Data security, compliance, and access controls Performance optimization for data processing workloads Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS’s analytics portfolio, including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch. You’ll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges, whether migrating from legacy … workshops, and reference architectures. Key job responsibilities Architect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch). Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud‐native analytics, including ...

deploy containerised workloads to AWS through managed Kubernetes and scale on-demand to satisfy burstable workloads. Other managed services we use in AWS include EMR, RDS, MSK and bespoke EC2 solutions. All infrastructure is managed through Terraform, our source code is in GitHub and automation through GH actions. Your ...

including exposure to other cloud vendorsIn-depth understanding of AWS's suite of tools and services for data management and pipelining, including VPC, EMR, S3, RDS, Kinesis, Glue, Redshift, and Data Pipeline. Proficiency in infrastructure-as-code tools such as Terraform, CloudFormation, and related technologies. Strong knowledge of Kubernetes. … fault-tolerant big data environments in the cloud, utilizing NoSQL and RDMS technologies like Hadoop, Spark, PostgreSQL, and cloud-based management tools such as EMR, Athena, and RDS.Ability to implement systems with a security-first mindset, adhering to firm-wide security policies and utilizing cloud-based security tools like ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS's analytics portfolio including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch. You'll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges whether migrating from legacy … leadership, workshops, and reference architectures. Key job responsibilitiesArchitect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch)Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud-native analytics, including ETL refactoring ...

will translate business needs into traceable technical designs and drive architectural standards. Remote with monthly office presence, Inside IR35. The ideal candidate brings AWS EMR/Spark expertise, design pattern discipline, and familiarity #J-18808-Ljbffr ...

open to these locations: London, GBR | Luxembourg, LUX | Paris, FRA | Spain, SPA | Italy, ITA | Germany, GERThe EU Amazon Vendor Services (AVS) and Retail Vendor Experience (VX) Program teams are seeking a Data Engineer to design and implement scalable data solutions and pipelines that can meaningfully contribute to both … similar role- Experience building large-scale, high-throughput, 24x7 data systemsPreferred qualification - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions- Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases, column-family ...

data architecture and modernization roadmapAssess Teradata workloads schemas ETL processes stored procedures and dependenciesDesign migration solutions to AWS services such as Redshift S3 Glue EMR Aurora and Lakehouse platformsLead migration planning wave management cutover rollback and data validation activitiesArchitect data integration CDC replication and near zero downtime migration approachesEstablish … Architecture Data Engineering with 8 years of Teradata and cloud migration experienceStrong expertise in Teradata Vantage BTEQ TPT Fast Load MultiloadAWS Redshift S3 Glue EMR Aurora DMSData Warehousing Data Lakes Lakehouse ArchitecturesETLELT Modernization and SQL MigrationTerraform GitHub GitLab CICD DevSecOpsExperience delivering largescale Teradata migration programs involving Mult terabyte ...

modernization roadmap Assess Teradata workloads schemas ETL processes stored procedures and dependencies Design migration solutions to AWS services such as Redshift S3 Glue EMR Aurora and Lakehouse platforms Lead migration planning wave management cutover rollback and data validation activities Architect data integration CDC replication and near zero downtime migration … Engineering with 8 years of Teradata and cloud migration experience Strong expertise in Teradata Vantage BTEQ TPT Fast Load Multiload AWS Redshift S3 Glue EMR Aurora DMS Data Warehousing Data Lakes Lakehouse Architectures ETLELT Modernization and SQL Migration Terraform GitHub GitLab CICD DevSecOps Experience delivering largescale Teradata migration programs ...

conceptual, logical and physical data models across multiple domains Design, build and optimise data platforms leveraging AWS and hybrid cloud environments, including Redshift, Glue, EMR and S3 Implement real-time and batch processing pipelines using modern data engineering frameworks including Spark, Kafka and dbt Create data flow diagrams, integration … physical models Hands-on experience building and optimising ETL and ELT pipelines at scale Deep practical knowledge of AWS data services including Redshift, Glue, EMR, Kinesis and S3 Experience with modern data engineering tools such as dbt, Spark or Flink Proven experience with SQL and NoSQL databases including PostgreSQL ...