51 to 65 of 65 Amazon EMR Jobs

from the Cloudera Hadoop platform (HDFS, Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop … maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services including AWS Glue Data Catalog, Athena, Redshift Spectrum, EMR Spark Perform data migration, testing, reconciliation, and unit testing activities to ensure data integrity and successful platform migration. Create and maintain Unix/Linux shell ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS’s analytics portfolio, including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch. You’ll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges, whether migrating from legacy … workshops, and reference architectures. Key job responsibilities Architect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch). Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud‐native analytics, including ...

deploy containerised workloads to AWS through managed Kubernetes and scale on-demand to satisfy burstable workloads. Other managed services we use in AWS include EMR, RDS, MSK and bespoke EC2 solutions. All infrastructure is managed through Terraform, our source code is in GitHub and automation through GH actions. Your ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS's analytics portfolio including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch. You'll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges whether migrating from legacy … leadership, workshops, and reference architectures. Key job responsibilitiesArchitect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch)Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud-native analytics, including ETL refactoring ...

field. Experience with large‐scale distributed data processing (e.g., Apache Spark) and cloud data infrastructure across GCP and AWS (e.g., Dataproc, Dataflow, GKE, EMR). Experience with Temporal More about us: LiveRamp’s mission is to connect data in ways that matter, and doing so starts with our people. ...

including exposure to other cloud vendorsIn-depth understanding of AWS's suite of tools and services for data management and pipelining, including VPC, EMR, S3, RDS, Kinesis, Glue, Redshift, and Data Pipeline. Proficiency in infrastructure-as-code tools such as Terraform, CloudFormation, and related technologies. Strong knowledge of Kubernetes. … fault-tolerant big data environments in the cloud, utilizing NoSQL and RDMS technologies like Hadoop, Spark, PostgreSQL, and cloud-based management tools such as EMR, Athena, and RDS.Ability to implement systems with a security-first mindset, adhering to firm-wide security policies and utilizing cloud-based security tools like ...

will translate business needs into traceable technical designs and drive architectural standards. Remote with monthly office presence, Inside IR35. The ideal candidate brings AWS EMR/Spark expertise, design pattern discipline, and familiarity #J-18808-Ljbffr ...

Amazon Development Centre (London) Limited We are looking for a passionate, talented, and inventive Data Scientist with a strong machine learning and analytics background to help build industry‐leading language technology powering Rufus, our AI‐driven search and shopping assistant, helping customers with their shopping tasks at every … Master's degree or above in Mathematics, Statistics, Computer Science, or related scientific field. Preferred Qualifications Experience with AWS services including S3, Redshift, SageMaker, EMR, Kinesis, Lambda, and EC2. Experience in defining and creating benchmarks for assessing generative AI model performance. Experience working on multi‐team, cross‐disciplinary projects. ...

candidate will architect scalable Databricks Lakehouse solutions using Delta Lake, Unity Catalog, DLT, Workflows, Auto Loader, PySpark, and Structured Streaming. The role involves migrating EMR, NiFi, Redshift, and legacy ETL workloads, while establishing data governance, security, quality, lineage, and observability frameworks. Strong AWS expertise across S3, Glue, IAM, Redshift … EMR, and Lambda, along with Airflow, CI/CD, GitHub, and Jenkins, is required. Experience enabling AI/ML and Generative AI use cases is highly valued. ...

application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems, and with Grafana, Power … application develop ment and data integration Experience with distributed data and compute, such as Spark or Databricks, Hadoop or Hive, Kafka, or AWS EMR, and cloud environments used by the IC Experience with geospatial analysis tools, such as ArcGIS or ArcPro, and GEOINT collection systems, and with Grafana, Power ...

high‐stakes clinical data into a clean, trusted foundation the whole product runs on. Design and ship data pipelines end-to-end: ingesting from EMR and clinic source systems, modelling into a canonical data layer, and serving analytics‐ready datasets and insights. Work closely with customers to migrate … validate data from their old EMR to wawa. Managing customers through complex data migrations step‐by‐step to ensure they have the best start with Wawa. Solve genuinely complex problems daily: heterogeneous healthcare data, schema mapping across clinics, data quality and validation, and multi‐country compliance. Collaborate with application ...

similar) Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Cloud Trail, etc. Experience with data visualization and analytics tools/frameworks (e.g., D3.js, Tableau, Looker, or similar) is a plus Strong analytical ...

Architecture, Enterprise Data Strategy, Data Warehouse, Master Data Management, ERP, CRM, BI, ETL/ELT, Azure Data Factory, Data Lakes, RDBMS, NoSQL, AWS Glue, EMR, Capital Markets Data) Our client is a leading global investment bank with a strong presence across financial markets and commodities. They are now looking … integrity, security and traceability. Strong experience across cloud and on-premise data technologies is required, with exposure to RDBMS, NoSQL, Data Lakes, AWS Glue, EMR and Azure Data Factory particularly valuable. You will also have a good understanding of data warehousing, ETL/ELT, data integration, data lineage ...

Lead Data Platform Engineer – DataOps Location: Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire About the Role We are seeking a Lead Data Platform Engineer to own the resilience, scalability, and security of our core ...

deep passion and desire to engineer and operate the world's largest cloud computing infrastructure to provide a better world for future generations? Amazon Web Services (AWS) builds and operates some of the largest internet infrastructure on the planet; providing companies of all sizes with an infrastructure … team helps to support and operate some of the largest distributed database and analytics services in the world. From DynamoDB to OpenSearch, Glue and EMR, the DBS team manage many of the most heavily used services in AWS. If you join us, you'll be part of a world ...