1 to 25 of 28 Amazon EMR Jobs

machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI/CD, and model monitoring. Proficiency in Python and relevant more »

have an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL more »

similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale more »

large scale DW/BI systems for B2B SAAS companies · Experience with open-source tools like Apache Flink and AWS tools like S3, Redshift, EMR and RDS. · Experience with AI/Machine Learning and Predictive Analytics · Experience in developing global products will be a big plus. · Understanding of budgets more »

onto the cloud platforms, one of the key strategies for the division in which you’ll get exposure to technologies like AWS S3, Snowflake, EMR etc. These are great roles playing a role on some really big interesting projects. more »

experience with orchestration tools, ideally Airflow Strong Data Architecture experience ideally in both GCP and AWS Knowledge of MPP systems such as Athena, BigQuery, EMR, Hive, Iceberg 👍 Bonus points for: Exposure to data streaming technologies such as Kafka or Kinesis PLEASE NOTE : Unfortunately, we are unable to sponsor VISAs more »

machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI/CD, and model monitoring. Proficiency in Python and relevant more »

London - 3x a week Length: Initial 6 months Contract, Inside IR35 Delivery of AWS-based data & analytics capabilities, built on foundational services such as EMR, Glue, MWAA, Dynamo, Kinesis, Kafka and Sagemaker AWS Cloud Data Platforms Architecture and AWS Cloud Security & Infrastructure Insurance or Regulated Financial Services Industries Solutioning more »

to ingest, transform and load the datasets. Your Profile Key skills/knowledge/experience: Good understanding of AWS cloud data platform services: EC2, EMR, RDS, Redshift, Glue. Ability to work with object-oriented scripting languages: Python, Pyspark. Knowledge of data pipeline and workflow management and their tools such more »

role, you'll spearhead backend and data engineering and mentor team members. Tech stack: Athena; Python, Flask, Redis, Postgres, React, Plotly, Docker, SQL, Athena & EMR Spark, ECS and Temporal. This is a 60/40 split between tech and leadership. Your background: 8 years+ coding experience, 4+ years Python more »

8+ with experience in Laravel/Symfony desired. JavaScript/TypeScript proficiency with NodeJS and React.JS. Familiarity with AWS Services (Aurora, MSK Kafka, ECS, EMR). 3+ years of database experience, ideally with MySQL. Hands-on experience with various data storage paradigms (e.g., RDMS + Document + KV Stores more »

massively distributed cloud-hosted data platform that would be used by the entire firm. Tech Stack: Python/Java, Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster. Cloud: AWS, Lambdas, ECS services This role would focus on various areas of Data Engineering including: End to End … Strong Python/Java Software Engineering skills Excellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and Snowflake Previous experience with Dremio, dbt, EMR or Dagster Good Computer Science fundamentals knowledge with strong knowledge of software and data architecture. If you would like more information on the above more »

reliable ETL pipelines on AWS, ensuring high performance and low latency data processing. AWS Service Utilisation: Utilise various AWS services such as S3, Glue, EMR, Athena, Redshift, and Lambda to build end-to-end data pipelines that meet business requirements and compliance standards. Team Leadership: Lead and mentor a … Proven experience (5 years) in designing, building, and managing large-scale data pipelines on AWS. Strong expertise in AWS services such as S3, Glue, EMR, Athena, Redshift, and Lambda. Proficiency in programming languages such as Python, Scala, or Java for data processing and automation. Solid understanding of data modeling more »

AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes more »

AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes more »

data processing. Technologies We Use: Development languages/frameworks : Java/Scala, Apache Spark, Kafka, Vertica, JavaScript (React/Redux), MicroStrategy Amazon : EMR, Step Functions, SQS, LaMDA and AWS cloud-native architectures DevOps Tools : Terraform or Cloud Formation, NewRelic, Jenkins, Grafana, PagerDuty, GitHub, GitHub Actions Database : MySQL … or Scala skills and UI skills Experience with designing and implementing high volume data processing jobs is a required. Working knowledge of Spark on EMR is a preferred. Strong database development skills, including advanced SQL, relational and NoSQL database technologies. Experience with AWS technologies are required. Strong analytical and more »

of Database development experience and a background in an OO language. This role offers the chance to gain exposure in the following technology AWS EMR, Redshift, Kafka Angular/Java (making changes to reflect changes in the data warehouse) By applying to this job you are sending us your more »

Over 2 million Sellers in 10 countries list their products for sale on the Amazon Marketplace. Sellers are a critical part of Amazons ecosystem to deliver on our vision of offering the Earths largest selection and lowest prices. Since Brexit, Sellers from outside the UK experience greater customs … invest more (cost and time) to move inventory into the UK. There are also increasing blockers for UK Sellers to export to other Amazon marketplaces. UK Global Selling aims to make the experience for Sellers simpler and more predictable to improve the return on their investment so that … and data mining PREFERRED QUALIFICATIONS Advanced Degree in Computer Science, Mathematics, Statistics, Finance, or related field Familiarity with AWS services such as S3, Redshift, EMR, Athena, etc. Experience with Machine Learning projects Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is more »

strong emphasis on Java and EMR. Implement and optimise data models and algorithms to extract valuable insights from large datasets. Utilise AWS services, including EMR, Glue, and Iceberg, for data storage, processing, and ingestion. Ensure data quality and integrity by implementing robust validation and monitoring processes. Collaborate with cross … engineering, with a focus on managing and processing financial data. Proficiency in Python and Java, with a strong preference for Java, and experience with EMR for data processing. Solid understanding of data modelling concepts and experience with relevant modelling languages. Hands-on experience with AWS services, including but not … limited to EMR, Glue, and S3. Prior experience with Iceberg for data storage and Glue for data ingestion is highly desirable. Strong SQL skills and experience with relational databases. Proven track record of delivering high-quality data solutions in a fast-paced environment. Excellent communication and collaboration skills, with more »

boundaries through multiple data centers and AWS regions. Your Profile Key skills/knowledge/experience: Experience of AWS Data platform experience including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS … DevSecOps pipelines. Experience in data security areas in AWS like IAM, Cloudwatch, Cloudtrail, Inspector. Hands on experience in architecture of the data workloads in EMR\Clusters. Designs system architecture to integrate easily with other AWS services. Strong background in technologies like Spark, Hive and Pyspark. Key Experience: Experience of more »

the adoption of best practices (agile methodologies, continuous improvement) in software engineering and product development. Design and lead software integration with external vendors (PACS, EMR) and business partners. Manage translation, user interface, and user documentation, adhering to human factors engineering principles and usability testing. Collaborate with leadership to align … performing product development teams across the entire lifecycle. Experience managing software development, UI/UX/workflow design, testing, SaaS security, and PACS/EMR integration. Worked with Cloud based SaaS (ideally AWS) Ideally some familiarity with Ai/ML for diagnosis Benefits Competitive salary, with share options and more »

AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Experience working with various types of databases like Relational, NoSQL more »

teams to integrate image processing modules into web applications using React.js. Deploy, configure, and manage production systems on AWS, with a focus on AWS EMR for big data processing. Implement continuous integration and deployment pipelines using Jenkins for efficient code deployment. Ensure observability of systems through proper logging, monitoring … experience in React.js. - Experience with code deployment tools such as Jenkins and version control systems like Git. - In-depth knowledge of AWS services, particularly EMR, S3, Lambda, networking, and permissions management. - Familiarity with observability tools for monitoring and logging production systems. - Experience with database management systems and website authentication more »

data products being delivered on AWS - Deliver and maintain logical and physical architectural patterns composing their data products. Technical experience required: - AWS- based data: EMR, Quicksight, Glue, MWAA, Dynamo, Kinesis, Kafka - Azure Datalake - AWS cloud data platform security and infrastructure Non-Technical skills required: - Stakeholder management, you'll be more »

PHP 8+ Experience with Laravel/Symfony framework Strong grasp of JavaScript/TypeScript Familiarity with AWS services including Aurora, MSK Kafka, ECS, and EMR Solid understanding of SQL Key Responsibilities: Collaborate with a talented team to conceptualise, develop, and deploy scalable web applications Write clean, efficient, and maintainable more »