SQL queries and good understanding of data model, python knowledge is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.) Experience in DevOps development and deployment using ontainer platforms About S&P Global Ratings At S&P Global Ratings, our More ❯
SQL queries and good understanding of data model, python knowledge is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.) Experience in DevOps development and deployment using ontainer platforms About S&P Global Ratings At S&P Global Ratings, our More ❯
Amazon Music is awash in data! To help make sense of it all, the DISCO (Data, Insights, Science & Optimization) team: (i) enables the Consumer Product Tech org make data driven decisions that improve the customer retention, engagement and experience on Amazon Music. We build and maintain … you. We collect billions of events a day, manage petabyte scale data on Redshift and S3, and develop data pipelines using Spark/Scala EMR, SQL based ETL, Airflow and Java services. We are looking for talented, enthusiastic, and detail-oriented Data Engineer, who knows how to take on … marketing and provides and protects a robust self-service core data experience for all internal customers. We deal in AWS technologies like Redshift, S3, EMR, EC2, DynamoDB, Kinesis Firehose, and Lambda. Your team will manage the data exchange store (Data Lake) and EMR/Spark processing layer using More ❯
with one or more of the following would also be beneficial: Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus. A team player - we highly regard collaboration. Knowledge More ❯
Altrincham, Cheshire, United Kingdom Hybrid / WFH Options
INRIX, Inc
Familiarity one or more of the following would also be beneficial : Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus A team player - we highly regard collaboration. Knowledge More ❯
HBase, MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS services such as CloudWatch, CloudTrail, ELB, EMR, KMS, SQS, SNS, and Systems Manager. Experience in mobile pla?orm development, such as web mobile, Android, microservices Working knowledge using proxies and proxy More ❯
preferred; other languages include Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda, etc.). Excellent communication, organization, and prioritization skills, with a strong ability to deliver results within tight timelines. Passionate about working with small More ❯
NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala More ❯
with other languages including Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda etc.). Excellent communication, organisation and prioritisation skills, and have a strong ability to deliver results within tight timelines. Passionate to work with More ❯
Kafka and Kinesis DataHub ML Flow and Airflow Docker and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and EMR for our Data Lake Elasticsearch and DynamoDB More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy More ❯
use AWS services such as AmazonElastic Compute Cloud (EC2), S3, AWS Glue, DynamoDB NoSQL, Relational Database Service (RDS), Elastic Map Reduce (EMR) and Amazon Redshift. Solutions: Deliver on-site technical engagements with partners and customers. This includes participating in pre-sales on-site visits … is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's … in working with data lakes, modern data architectures, Lambda type architectures Proficiency in writing and optimizing SQL Knowledge of AWS services including S3, Redshift, EMR, Kinesis and RDS Experience with Open Source Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.) Ability to write code in Python, Ruby, Scala or More ❯
2. (Mandatory) Demonstrated experience with AWS cloud services, including long-term storage options, and cloud-based database services such as Databricks or ElasticMapReduce (EMR). 3. (Mandatory) Demonstrated experience with SQL database structures and mapping between SQL databases. 4. (Mandatory) Demonstrated experience in large-scale data migration efforts. More ❯
2. (Mandatory) Demonstrated experience with AWS cloud services, including long-term storage options, and cloud-based database services such as Databricks or ElasticMapReduce (EMR). 3. (Mandatory) Demonstrated experience with SQL database structures and mapping between SQL databases. 4. (Mandatory) Demonstrated experience in large-scale data migration efforts. More ❯
of an Agile engineering or development team. Strong hands-on experience and understanding of working in a cloud environment such as AWS. Experience with EMR (Elastic Map Reduce), Spark. Strong experience with CI/CD pipelines with Jenkins. Experience with the following technologies: SpringBoot, Gradle, Terraform, Ansible, GitHub/ More ❯
Chantilly, Virginia, United States Hybrid / WFH Options
The DarkStar Group
databases, and services. Cloud infrastructure is deployed using AWS C2S available services in the IDL VPC boundaries. Commonly used AWS tools include Managed OpenSearch, EMR, EC2, Lambdas, etc. Microservices and Kubernetes container orchestration is used to deploy applications in a managed way Working with the ISSM and various networking More ❯
infrastructure security practices, including data privacy, model security, and compliance standards like GDPR and SOC 2. Familiarity with AWS big data tools (Redshift, Glue, EMR) for processing large datasets to support machine learning models. Preferred Qualifications: AWS Certified Machine Learning - Specialty or other relevant certifications. Experience with machine learning More ❯
and how to apply them within Hadoop. - Prior working experience with AWS - any or all of EC2, S3, EBS, ELB, RDS, DynamoDB, EMR. Amazon is an equal opportunities employer, and we value your passion to discover, invent, simplify and build. We welcome applications from all members of society More ❯
experience as a Data Engineer. Demonstrated experience with AWS cloud services, including long-term storage options, and cloud-based database services (e.g., Databricks or EMR). Proficiency in SQL database structures and mapping between SQL databases. Experience with large-scale data migration efforts. Experience with database architecture, performance design More ❯
Preferred Qualifications: Domain knowledge in Financial Industry and Capital Markets is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.). Experience in DevOps development and deployment using Docker and containers. Python experience is a plus. About S&P Global More ❯
principles, methodologies, and tools, including GitLab CI/CD and Jenkins Experience with distributed data and computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience leading a team of AI and ML engineers, researchers, and data scientists to develop and deploy advanced AI and ML technologies More ❯
more of what they want - low prices, vast selection, and convenience - continues to grow and evolve as a world-class e-commerce platform. Amazon's evolution from Web site to e-commerce partner to development platform is driven by the spirit of innovation that is part of the … develop technology that improves the lives of shoppers and sellers around the world. About Team The RBS team is an integral part of Amazon online product lifecycle and buying operations. The team is designed to ensure Amazon remains competitive in the online retail space with the … best price, wide selection and good product information. The team's primary role is to create and enhance retail selection on the worldwide Amazon online catalog. The tasks handled by this group have a direct impact on customer buying decisions and online user experience. Overview of the role More ❯
HBase, MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS services such as CloudWatch, CloudTrail, ELB, EMR, KMS, SQS, SNS, and Systems Manager. Experience in suppor?ng, maintaining, and migra?ng JavaFX applica?ons to modern cloud-na?ve solu?ons. More ❯
HBase, MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS services such as CloudWatch, CloudTrail, ELB, EMR, KMS, SQS, SNS, and Systems Manager. Experience in suppor?ng, maintaining, and migra?ng JavaFX applica?ons to modern cloud-na?ve solu?ons. More ❯
