1 to 25 of 37 Amazon EMR Jobs

Benefits Job typePermData Engineer (AWS) – Manchester(Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer)Our client is a global innovator … Nathan Warner at Noir Consulting.(Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer)NOIRUKTECHRECNOIRUKREC ...

Engineer (AWS) – Manchester(Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer)Our client … Noir Consulting.(Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer)NOIRUKTECHRECNOIRUKREC ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

higher) Azure AI Fundamentals (awareness of cloud ML/AI services) Desirable Experience AWS and Big Data: Hands-on experience with AWS (S3, EMR, Lambda, Redshift, Athena) and PySpark/Python for large-scale batch processing. CI/CD and DevOps: Experience with Git/GitLab workflows, automated testing ...

Azure AI Fundamentals (or practical awareness of ML/AI services). Desirable Experience Big Data and Cloud Processing: Hands-on experience with AWS (EMR, S3, Lambda, Redshift, Athena, CloudWatch) and PySpark/Python for large-scale batch processing. DevOps and CI/CD: Familiarity with automated testing pipelines ...

DevOps, CI/CD and software testing. • Expertise with one of programming languages such as SQL, or Python. • Have working experience of AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services. • Experience with Data platform tools like Databricks and/or Snowflake. • Be able ...

integrated toolingProficiency in Python, Scala, or Java in a production data platform contextSolid understanding of cloud-native data infrastructure (AWS preferred — Glue, Athena, S3, EMR, Lambda, or equivalents)Track record of managing, recruiting, and developing high-performing remote engineering teamsAbility to translate long-term platform vision into executable quarterly ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

Engineer) (Preferred)LanguagesEnglish (Preferred)Spanish (Preferred)Hard SkillsPractical experience with AWS cloud architecture, including services like S3, IAM, VPC, KMS, CloudWatch, CloudTrail, Glue, Athena, EMR, Lambda, Step Functions, and SageMaker. (Preferred)Skilled in SQL and NoSQL databases for implementing data warehouses and data lakes. (Preferred)Experienced in data ingestion … processing, transformation, and delivery using batch, streaming, and real-time methods. (Preferred)Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred)Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

cases.Develop data models and Data Lake designs around stated use cases to capture KPIs and data transformations.Identify relevant AWS services - on Amazon EMR, Redshift, Athena, Glue, Lambda, to design an architecture that can support client workloads/use-cases; evaluate pros/cons among the identified options ...

Linux skills and proficiency in Python for automation and integrationFamiliarity with infrastructure as code, using Terraform or AnsibleDeep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAAExperience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetryStrong problem-solving skills ...

exposure to the following will be good to have else we will be enable you with the required trainingAWS Glue and Data Catalog, EMR, Athena, S3, Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure ...

pipelines across from raw to polished layers using Cloud native services such asS3, Glue (ETL & Data Catalog), Lake Formation, Redshift, Athena, EMR/Spark, Kinesis/MSK, Step Functions, Lambda, EventBridge. Define storage/format strategies (e.g.,Parquet/Delta/Apache Iceberg) and partitioning, compaction, and indexing … solutions, includinghands-onwork with bothtraditional DBMSandcloud nativedata platforms. 5+ yearsbuilding on cloud platformswith production experience in several of:S3, Glue, Lake Formation, Redshift, Athena, EMR/Spark, Kinesis/MSK, Lambda, Step Functions, EventBridge, SageMaker. Demonstrated expertise implementingdata propagation Lakehousepatterns and governanceat scale. Proven track record supportingAI/MLworkloads ...

ideally on AWS using IaC You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analytics You have experience of designing and operating data ingestion pipelines at scale (batch ...

computing frameworksExperience with enterprise-scale implementations of cloud-native data platforms such as Databricks and SnowflakeGood understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutionsExperience navigating complex data governance ...

Build & deliver Design and develop scalable, testable data pipelines using Python and Apache Spark Build and orchestrate data workflows using AWS services (e.g. Glue, EMR Serverless, Lambda, S3) Contribute to the evolution of a modern lakehouse architecture (e.g. Apache Iceberg) Work with relational databases, particularly PostgreSQL/Aurora PostgreSQL ...

impact-scalability tradeoff into account.Some skills that will make you stand out: Apache Spark, Iceberg, Kafka, dbtScikit-Learn, XGBoost, PyTorch, MLFlow,, GraphFrames, RayAWS (S3, EMR, SageMaker, Lakeformation), Terraform, Docker, GitHub CI/CDKnowledge Graphs (+ RAG), graph ML, probabilistic programming, A/B testingAdditional InformationFor everyone, everywhere. ...

understand complex business requirements and render them as prototype systems with quick turnaround time.Implementation and tuning experience in the Big Data Ecosystem, (such as EMR, Hadoop, Spark, R, Presto, Hive), Database (such as Oracle, MySQL, PostgreSQL, MS SQL Server), NoSQL (such as DynamoDB, HBase, MongoDB, Cassandra, design principles ...

digital platformsOur technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.)PySparkAWS cloud infrastructure: EMR, ECS, Athena, etcMLOps/DevOps: Terraform, Docker, Airflow, MLFlowMonitoring and evaluation platforms including New Relic and BraintrustMore information:Enjoy fantastic perks like private healthcare ...

Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. We offer talented security professionals the chance to accelerate their careers with … development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations- Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Experience developing, deploying and managing AI products at scaleAmazon is an equal opportunities employer. We believe passionately that employing ...