17 of 17 Amazon EMR Jobs

Skills Expected Candidate should have experience with one or more of the following AWS services: Amazon S3 AWS Glue Amazon EMR AWS Lambda AWS Step Functions Amazon Redshift Amazon Athena Amazon RDS/Aurora AWS IAM AWS KMS Amazon ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

higher) Azure AI Fundamentals (awareness of cloud ML/AI services) Desirable Experience AWS and Big Data: Hands-on experience with AWS (S3, EMR, Lambda, Redshift, Athena) and PySpark/Python for large-scale batch processing. CI/CD and DevOps: Experience with Git/GitLab workflows, automated testing ...

Azure AI Fundamentals (or practical awareness of ML/AI services). Desirable Experience Big Data and Cloud Processing: Hands-on experience with AWS (EMR, S3, Lambda, Redshift, Athena, CloudWatch) and PySpark/Python for large-scale batch processing. DevOps and CI/CD: Familiarity with automated testing pipelines ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

DevOps, CI/CD and software testing. • Expertise with one of programming languages such as SQL, or Python. • Have working experience of AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services. • Experience with Data platform tools like Databricks and/or Snowflake. • Be able ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

pipelines across from raw to polished layers using Cloud native services such asS3, Glue (ETL & Data Catalog), Lake Formation, Redshift, Athena, EMR/Spark, Kinesis/MSK, Step Functions, Lambda, EventBridge. Define storage/format strategies (e.g.,Parquet/Delta/Apache Iceberg) and partitioning, compaction, and indexing … solutions, includinghands-onwork with bothtraditional DBMSandcloud nativedata platforms. 5+ yearsbuilding on cloud platformswith production experience in several of:S3, Glue, Lake Formation, Redshift, Athena, EMR/Spark, Kinesis/MSK, Lambda, Step Functions, EventBridge, SageMaker. Demonstrated expertise implementingdata propagation Lakehousepatterns and governanceat scale. Proven track record supportingAI/MLworkloads ...

ideally on AWS using IaC You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analytics You have experience of designing and operating data ingestion pipelines at scale (batch ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

/60 PM counter granularity and able to write codes for aggregation Build and optimize distributed data processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse Work with Amazon MSK (Kafka) for real‐time ...

Amazon Web Services Open Data Analytics (ODA) organization … looking for exceptional engineers to help in our mission to provide the world's best cloud Big Data processing platform and services such as EMR and Athena. The ODA engines team is looking for an experienced engineer to join the core engines and datalake team. Athena and EMR ...

This is an excellent opportunity to join Amazon's world class technical team in Herndon, VA, working with some of the best and brightest engineers and technical managers while also developing your skills and furthering your career within one of the most innovative and progressive technology companies anywhere. … Web Service is building some of the largest distributed systems in the world. Amazon's database offerings like Aurora, DynamoDB, EMR, OpenSearch, RDS, and Redshift are massively scaled services that make up a critical piece of the internet today. A successful Engineer joining the team ...

firewall management, connectivity solutions, infrastructure integration, and cyber security initiatives across clinics and corporate locations. You will play a key role in supporting partnerships, EMR integrations, and infrastructure modernisation programmes, ensuring all solutions remain secure, compliant, and aligned with enterprise standards. The role: Core IT Infrastructure & Network Delivery Cyber … Enterprise Networking Environments Hands-on experience managing firewalls and secure VPN connectivity. Experience working within multi-site or enterprise-scale environments. Desirable Knowledge of EMR/EPR integrations. Understanding of Cyber Essentials, DSPT and Zero Trust security principles. Experience supporting cloud networking environments within Azure and/or AWS. ...