22 of 22 Amazon EMR Jobs

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

higher) Azure AI Fundamentals (awareness of cloud ML/AI services) Desirable Experience AWS and Big Data: Hands-on experience with AWS (S3, EMR, Lambda, Redshift, Athena) and PySpark/Python for large-scale batch processing. CI/CD and DevOps: Experience with Git/GitLab workflows, automated testing ...

Azure AI Fundamentals (or practical awareness of ML/AI services). Desirable Experience Big Data and Cloud Processing: Hands-on experience with AWS (EMR, S3, Lambda, Redshift, Athena, CloudWatch) and PySpark/Python for large-scale batch processing. DevOps and CI/CD: Familiarity with automated testing pipelines ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

DevOps, CI/CD and software testing. • Expertise with one of programming languages such as SQL, or Python. • Have working experience of AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services. • Experience with Data platform tools like Databricks and/or Snowflake. • Be able ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect ð Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

Engineer) (Preferred)LanguagesEnglish (Preferred)Spanish (Preferred)Hard SkillsPractical experience with AWS cloud architecture, including services like S3, IAM, VPC, KMS, CloudWatch, CloudTrail, Glue, Athena, EMR, Lambda, Step Functions, and SageMaker. (Preferred)Skilled in SQL and NoSQL databases for implementing data warehouses and data lakes. (Preferred)Experienced in data ingestion … processing, transformation, and delivery using batch, streaming, and real-time methods. (Preferred)Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred)Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...

Linux skills and proficiency in Python for automation and integrationFamiliarity with infrastructure as code, using Terraform or AnsibleDeep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAAExperience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetryStrong problem-solving skills ...

pipelines across from raw to polished layers using Cloud native services such asS3, Glue (ETL & Data Catalog), Lake Formation, Redshift, Athena, EMR/Spark, Kinesis/MSK, Step Functions, Lambda, EventBridge. Define storage/format strategies (e.g.,Parquet/Delta/Apache Iceberg) and partitioning, compaction, and indexing … solutions, includinghands-onwork with bothtraditional DBMSandcloud nativedata platforms. 5+ yearsbuilding on cloud platformswith production experience in several of:S3, Glue, Lake Formation, Redshift, Athena, EMR/Spark, Kinesis/MSK, Lambda, Step Functions, EventBridge, SageMaker. Demonstrated expertise implementingdata propagation Lakehousepatterns and governanceat scale. Proven track record supportingAI/MLworkloads ...

ideally on AWS using IaC You have experience with Lakehouse and modern Data Warehouse patterns; AWS S3-based Lakehouse patterns, Athena/Redshift, Glue, EMR and related native services and Metabase for self-service analytics You have experience of designing and operating data ingestion pipelines at scale (batch ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

understand complex business requirements and render them as prototype systems with quick turnaround time.Implementation and tuning experience in the Big Data Ecosystem, (such as EMR, Hadoop, Spark, R, Presto, Hive), Database (such as Oracle, MySQL, PostgreSQL, MS SQL Server), NoSQL (such as DynamoDB, HBase, MongoDB, Cassandra, design principles ...

Trino.,Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi) and Serverless data concepts.Familiarity with mainstream global cloud products such as AWS EMR/Redshift, Google BigQuery, Snowflake, and Databricks.,Ability to perform competitive analysis and develop differentiation strategies.Soft Skills: Excellent logical thinking, communication skills ...

real-time streaming pipelines, business intelligence, and advanced analytics leveraging the breadth of AWS's analytics portfolio including Amazon Redshift, Athena, EMR, Glue, Kinesis, QuickSight, and OpenSearch.You'll serve as a trusted technical advisor to enterprise customers navigating complex analytics modernisation challenges whether migrating from legacy … thought leadership, workshops, and reference architectures.Key job responsibilitiesArchitect analytics solutions — design data lake, lakehouse, warehouse, and streaming architectures using AWS analytics services (Redshift, Athena, EMR, Glue, Kinesis, QuickSight, OpenSearch)Lead analytics modernisation — guide customers migrating from legacy platforms (Teradata, Oracle, Netezza, Hadoop) to cloud-native analytics, including ETL refactoring ...

software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics).- Experience with data infrastructures: relational analytic DBMS, Elastic-Search, and Big Data EMR/EC2/Glue/Lambda, or experience with training and deploying machine learning systems to solve large-scale optimizations- Experience communicating across technical … Database, and/or Storage- PhD in computer science, machine learning, engineering, or related fields, or experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Knowledge of general AI tools- Knowledge of data engineering pipelines, cloud solutions, ETL management, databases, visualizations and analytical platforms- Experience ...

/60 PM counter granularity and able to write codes for aggregation Build and optimize distributed data processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse Work with Amazon MSK (Kafka) for real‐time ...

Amazon Web Services Open Data Analytics (ODA) organization … looking for exceptional engineers to help in our mission to provide the world's best cloud Big Data processing platform and services such as EMR and Athena. The ODA engines team is looking for an experienced engineer to join the core engines and datalake team. Athena and EMR ...

This is an excellent opportunity to join Amazon's world class technical team in Herndon, VA, working with some of the best and brightest engineers and technical managers while also developing your skills and furthering your career within one of the most innovative and progressive technology companies anywhere. … Web Service is building some of the largest distributed systems in the world. Amazon's database offerings like Aurora, DynamoDB, EMR, OpenSearch, RDS, and Redshift are massively scaled services that make up a critical piece of the internet today. A successful Engineer joining the team ...

firewall management, connectivity solutions, infrastructure integration, and cyber security initiatives across clinics and corporate locations. You will play a key role in supporting partnerships, EMR integrations, and infrastructure modernisation programmes, ensuring all solutions remain secure, compliant, and aligned with enterprise standards. The role: Core IT Infrastructure & Network Delivery Cyber … Enterprise Networking Environments Hands-on experience managing firewalls and secure VPN connectivity. Experience working within multi-site or enterprise-scale environments. Desirable Knowledge of EMR/EPR integrations. Understanding of Cyber Essentials, DSPT and Zero Trust security principles. Experience supporting cloud networking environments within Azure and/or AWS. ...