1 to 25 of 34 Amazon EMR Jobs

Azure Data Lake Storage Power BI Microsoft Purview AWS Glue AWS Lake Formation Amazon Redshift Amazon Athena Amazon EMR Amazon S3 SQL, Python, and PySpark CI/CD pipelines and DevOps practices Infrastructure as Code (Terraform preferred) Data Mesh, Master Data ...

Experience working within Azure environments. Strong SQL skills and understanding of modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab ...

GitLab , and CI/CD pipelines. Understanding of AWS security best practices, IAM, and RBAC. Desirable Skills Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR . Knowledge of Terraform or CloudFormation . Experience in consultancy or client-facing environments. Personal Attributes Strong problem-solving and troubleshooting skills. Excellent communication ...

data analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

data analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

expertise with Infrastructure as Code (Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements ...

Remote (occasional expensed travel to Leeds/Newcastle) Clearance: Active SC Clearance required Rate: Up to £425/day (Inside IR35) Tech Stack: AWS (EMR, S3, Lambda), PySpark, Python, SQL, CI/CD Focus: Building scalable pipelines, modernising ETL, supporting MI/Power BI Level: Mid to Senior - mentoring ...

Languages English (Preferred) Spanish (Preferred) Hard Skills Practical experience with AWS cloud architecture, including services like S3, IAM, VPC, KMS, CloudWatch, CloudTrail, Glue, Athena, EMR, Lambda, Step Functions, and SageMaker. (Preferred) Skilled in SQL and NoSQL databases for implementing data warehouses and data lakes. (Preferred) Experienced in data ingestion … processing, transformation, and delivery using batch, streaming, and real-time methods. (Preferred) Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). ...

functional teams to deliver end-to-end solutions Key Skills & Experience: Strong expertise in AWS cloud services, including: CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing … Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/or Amazon Athena for data querying and validation Strong understanding of EMR and log analysis Experience with GitLab for CI/CD pipelines, release tagging, and version control Knowledge of Docker and containerisation Understanding of encryption ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache NiFi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain-driven design approaches and architecture Linux awareness and Scripting skills Postgres/PL/SQL knowledge Key Strengths: Self ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache NiFi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain-driven design approaches and architecture Linux awareness and Scripting skills Postgres/PL/SQL knowledge Key Strengths: Self ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache Nifi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain driven design approaches and architecture Linux awareness and Scripting skills Postgress/PLSQL knowledge Key Strengths: Self starter ...

principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache Nifi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain driven design approaches and architecture Linux awareness and Scripting skills Postgress/PLSQL knowledge Key Strengths: Self starter ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience ...

Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/ ...

Job Description AWS Data Engineer (Active SC) Full time/perm Our client is seeking Security Cleared AWS Data Engineers at all levels to design, build, and support scalable cloud-based data solutions. You will ...

technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More information Enjoy fantastic perks like ...

causes Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures Validate data using tools such as Jupyter Notebooks and Amazon Athena Analyse data across multiple formats to ensure integrity and correctness of new functionality Support CI/CD practices using Git-based workflows … slowly changing dimensions Ability to generate realistic test data for various scenarios Additional Knowledge Understanding of distributed data platforms and big data environments (e.g., EMR) Knowledge of encryption principles (client-side and server-side) Awareness of production system monitoring and incident analysis Soft Skills Strong analytical and problem-solving ...

governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance PREFERRED QUALIFICATIONS - Experience in IT implementation - Data quality and lineage frameworks - Data security, compliance … access controls - Performance optimization for data processing workloads - Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion ...

governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance - Data quality and lineage frameworks PREFERRED QUALIFICATIONS - Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure - Data security, compliance, and access controls - Performance optimization for data processing workloads - Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance - Data quality and lineage frameworks PREFERRED QUALIFICATIONS - Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure - Data security, compliance, and access controls - Performance optimization for data processing workloads - Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business … Engineering, Computer Science or related field, or experience working with or evaluating AI systems - Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central ...