19 of 19 Amazon EMR Jobs

Azure Data Lake Storage Power BI Microsoft Purview AWS Glue AWS Lake Formation Amazon Redshift Amazon Athena Amazon EMR Amazon S3 SQL, Python, and PySpark CI/CD pipelines and DevOps practices Infrastructure as Code (Terraform preferred) Data Mesh, Master Data ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

Experience working within Azure environments. Strong SQL skills and understanding of modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab ...

/Hybrid Duration: 5 months Essential Skills: Informatica Data project experience AWS Azure Desirable Skills: Hands-on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large-scale batch processing. Data engineering at scale in government or similarly complex domains, including ...

GitLab , and CI/CD pipelines. Understanding of AWS security best practices, IAM, and RBAC. Desirable Skills Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR . Knowledge of Terraform or CloudFormation . Experience in consultancy or client-facing environments. Personal Attributes Strong problem-solving and troubleshooting skills. Excellent communication ...

data analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

expertise with Infrastructure as Code (Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements ...

Remote (occasional expensed travel to Leeds/Newcastle) Clearance: Active SC Clearance required Rate: Up to £425/day (Inside IR35) Tech Stack: AWS (EMR, S3, Lambda), PySpark, Python, SQL, CI/CD Focus: Building scalable pipelines, modernising ETL, supporting MI/Power BI Level: Mid to Senior - mentoring ...

technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More information Enjoy fantastic perks like ...

causes Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures Validate data using tools such as Jupyter Notebooks and Amazon Athena Analyse data across multiple formats to ensure integrity and correctness of new functionality Support CI/CD practices using Git-based workflows … slowly changing dimensions Ability to generate realistic test data for various scenarios Additional Knowledge Understanding of distributed data platforms and big data environments (e.g., EMR) Knowledge of encryption principles (client-side and server-side) Awareness of production system monitoring and incident analysis Soft Skills Strong analytical and problem-solving ...

governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance PREFERRED QUALIFICATIONS - Experience in IT implementation - Data quality and lineage frameworks - Data security, compliance … access controls - Performance optimization for data processing workloads - Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion ...

governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance PREFERRED QUALIFICATIONS - Experience in IT implementation - Data quality and lineage frameworks - Data security, compliance … access controls - Performance optimization for data processing workloads - Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your experience and skills. We value your passion ...

governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance - Data quality and lineage frameworks PREFERRED QUALIFICATIONS - Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure - Data security, compliance, and access controls - Performance optimization for data processing workloads - Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

governance frameworks - Data modeling and schema design for analytics workloads - Modern data platform design and implementation - ETL/ELT pipeline development and optimization (Glue, EMR) - Data warehousing solutions (Redshift) - Data catalog management and metadata governance - Data quality and lineage frameworks PREFERRED QUALIFICATIONS - Experience and technical expertise (design and implementation … data center or data center to cloud infrastructure - Data security, compliance, and access controls - Performance optimization for data processing workloads - Big data processing platforms (EMR, Glue) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make ...

Analytics, UKI, AWS UKI Specialist Team Job ID: 3200750 | AWS EMEA SARL (UK Branch) Do you want to own driving the adoption of Amazon Web Services (AWS) in UKI’s largest and most innovative companies? Want to be part of a cross-functional team focused on increasing technology … Data & Analytics, you will drive customer adoption of Amazon Web Services (AWS) Data and Analytics services (i.e. Redshift, Search (ElasticSearch, CloudSearch), EMR, Athena, Kinesis, Glue, and other Data Services) across UK and Ireland. Customer applications that are built to operate at scale need services with high throughput ...

want to own driving the adoption of Amazon Web Services (AWS) in UKIs largest and most innovative companies? Want to be part of a cross-functional team focused on increasing technology adoption of cloud computing by engaging directly with C-level executives and influencers at all levels … Data & Analytics, you will drive customer adoption of Amazon Web Services (AWS) Data and Analytics services (i.e. Redshift, Search (ElasticSearch, CloudSearch), EMR, Athena, Kinesis, Glue,, and other Data Services) across UK and Ireland. Customer applications that are built to operate at scale need services with high throughput ...

want to own driving the adoption of Amazon Web Services (AWS) in UKIs largest and most innovative companies? Want to be part of a cross-functional team focused on increasing technology adoption of cloud computing by engaging directly with C-level executives and influencers at all levels … Data & Analytics, you will drive customer adoption of Amazon Web Services (AWS) Data and Analytics services (i.e. Redshift, Search (ElasticSearch, CloudSearch), EMR, Athena, Kinesis, Glue,, and other Data Services) across UK and Ireland. Customer applications that are built to operate at scale need services with high throughput ...

Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business … Engineering, Computer Science or related field, or experience working with or evaluating AI systems - Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central ...

Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business … Engineering, Computer Science or related field, or experience working with or evaluating AI systems - Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central ...