21 of 21 Amazon EMR Jobs

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena, and related services. Implement lakehouse architecture using Databricks, Delta Lake, and AWS S3. Build data ingestion pipelines from ...

GitLab , and CI/CD pipelines. Understanding of AWS security best practices, IAM, and RBAC. Desirable Skills Experience with Athena, SQS, CloudWatch, CloudTrail, or EMR . Knowledge of Terraform or CloudFormation . Experience in consultancy or client-facing environments. Personal Attributes Strong problem-solving and troubleshooting skills. Excellent communication ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

data analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

expertise with Infrastructure as Code (Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements ...

experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data technologies including Glue, EMR, Lambda, DynamoDB, S3, EventBridge, Step Functions and related services Proven experience building Data Lakehouse platforms, Data Products and ELT/ETL frameworks supporting analytics ...

pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you can expect Work to agile best practices and cross-functionally with multiple teams and stakeholders. ...

Desirable Skills \n \n Hands-on experience with Apache NiFi for data pipeline development and orchestration \n AWS experience including familiarity with EMR, S3 and SQS \n Awareness of domain-driven design approaches and architecture \n Linux awareness and Scripting skills \n PostgreSQL and PL/SQL knowledge ...

/CD tooling including Git Desirable Skills Hands-on experience with Apache NiFi for data pipeline development and orchestration AWS experience including familiarity with EMR, S3 and SQS Awareness of domain-driven design approaches and architecture Linux awareness and Scripting skills PostgreSQL and PL/SQL knowledge ...

metrics and KPIs to verify and automate management of data quality. \n Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions). \n\n \n Desirable Skills \n \n \n Working experience ...

designing metrics and KPIs to verify and automate management of data quality.\ NGood working experience of AWS (e.G. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.G. ADF, Synapse, Fabric, Azure Functions).\ N\n \nDesirable Skills\ N \n\nWorking experience in Data Lakehouse ...

metrics and KPIs to verify and automate management of data quality. \n Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions). \n\n Desirable Skills \n \n Working experience in Data Lakehouse ...

metrics and KPIs to verify and automate management of data quality. \n Good working experience of AWS (e.g. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.g. ADF, Synapse, Fabric, Azure Functions). \n\n Desirable Skills \n \n Working experience in Data Lakehouse ...

designing metrics and KPIs to verify and automate management of data quality. \ NGood working experience of AWS (e.G. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.G. ADF, Synapse, Fabric, Azure Functions). \ N\nDesirable Skills\ N\nWorking experience in Data Lakehouse environments such ...

designing metrics and KPIs to verify and automate management of data quality. \ NGood working experience of AWS (e.G. S3, Kinesis, Glue, Redshift, Lambda and EMR) and/or Azure data services (e.G. ADF, Synapse, Fabric, Azure Functions). \ N\nDesirable Skills\ N\nWorking experience in Data Lakehouse environments such ...

enterprise-scale implementations of cloud-native data platforms such as Databricks and Snowflake\ N\n Good understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutions\ N\n Experience navigating ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Solution Architect delivering enterprise AWS data platforms. Strong hands-on expertise with: AWS S3 AWS Glue AWS Lake Formation Amazon Redshift Athena EMR Experience designing modern data lakes, lakehouse architectures, data integration pipelines, and analytics platforms. Strong understanding of data governance, security, metadata management, and data architecture ...

Rate: Competitive - Outside IR35 Industry: Technology/Data & AI What You’ll Be Doing? Design, build, and maintain a scalable MLOps platform using Amazon SageMaker, covering model training, deployment, pipelines, monitoring, and governance. Lead the migration of a complex suite of production machine learning models from legacy platforms … experience. Knowledge of Infrastructure as Code using Terraform, CloudFormation, or CDK is advantageous. Familiarity with AWS services including Step Functions, Lambda, CloudWatch, CloudTrail, Glue, EMR, Lake Formation, Feature Store, and VPC networking would be beneficial. Experience with data governance, security, and compliance within cloud environments. Ability to lead technical ...

DevOps Engineer, Platform Engineer or Cloud Engineer. Strong AWS experience, ideally within production-scale environments. Hands-on experience with Kubernetes, ideally Amazon EKS. Experience with observability and monitoring tools such as Dynatrace, Prometheus, Grafana, CloudWatch, OpenTelemetry, ELK or similar. Understanding of SLIs, SLOs, error budgets and golden signals. … Experience working with data platforms, data pipelines or data-heavy environments. Exposure to batch or streaming data workloads, such as Kafka, Spark, Airflow, Glue, EMR, Databricks or similar. Data observability experience. Previous public sector experience across multiple engagements. Consultancy experience would be beneficial, especially within environments such as Capgemini ...