16 of 16 Amazon EMR Jobs

within UK Central Government. What You'll Be Doing Design, build, and maintain production-grade data pipelines using AWS services including Amazon EMR, S3 and Lambda. Develop scalable data processing solutions using PySpark, Python and SQL with a focus on performance, resilience, testing and observability. Lead … experience delivering data engineering solutions within UK Central Government. Strong commercial experience with Informatica. Hands-on expertise with AWS services including Amazon EMR, S3 and Lambda. Advanced PySpark, Python and SQL skills for large-scale data processing. Experience building and maintaining enterprise-scale batch data pipelines. Strong ...

Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client … Noir Consulting. (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) NOIRUKTECHREC NOIRUKREC ...

notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such as S3, Glue, Lambda, EMR, IAM, KMS, CloudWatch, Secrets Manager, Athena, and related services. Implement lakehouse architecture using Databricks, Delta Lake, and AWS S3. Build data ingestion pipelines from ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

data analysis, profiling and insight delivery Cloud & Platforms Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow SQL Server stack (SSIS, SSRS) Engineering Practices CI/CD for data platforms ...

expertise with Infrastructure as Code (Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements ...

experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data technologies including Glue, EMR, Lambda, DynamoDB, S3, EventBridge, Step Functions and related services Proven experience building Data Lakehouse platforms, Data Products and ELT/ETL frameworks supporting analytics ...

functional teams to deliver end-to-end solutions Key Skills & Experience: Strong expertise in AWS cloud services, including: CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing … Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/or Amazon Athena for data querying and validation Strong understanding of EMR and log analysis Experience with GitLab for CI/CD pipelines, release tagging, and version control Knowledge of Docker and containerisation Understanding of encryption ...

data analytics and AI-driven solutions. Skilled in designing and automating data quality metrics and KPIs. Proficient with AWS (S3, Kinesis, Glue, Redshift, Lambda, EMR) and/or Azure (ADF, Synapse, Fabric, Functions). To be Considered.... Please either apply by clicking online or emailing me directly to henry.clay ...

Kotlin/Java programming.Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive.Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue.Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development.Strong communication skills, with the ability to work ...

pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python, SQL, DBT, AWS: S3, Glue, EMR, Lambda, Aurora, Airflow, Terraform). Ensure data availability, integrity, and performance as the platform scales globally. Drive best practices in data quality, automated testing … equivalent). Experience integrating with major EHR platforms (Epic, Cerner, Meditech, or similar). Strong command of the AWS data stack: S3, Glue, EMR, Lambda, Aurora, and orchestration tools such as Airflow. Proficiency in Python, SQL, and DBT; familiarity with IaC tooling such as Terraform. Comfortable operating across customer ...

regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills: You are highly comfortable using ...

regulated environment.* AWS Experience: You have a strong working knowledge of AWS and cloud-first data pipeline orchestration tools (like Airflow, Glue, or EMR).* A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines.* Strong Automation Skills: You are highly comfortable using ...

Solution Architect delivering enterprise AWS data platforms. Strong hands-on expertise with: AWS S3 AWS Glue AWS Lake Formation Amazon Redshift Athena EMR Experience designing modern data lakes, lakehouse architectures, data integration pipelines, and analytics platforms. Strong understanding of data governance, security, metadata management, and data architecture ...

Rate: Competitive - Outside IR35 Industry: Technology/Data & AI What You’ll Be Doing? Design, build, and maintain a scalable MLOps platform using Amazon SageMaker, covering model training, deployment, pipelines, monitoring, and governance. Lead the migration of a complex suite of production machine learning models from legacy platforms … experience. Knowledge of Infrastructure as Code using Terraform, CloudFormation, or CDK is advantageous. Familiarity with AWS services including Step Functions, Lambda, CloudWatch, CloudTrail, Glue, EMR, Lake Formation, Feature Store, and VPC networking would be beneficial. Experience with data governance, security, and compliance within cloud environments. Ability to lead technical ...

Lead Data Platform Engineer – DataOps Location: Nottingham Trent House (95002), United Kingdom, Nottingham, Nottinghamshire About the Role We are seeking a Lead Data Platform Engineer to own the resilience, scalability, and security of our core ...