1 to 25 of 51 Amazon EMR Jobs in London

Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/prod), naming standards … cloud platform, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, and related security, networking, and monitoring services.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.* Passion for data and a thirst ...

data solutions that meet complex business needs and support informed decision-making. Experience Required: Strong AWS expertise, including tools such as Glue, Lambda, Kinesis, EMR, Athena, DynamoDB, CloudWatch, SNS and Step Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage ...

Kafka and a programming language (e.g., Python or Java) for building data workflows and automation. Familiarity with AWS services such as S3, Glue, Lambda, EMR, or streaming tools like MSK/Kinesis. Experience with basic data governance, data quality checks, and security practices (e.g., RBAC, encryption, handling PII). ...

SQLExperience working with AWS and its data and AI/ML services such as SageMakerExperience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake)Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloadsUnderstanding of Data Security, Data ...

Software Dev Engineer, Amazon Security Automation Job ID: 10498444 | Amazon UK Services Ltd. At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon … development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2 Experience developing, deploying and managing AI products at scale Amazon is an equal opportunities employer. We believe passionately ...

technologies like Apache Iceberg and Spark.Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.RDBMS: Knowledge of PostgreSQL is a plus.Industry Experience: Proven ...

disciplines and exposure to Infrastructure-as-Code such as Terraform Your Profile Essential skills/knowledge/experience: Experience with AWS data stack (S3, EMR, EC2, etc.) PySpark & Snowflake & CI/CD & DevOps Performance optimisation and large-scale data processing Data modelling (RDV/BDV or similar patterns preferred ...

JavaCommercial experience in client-facing projects is a plus, especially within multi-disciplinary teamsDeep knowledge of database technologies:Distributed systems (e.g., Spark, Hadoop, EMR)RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL)NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j)Solid understanding of software engineering best practices – code reviews, testing frameworks ...

Linux skills and proficiency in Python for automation and integrationFamiliarity with infrastructure as code, using Terraform or AnsibleDeep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAAExperience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetryStrong problem-solving skills ...

exposure to the following will be good to have else we will be enable you with the required trainingAWS Glue and Data Catalog, EMR, Athena, S3, Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure ...

Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding model training/inference — feature ...

Develop ETL/ELT processes for ingesting, transforming and processing data from multiple sources Implement data solutions using AWS S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches for analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … enterprise environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services including S3, Glue, Lambda, Athena, Redshift and EMR Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines and data processing workflows Understanding of data modelling, data lakes ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the right services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

design and build scalable data pipelines using Python and Apache Spark, with hybrid work in mind. You will orchestrate data workflows using AWS Glue, EMR Serverless, Lambda and S3, integrate lakehouse architecture with Apache Iceberg, and collaborate with business teams. The role emphasizes modern software practices, observability, testing with ...

TypeScript, Python, Java, etc) in support of Investment Portfolio Management and Construction Utilizing AWS technologies such as Lambda, API Gateway, DynamoDB, S3, Glue, Redshift, EMR, Sagemaker, EKS/ECS. Working in a team with experienced software engineers to identify great projects and features that will help you grow ...

Develop and optimize data models for data warehouse/data lake (Redshift, S3) Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR) Implement data quality checks, validation, and reconciliation processes Optimize pipeline performance and manage compute/storage costs Ensure data security and access control (IAM, KMS, encryption … requirements Document data pipelines, architecture, and operational runbooks Skills Must have 5+ years of experience Hands-on experience building data pipelines on AWS (Glue, EMR, Lambda, Step Functions) Strong SQL and experience with data warehousing (Redshift, dimensional modeling) Proficiency in Python or Scala for data engineering Experience with ...

Experience with enterprise-scale implementations of cloud-native data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutions Experience navigating complex data ...

computing frameworksExperience with enterprise-scale implementations of cloud-native data platforms such as Databricks and SnowflakeGood understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutionsExperience navigating complex data governance ...

considering effort, impact, and scalability trade-offs; Nice to have: Apache Spark, Iceberg, Kafka, dbt, Scikit-Learn, XGBoost, PyTorch, MLFlow, GraphFrames, Ray, AWS S3, EMR, SageMaker, Lakeformation, Terraform, Docker, GitHub CI/CD, Knowledge Graphs, RAG, graph ML, probabilistic programming, A/B testing. Условия No conditions specified #J ...

technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More information Enjoy fantastic perks like ...

Kotlin/Java programming.Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive.Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue.Experience working in Agile environments and contributing through code reviews, design discussions, and collaborative development.Strong communication skills, with the ability to work ...

digital platformsOur technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.)PySparkAWS cloud infrastructure: EMR, ECS, Athena, etcMLOps/DevOps: Terraform, Docker, Airflow, MLFlowMonitoring and evaluation platforms including New Relic and BraintrustMore information:Enjoy fantastic perks like private healthcare ...

distributed teams in collaborative delivery environments. Deep working knowledge across key AWS Data & Analytics services, including: Building large-scale data lake architectures on Amazon S3 and open table formats Implementing governance and cataloging through AWS Lake Formation. Developing ETL and metadata frameworks using AWS Glue. Leveraging AWS Lambda … serverless data processing. Running distributed data workloads on Amazon EMR. Enabling real-time data pipelines with AWS Kinesis (Data Streams and Firehose). Orchestrating pipelines using AWS Step Functions/Amazon MWAA/similar services. Designing and optimizing schemas and query performance on Amazon ...

data pipelines, and collaboration across global teams from a remote UK setting. You will work with a broad stack including AWS Glue, Redshift, EMR, Kinesis, and Python/PySpark to deliver real business impact for Fortune 1000 #J-18808-Ljbffr ...