1 to 25 of 28 Amazon EMR Jobs in London

Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/prod), naming standards … cloud platform, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, and related security, networking, and monitoring services.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.* Passion for data and a thirst ...

experience in Data Engineering* Strong expertise in Python and extensive experience with PySpark and distributed data processing* Expert-level knowledge of AWS services including EMR, Glue, Lambda, S3, Athena, Redshift, ECS/EKS, Step Functions, EventBridge, IAM, CloudWatch, and SNS/SQS* Hands-on experience building data lakes ...

ways of working. It’s a plus if you also have these skills Experience using AWS or another major cloud platform. Our environment includes EMR, Athena, Lambda, S3, Glue and Step Functions, but we're open to transferable experience solving similar problems. Experience with Snowflake, Spark, Scala or Airflow ...

Implement batch workflows and ETL processes adhering to modern engineering standards. Develop Cloud-Based Workflows Orchestrate data workflows using AWS services such as Glue, EMR Serverless, Lambda, and S3. Contribute to the evolution of lakehouse architecture leveraging Apache Iceberg. Apply Software Engineering Best Practices Use version control, CI/ ...

emerging technologies could improve engineering quality, productivity and ways of working. Additional assets Experience using AWS or another major cloud platform. Our environment includes EMR, Athena, Lambda, S3, Glue and Step Functions, but we're open to transferable experience solving similar problems. Experience with Snowflake, Spark, Scala or Airflow ...

Kafka and a programming language (e.g., Python or Java) for building data workflows and automation. Familiarity with AWS services such as S3, Glue, Lambda, EMR, or streaming tools like MSK/Kinesis. Experience with basic data governance, data quality checks, and security practices (e.g., RBAC, encryption, handling PII). ...

technical stakeholders Experience supporting machine learning or AI workloads through production-grade data engineering solutions Highly Desirable Strong AWS data platform experience (S3, Glue, EMR, Redshift, Athena, Lambda, Bedrock, SageMaker or equivalent) Experience operationalising machine learning models into production environments Experience with MLOps, model deployment, model monitoring, model lifecycle ...

Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics and AI workloads - Understanding of Data ...

software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence Preferred Qualifications Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions Experience with non-relational databases/data stores (object storage, document or key-value stores, graph … highly available, distributed systems of data extraction, ingestion, and processing of large data sets Experience with big data technologies such as: Hadoop, Hive, Spark, EMR Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting ...

Spark Strong skills in Python and SQL, with solid data modeling experience Extensive knowledge of AWS/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB, EMR, Athena) Hands-on experience with orchestration and workflow tools (Docker, Kubernetes, Airflow, Prefect, Dagster) Familiar with CI/CD pipelines, infrastructure as code ...

mesh, data fabric). Hands-on experience with one or more cloud data ecosystems: Azure (Data Factory, Synapse, Fabric, ADLS, Databricks) AWS (Glue, Redshift, EMR) GCP (BigQuery, Dataflow) Databricks (Spark/PySpark) Snowflake (SQL, Snowpark, performance tuning) Strong SQL and/or Python capability, and familiarity with tools such ...

proficiency in Python for automation and integration Familiarity with infrastructure as code, using Terraform or Ansible Deep understanding of AWS analytics technologies including EMR, MSK, Athena, Redshift, Glue and MWAA Experience with CI/CD and observability tools such as Jenkins, ArgoCD, Prometheus, Grafana and OpenTelemetry Strong problem‐solving ...

comprehensive understanding of cloud data warehousing, data pipelines and data transformation (extract, transform, and load) processes and supporting technologies such as Google Dataflow, DBT, EMR, CI/CD Pipelines, Airflow DAGs, and other analytics tools. Experience with cloud-based data infrastructures (Ideally GCP, but AWS or Azure would also ...

ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data engineering frameworks … environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ELT pipelines ...

Proficiency in Python (preferred), with experience in other languages like Java, Scala, or TypeScript Strong knowledge of cloud-based big data tools (AWS, Spark, EMR, Lambda, etc.) Excellent communication and problem-solving skills, with a collaborative mindset A passion for supporting SMEs through innovative, data-led technology Background ...

TypeScript, Python, Java, etc) in support of Investment Portfolio Management and Construction Utilizing AWS technologies such as Lambda, API Gateway, DynamoDB, S3, Glue, Redshift, EMR, Sagemaker, EKS/ECS. Working in a team with experienced software engineers to identify great projects and features that will help you grow ...

Experience with enterprise-scale implementations of cloud-native data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns with demonstrated experience architecting end-to-end data solutions Experience navigating complex data ...

solve them Some extra skills that are great (but not essential): Experience with MLOps tools: Airflow, MLflow, AWS SageMaker, AWS S3, AWS EMR, CI/CD Prior experience in the fraud domain and a strong understanding of fraud detection techniques Experience designing and deploying LLM-based solutions in production ...

technology stack Python and associated ML/DS libraries (scikit-learn, NumPy, LightGBM, Pandas, LangChain/LangGraph, TensorFlow, etc.) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc MLOps/DevOps: Terraform, Docker, Airflow, MLFlow Monitoring and evaluation platforms including New Relic and Braintrust More information Enjoy fantastic perks like ...

Experience with enterprise-scale implementations of cloud-native data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills: Experience navigating complex data governance, security, and compliance ...

vector operations using numpy, scipy; experience with distributed computation using multithreading, multi GPUs, Dask, Ray, Polars Familiarity with AWS Cloud services such as EMR, Sagemaker Overall knowledge of the Software Development Life Cycle Solid understanding of agile methodologies including CI/CD, application resiliency, and security Preferred Qualifications, Capabilities ...

production rather than for novelty. You don't need to know all of it on day one. Data and compute: S3, Athena, Spark on EMR, SQLOrchestration and MLOps: Airflow, MLflow, Docker, ECS, Terraform, GitHub Actions for CI/CDModels: foundation models served through Amazon BedrockAgents: LangGraph … orchestration, deployed and run on Amazon Bedrock AgentCore, with MCP for tool integrationEvaluation: Braintrust for evals, tracing and monitoring agent quality in productionMore information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for-1 share purchase plans, an EV Scheme ...

Data Engineer II (1 Year FTC), Supply Chain Optimization Technologies - Planning Job ID: 10590990 | Amazon EU SARL (UK Branch) **This is a 1 Year FTC contract** Are you passionate about building data solutions that power decisions at massive scale? As a Data Engineer II at Amazon … Experience in data engineering Experience with data modeling, warehousing and building ETL pipelines Preferred Qualifications Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions Experience with non-relational databases/data stores (object storage, document or key-value stores, graph ...

code to architects and developers Excellent communication skills and a desire to impart knowledge Added bonus if you have Experience with Spark Experience with EMR Experience as a Solution Architect AWS Solution Architect Associate Certification What we offer you A multifaceted job with a high degree of responsibility ...

does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena, or the Databricks/Snowflake equivalents), making sound decisions on architecture, data modelling, and tooling and weighing up trade-offs … need to be the person designing the model Have designed and operated production data pipelines on a modern cloud data platform, AWS (Glue, EMR, Redshift, S3/Lake Formation), Databricks, Snowflake or comparable, and can talk about which of those decisions would travel to a different one, and which ...