101 to 125 of 140 Apache Spark Jobs in London

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent). Understanding of ML concepts. ...

code, CI/CD best practices, and cloud platforms (AWS, GCP, or Azure). Experience with relational databases and data processing and query engines (Spark, Trino, or similar). Familiarity with monitoring, observability, and alerting systems for production ML (Prometheus, Grafana, Datadog, or equivalent). Understanding of ML concepts. ...

stores (Feast, AWS Feature Store). Containerisation (Docker) and orchestration (Kubernetes, ECS). Infrastructure as Code (Terraform, CloudFormation). Large-scale data processing frameworks (Spark, Dask). Familiarity with data governance and compliance frameworks. Experience in regulated industries such as healthcare or finance. Benefits: Competitive salary ...

Qualifications A strong portfolio of research publications (ICML, NeurIPS, KDD, etc.) or patents related to applied AI. Extensive experience with distributed computing frameworks (e.g., Spark, Ray) for large-scale model training and inference. ...

Qualifications A strong portfolio of research publications (ICML, NeurIPS, KDD, etc.) or patents related to applied AI. Extensive experience with distributed computing frameworks (e.g., Spark, Ray) for large-scale model training and inference. ...

/multi-region patterns , meeting defined RPO/RTO targets. Hands-On Engineering Write and review production-grade code using: Python, Scala, SQL Spark/AWS Glue AWS Lambda & Step Functions Build infrastructure using Terraform (IaC) . Implement CI/CD pipelines (GitLab, Jenkins). Enforce automated testing, performance ...

streaming data and experimentation platforms. Ensure data quality, reliability, and scalability. Requirements 5+ years in Data Engineering or Data Platform teams. Strong Scala and Spark skills. Experience with Airflow, Databricks, and streaming tools (Kafka, Kinesis). Background in experimentation or analytics platforms. if you fit the above skills, pleae ...

Description: This is a generalist mid-level backend position within the Ads Organization. Technologies used on the team include: Languages: Go, Python, Scala Frameworks: Spark, Thrift, Kafka Data stores: Postgres, BigQuery, Redis, Druid Tools: Kubernetes, Airflow, Docker Job responsibilities: You will work with the existing engineering team and help ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

Deep expertise in search and recommendation systems (e.g., semantic embeddings, learning-to-rank, personalisation algorithms). Hands-on experience with modern ML toolchains — Python, Spark, and frameworks such as PyTorch or TensorFlow. Strong grounding in experimental design, A/B testing, and the use of offline/online metrics ...

Deep expertise in search and recommendation systems (e.g., semantic embeddings, learning-to-rank, personalisation algorithms). Hands-on experience with modern ML toolchains — Python, Spark, and frameworks such as PyTorch or TensorFlow. Strong grounding in experimental design, A/B testing, and the use of offline/online metrics ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure ...

systems. Influence Opinion and decision-making across AI and ML Skills Python SQL/Pandas/Snowflake/Elasticsearch Docker/Kubernetes Airflow/Spark Familiarity with GenAI models/libraries Requirements 3+ years of relevant software engineering experience post-graduation A degree (ideally a Master’s) in Computer ...

systems. Influence Opinion and decision-making across AI and ML Skills Python SQL/Pandas/Snowflake/Elasticsearch Docker/Kubernetes Airflow/Spark Familiarity with GenAI models/libraries Requirements 3+ years of relevant software engineering experience post-graduation A degree (ideally a Master’s) in Computer ...

Feast, AWS Feature Store) Experience with containerisation (Docker) and orchestration (Kubernetes, ECS) Familiarity with Infrastructure as Code (Terraform, CloudFormation) Experience with data processing frameworks (Spark, Dask) for large-scale workloads Understanding of data governance and compliance frameworks ...

Feast, AWS Feature Store) • Experience with containerisation (Docker) and orchestration (Kubernetes, ECS) • Familiarity with Infrastructure as Code (Terraform, CloudFormation) • Experience with data processing frameworks (Spark, Dask) for large-scale workloads • Understanding of data governance and compliance frameworks ...

deliver at pace and scale. The toolkit you’ll use 🌳 Data Science & Engineering: Python (NumPy, Pandas, scikit-learn, PyTorch/TensorFlow), SQL, NoSQL, Spark, big data ecosystems Visualisation & APIs: REST/JSON, Postman, Flask/FastAPI, Power BI/Tableau, D3.js DevOps & Cloud: CI/CD, Docker … Foundry (full training provided). Familiarity with AI/ML Ops pipelines , real-time analytics, or edge deployments. Big Data stack knowledge (e.g., Hadoop, Spark, Kafka). GenAI/LLM experience (e.g., AWS Bedrock, LangChain). Why this is a great move 🌳 Mission & impact: Work on projects where data ...

deliver at pace and scale. The toolkit you’ll use 🌳 Data Science & Engineering: Python (NumPy, Pandas, scikit-learn, PyTorch/TensorFlow), SQL, NoSQL, Spark, big data ecosystems Visualisation & APIs: REST/JSON, Postman, Flask/FastAPI, Power BI/Tableau, D3.js DevOps & Cloud: CI/CD, Docker … Foundry (full training provided). Familiarity with AI/ML Ops pipelines , real-time analytics, or edge deployments. Big Data stack knowledge (e.g., Hadoop, Spark, Kafka). GenAI/LLM experience (e.g., AWS Bedrock, LangChain). Why this is a great move 🌳 Mission & impact: Work on projects where data ...

models for performance, scalability, and accuracy. Qualifications: Deep knowledge of neural networks (CNNs, RNNs, LSTMs, Transformers). Strong experience with data tools (Pandas, NumPy, Apache Spark). Solid understanding of NLP algorithms. Experience integrating ML models via RESTful APIs. Familiarity with CI/CD pipelines and deployment automation. ...

models for performance, scalability, and accuracy. Qualifications: Deep knowledge of neural networks (CNNs, RNNs, LSTMs, Transformers). Strong experience with data tools (Pandas, NumPy, Apache Spark). Solid understanding of NLP algorithms. Experience integrating ML models via RESTful APIs. Familiarity with CI/CD pipelines and deployment automation. ...

. • Experience building and deploying applications on Kubernetes (EKS). Ask anything Important skills: Must have: 1. Bash Scripting 2.Real time with Spark structured streaming Nice to have : Familiarity with IceBerg GCP/BQexposure ...

tooling and working with large transactional datasets • Understanding of OTC products including CDS, Interest Rate Swaps and Variance Swaps Highly Desirable • Experience with C++, Spark, Kafka or other distributed compute tools • Exposure to position keeping, risk, or PnL systems • Strong debugging, profiling and optimisation capability across data pipelines ...

tooling and working with large transactional datasets • Understanding of OTC products including CDS, Interest Rate Swaps and Variance Swaps Highly Desirable • Experience with C++, Spark, Kafka or other distributed compute tools • Exposure to position keeping, risk, or PnL systems • Strong debugging, profiling and optimisation capability across data pipelines ...

lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands-on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practice Credibility to lead long-tenured individual contributors while providing ...