101 to 125 of 151 Apache Spark Jobs in London

engineering practices (clean code, testing, version control, code review)Proficient with large-scale data: strong SQL skills and familiarity with distributed data processing (e.g., Spark, Hive) for building training datasets, features, and analytical viewsLeadership & CollaborationProven ability to lead through influence: aligning cross-functional stakeholders on problem definitions, success metrics ...

retrieval, and multi-modal representation learning. Technical Stack: Mastery of Python and deep learning frameworks (TensorFlow, PyTorch) alongside hands-on experience with distributed computing (Spark, Ray) and cloud infrastructure (AWS/GCP).Desired: Graph Neural Networks (GNNs): Strong experience applying GNNs, knowledge graphs, or graph embeddings to map complex ...

platforms for Agentic AI, Generative AI, Machine Learning, or Business Intelligence, covering data preparation, embeddings generation, vector search, and system integration using modern frameworks (Spark, dbt, LangChain)A strong foundation in system design, data storage, and reliability with commonly used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.) and data … engineering tools (e.g., Pandas, Spark, dbt, etc.)Hands-on experience with MLOps/LLMOps principles, including CI/CD for data workflows, automated agent evaluation (LangSmith, Opik, Langfuse), and infrastructure as code (Terraform)Experience building systems with different data formats (structured vs unstructured) and data processing methods (streaming ...

have a background)Testing and deployment pipelines, software and productivity tools, monitoring and middleware, data infrastructure.Integrating best-of-breed tools and technologies such as Spark, Kafka, Zookeeper, Mesos, Docker, ElasticsearchAssembling platforms and frameworks to automate business processesCollaborating with internal technology, research and portfolio management teamsPython Developers MUST have ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka).Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks like ...

audiences both written and verbalPreferred (but not required) to have: Experience in BankingHands on experience with PythonExperience working with modern data technology (e.g. dbt, spark, containers, devops tooling, orchestration tools, git, etc.)Experience with AI, data science and machine learning technologiesPeople want to buy from people who understand them. ...

withFX or financial markets experienceTerm structure modelling, stochastic calculus or Monte Carlo methodsInterest rate curve bootstrappingAlgorithmic execution experienceData lake or warehouse experience (Snowflake, Iceberg, Spark etc.)A product mindset - you think about who uses your systems and why.Clear communicator who can work cross-functionally with other quants, analysts, traders ...

withFX or financial markets experienceTerm structure modelling, stochastic calculus or Monte Carlo methodsInterest rate curve bootstrappingAlgorithmic execution experienceData lake or warehouse experience (Snowflake, Iceberg, Spark etc.)A product mindset - you think about who uses your systems and why. Clear communicator who can work cross-functionally with other quants, analysts ...

following areas: software design or development, content distribution/CDN, scripting/automation, database architecture, IP networking, IT security, BigData/Hadoop/Spark, operations management, service oriented architecturePreferred qualification - Experience with AWS services or other cloud offerings- Experience with operational parameters and troubleshooting for four ...

doingDesigning and building scalable data pipelines that support machine learning, analytics and data science initiatives. Developing high-performance data solutions using Python, Spark, Databricks and Azure technologies. Creating and maintaining datasets that power customer, marketing, pricing and forecasting use cases. Collaborating closely with Applied Scientists and Machine Learning Engineers … engineering solutions within cloud-based environments. Strong expertise in Python and experience developing production-grade data pipelines and data products. Experience working with Databricks, Spark and distributed processing technologies. Experience designing and operating large-scale data platforms using Azure, AWS or GCP.Deep understanding of data modelling, data architecture ...

models for performance, scalability, and accuracy. Qualifications: Deep knowledge of neural networks (CNNs, RNNs, LSTMs, Transformers). Strong experience with data tools (Pandas, NumPy, Apache Spark). Solid understanding of NLP algorithms. Experience integrating ML models via RESTful APIs. Familiarity with CI/CD pipelines and deployment automation. ...

regularly and concisely.Good to HaveKnowledge of the adTech space and particularly the identifiers used in the field.Experience with large-scale distributed data processing (e.g., Apache Spark) and cloud data infrastructure across GCP and AWS (e.g., Dataproc, Dataflow, GKE, EMR).Experience with TemporalWe use automated decision systems ...

reconciliation tooling and working with large transactional datasets Understanding of OTC products including CDS, Interest Rate Swaps and Variance SwapsHighly Desirable• Experience with C++, Spark, Kafka or other distributed compute tools Exposure to position keeping, risk, or PnL systems Strong debugging, profiling and optimisation capability across data pipelinesIf ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka).Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks like ...

money doing something you are passionate about.My client is based in LondonFollow me on Twitter for more roles and news @SebFintechSytems ENgineer – Security, Hadoop, SPark, debian, SELinux, Debian, puppet, ruby , python, kerberos ...

mentoring capability across globally distributed teams. PreferredRedpanda architecture and operations. Event sourcing and CQRS in production environments. Stream processing with Kafka Streams, Flink, Spark Streaming, ksqlDB, or similar technologies. Financial services, banking, lending, payments, or regulated industry experience. Kubernetes and cloud-native platforms. Observability stacks including Prometheus, Grafana, OpenTelemetry ...

conducted for several leading frontier model developers and national safety institutes, and has been featured in OpenAI's o1 system card and Meta Muse Spark's Safety & Preparedness Report. About the roleAs a Senior Research Scientist at Faculty, you will join our high-impact R&D team to lead ...

like Cassandra, Elasticsearch, Kafka, and more across different environmentsTechnologies We Use Different backend languages, including Java, Rust, and GoOpen-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, FlinkIndustry-standard build tooling, including Gradle and GitHubWhat We ValueDemonstrated ability to collaborate and empathise with a variety of individuals. Able ...

person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. Requires participation in an on-call rotation ...

systems like Cassandra, Elasticsearch, Kafka, and more across different environmentsTechnologies We UseDifferent backend languages, including Java, Rust, and GoOpen-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, FlinkIndustry-standard build tooling, including Gradle and GitHubWhat We ValueDemonstrated ability to collaborate and empathise with a variety of individuals. Able ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating legacy … systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

deploying scalable data platforms end-to-end on AWS and/or Databricks. Production Coding: Strong, hands-on production experience with Python, SQL, Spark, and Databricks or AWS data tools. Consulting/Client Delivery: Experience working in a consultancy, systems integrator, or client-facing setting with direct accountability …/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming).Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure: Exposure ...

deploying scalable data platforms end-to-end on AWS and/or Databricks. Production Coding: Strong, hands-on production experience with Python, SQL, Spark, and Databricks or AWS data tools. Consulting/Client Delivery: Experience working in a consultancy, systems integrator, or client-facing setting with direct accountability …/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ML Infrastructure: Exposure ...

society's experience with software. Come join one of the fastest-growing startups, supported by best-in-class institutions like Battery Ventures, Salesforce Ventures, Spark Capital and Meritech. Pendo Core Values: Bias to Act, Hone Your Craft, The Team is Pendo, and Maniacal Focus. Location: Pendo is a hybrid ...

person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. Requires participation in an on-call rotation ...