176 to 200 of 254 Apache Spark Jobs in London

networking, storage, to applications Work in Python to design and deliver open source code Architect cloud infrastructure solutions like OpenStack, Kubernetes, Ceph, Hadoop and Spark either On-Premises or in Public Cloud (AWS, Azure, Google Cloud) Coach and develop your colleagues where you have insights Grow a healthy, collaborative ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka). Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks ...

with product stakeholders to align technical strategy with business goals and resolve blockers across the team. Apply efficient data transformations using distributed computing (e.g., Spark, Dask) and ensure robust test coverage for production systems. Mentor junior team members and utilise model explainability methods to drive feature performance improvements. About ...

operating large-scale data pipelines or search/retrieval systems Are proficient in Python and/or TypeScript, and familiar with tools like Spark, Kafka, Flink, data warehouses, and SQL Take a product-minded approach, design with user workflows in mind, and iterate quickly based on feedback Favor pragmatic ...

engineering practices (clean code, testing, version control, code review) Proficient with large‐scale data: strong SQL skills and familiarity with distributed data processing (e.g., Spark, Hive) for building training datasets, features, and analytical views Proven ability to lead through influence: aligning cross‐functional stakeholders on problem definitions, success metrics ...

large generative models. AV/robotics/simulation; multi-sensor driving data (video, telemetry; LiDAR a plus). Productionising research: Flyte/Ray/Spark-style jobs, dataset lineage, training mix configuration. Reward models, offline RL, or closed-loop evaluation of driving policies. Cloud GPU fleets (Azure/ ...

decisions across multiple engineering disciplines. What we can offer you At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core. Highly competitive package (base + equity) with reviews every ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based … Working knowledge of ETL/ELT patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits We strive to provide comprehensive benefits and perks that meet the needs of all our employees. ...

Barlowe LLP is seeking an engineer to build and operate distributed analytics platforms in London. The role involves using technologies such as Spark, Kafka, and AWS to power research and trading teams. The ideal candidate will have strong experience with data analytics systems, automation skills in Python ...

drive AI-assisted development practices to improve quality and speed. The role emphasizes applying cloud-native architectures, modern data technologies like Kafka, Databricks, and Spark, and maintaining operational stability while shaping the team's technical strategy #J-18808-Ljbffr ...

years of experience in data science and predictive modeling. Expertise in SQL, R, or Python for data analysis. Experience with big data technologies (Hadoop, Spark). Ability to translate complex data into business strategy. Highly competitive salary and stock options. Relocation assistance if required. State-of-the-art workstation ...

Kafka, RabbitMQ, or Pulsar Experience with Kafka Connect Experience in setting up data platforms and establishing standards Experience with distributed data processing frameworks (e.g., Spark or Flink) #ICBCareers #ICBEngineering #J-18808-Ljbffr ...

with stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL #CIBAppliedAI #J-18808-Ljbffr ...

programming, hardware-aware optimization, or FPGA-adjacent systems. Experience with ML/data tooling such as PyTorch, JAX, CUDA, GPU clusters, Ray, Kafka, Kubernetes, Spark, or comparable technologies. Understanding of market microstructure, backtesting pitfalls, transaction costs, and the operational needs of live quantitative strategies. Experience in environments operating real ...

Security, Collaboration, and Observability portfolios. Your Impact As a Software Engineer you will: Design, build, test, and operate near real time data streaming-based (Spark/Flink) solutions for some of the largest Networking customers in the world. Develop agentic workflows, reusable skills, tool integrations, and orchestration capabilities. Integrate ...

Company description Publicis Media harnesses the power of modern media through leading agency brands Dysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, StarcomandZenith, as well as global accelerator PMX; immersive experience group PMCI and access to integrated platform-based technologies and offerings from CJ, EpsilonandInfluential. ...

programming, hardware-aware optimization, or FPGA-adjacent systems. Experience with ML/data tooling such as PyTorch, JAX, CUDA, GPU clusters, Ray, Kafka, Kubernetes, Spark, or comparable technologies. Understanding of market microstructure, backtesting pitfalls, transaction costs, and the operational needs of live quantitative strategies. Experience in environments operating real ...

person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. Requires participation in an on-call rotation ...

person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. Requires participation in an on-call rotation ...

build and enhance our Databricks platform, ensuring it remains secure, scalable and reliable. Develop and maintain batch and real-time data pipelines using Databricks, Spark and Delta Lake. Contribute to platform architecture, engineering standards and best practices across the data estate. Collaborate with Product, Analytics and Data Science teams … improvement across the engineering team. Our ideal candidate Proven experience building and supporting scalable, production-grade data platforms. Strong hands-on expertise with Databricks, Spark, Delta Lake, Python and SQL. Good understanding of cloud-based data engineering, ideally within Azure environments. Experience working with Infrastructure as Code tools such ...

services to support research and trading. You will collaborate with researchers and engineers to evolve platform capabilities, automate operations and adopt technologies such as Spark, Trino, Kafka, and Airflow. #J-18808-Ljbffr ...

will lead requirements for the Treasury Analytics Group, support FIS Quantum & TBSM, and work on a new risk/analytics platform using Hadoop, Spark, and NoSQL tools. The role reqs 5+ years of experience, Linux/Oracle/MS SQL, ITIL, and scripting with Java/Python. Collaboration with ...

days a week and delivering high-quality, consultative outcomes. Ideal candidates will have strong communication skills and a track record in Big Data technologies (Spark, Hadoop, EMR, MapR) and NoSQL/MPP databases, with a passion for #J-18808-Ljbffr ...

governance requirements. Sound scientific and commercial judgement, balancing business opportunity, evidence quality and governance. When we put unexpected teams in the same room, we spark bold thinking with the power to inspire life‐changing medicines. In‐person working gives us the platform we need to connect, work at pace ...