76 to 86 of 86 Apache Spark Jobs in London

reasoning engines, and data platforms, linking bioinformatics with modern AI to interpret variants, diseases, and literature. You’ll work across PostgreSQL, DuckDB, Redis, and Spark, delivering scalable, explainable AI systems. #J-18808-Ljbffr ...

experience owning and operating production data infrastructure at significant scale. Proven capability delivering large-scale streaming data solutions using technologies such as Kafka, Flink, Spark Streaming, Dataflow, or similar. Demonstrated success leading end-to-end migrations of live production systems. Strong knowledge of cloud platforms and distributed data architectures. … with data scientists, analysts, and business stakeholders. Strong understanding of data platform reliability, performance, scalability, and cost optimisation. Experience with technologies such as ClickHouse, Apache Iceberg, BigQuery, dbt, Elasticsearch, Druid, GCP, or AWS is highly desirable. If you're an experienced Senior Data Engineer looking to lead complex data ...

Overview At Aztec, we are committed to building a diverse and inclusive workforce where everyone is valued, respected, and able to grow. We welcome applications from all individuals and encourage candidates who are excited about ...

coupled with a strong interest in continuous learning. Flexibility to travel up to 20% of the time. Preferred Technical and Professional Experience Experience with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits ...

At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer‐centric mindset guides us to create a unified platform that makes data science and ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with Distributed Spark based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits: Passion ...

ability to mentor and develop others. You'll lead platform engineering initiatives while coaching a team of BI Developers in Fabric, Python and Spark, helping drive the organisation's data engineering capability forward. Key Responsibilities Development, support and enhancement of EDAP on Microsoft Fabric. Design and build scalable data … Python and Spark. Work with stakeholders to deliver robust, business-focused data solutions. Essential Skills Microsoft Fabric (hands-on platform engineering experience). Python. Apache Spark. Azure Data Factory, Databricks and Data Lake. Enterprise-scale data platform design and delivery. Experience coaching, mentoring and leading technical teams. Important This ...

replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many modern Lakehouse architectures.We guarantee you’ll learn … focus on scalability, reliability, and observability.Strong knowledge of the JVM and server-side Kotlin/Java programming.Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive.Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue.Experience working in Agile environments and contributing through code ...

scalability Build and integrate RESTful microservices within a complex distributed architecture Work with large-scale data sets, leveraging SQL and big data tools (e.g., Spark, Kafka) Influence system design and contribute to the technical roadmap Collaborate closely with a highly skilled engineering team to deliver innovative solutions Requirements Strong … experience building and consuming RESTful services Solid SQL skills and familiarity with large-scale data processing Knowledge of big data technologies such as Spark and Kafka Experience in finance is preferred, but not essential Strong academic background, ideally in Computer Science or a related discipline #J-18808-Ljbffr ...

tuned foundational Large Language Models (LLMs), along with sub‐agents, tools, and MCP integrations Architect end‐to‐end ML pipelines, integrating data processing (e.g., Spark, Airflow) with model training, evaluation, and deployment workflows Drive experimentation frameworks, including A/B testing and offline evaluation, to continuously improve model performance … fine‐tuning Large Language Models (LLMs) and building production AI Agents. Proven experience designing scalable data and ML pipelines using tools such as Spark, Airflow, or similar distributed systems. Demonstrated ability to operate as a senior individual contributor, influencing technical strategy and decision‐making without direct authority. Experience partnering ...