151 to 175 of 191 Apache Jobs in London

Vision Familiarity with Bayesian Learning Familiarity with Causal Inference Familiarity with Recommender Systems Familiarity with Graphs and GNNs Familiarity with Reinforcement Learning Familiarity with Apache Spark or other distributed processing frameworks A paid 6-week sabbatical leave after four years For everyone, everywhere. We’re people building money without ...

Data, Streaming & Analytics Oversee large-scale telemetry ingestion via highly available MQTT brokers handling 6+ billion messages per day . Guide streaming pipelines using Apache Pulsar and data storage across DynamoDB and Google BigQuery . Enable high-fidelity time-series analytics, machine learning, and forecasting at scale. Ensure robust ...

semantic data fabric, converting multi-stream clinical execution datasets into an object-centric model. Design and execute a modern Data Lake strategy centred on Apache Iceberg as the core storage format, ensuring high-performance querying and seamless interoperability with Snowflake and heterogeneous compute engines. AI-Accelerated Schema & Pipeline Engineering … resilient, self-healing pipeline architectures. Key Business Value & Strategic Impact Your leadership will directly advance life sciences technology. By pairing modern lakehouse architecture (Snowflake, Apache Iceberg, Kafka) with AI-augmented workflows, you will empower our platform to process critical safety signals in hours rather than weeks. This enables adaptive ...

e.g., Java, TypeScript, SQL) Experience building and consuming APIs and event‐driven services in a cloud environment Experience with data processing frameworks such as Apache Spark and working with large structured datasets Working knowledge of LLM‐based application development, including prompting, tool calling, retrieval, and evaluation Experience using approved … agent frameworks (e.g., Google ADK, LangGraph) and agent protocols such as MCP, A2A, or AG-UI Experience with Databricks, MLflow, and Delta Lake or Apache Iceberg Exposure to model serving on Kubernetes and to model monitoring (drift, latency, accuracy) Familiarity with CRM platforms such as Salesforce and their APIs ...

environment 2+ years’ experience working with Red Hat Linux (or other Unix variants), including scripting 2+ years’ experience supporting applications such as Java, .NET, Apache or IIS Desirable Experience within the financial services or trading environment Knowledge of Windows Server Familiarity with ITIL frameworks Exposure to market data ...

experience writing high-quality production code Strong foundation in operating systems and systems programming Proven track record in performance engineering Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus Understanding of cutting-edge ML infrastructure stack (e.g. PyTorch, CUDA) is also a plus Experience ...

host what we build. That means Linux servers, Docker containers, MySQL, Apache, Cloudflare in front and backups behind, across client sites, a dealer management system, telephony and our own site. When a PHP security release lands, every container gets patched within days, and someone checks that it did. This ...

functionality behind them, client portals, e-commerce and the software we write for one business at a time. The stack is PHP 8, MySQL, Apache, Docker and plain JavaScript, with a pre-commit hook that runs the linter and a checker for silent failures. We build by hand ...

bookings, quotes and portals, through our own dealer management system for car dealers, to CRMs and integrations written for one business. PHP 8, MySQL, Apache, Docker and plain JavaScript, with a pre-commit hook that runs the linter and a checker for silent failures. What you will be doing ...

Experience designing data products across source-aligned, aggregate and consumer-aligned patterns. Proven ability to architect and scale modern cloud data platforms using Snowflake, Apache Iceberg, Amazon Redshift, and S3. Hands-on expertise in developing robust data transformation pipelines and orchestrating complex workflows using dbt and Apache Airflow. ...

profiling, GC tuning, and squeezing performance where it counts Solid grasp of distributed systems architecture and in‐memory computing concepts Proven production experience with Apache Ignite — you’ve used it at scale, not just evaluated it Strong MongoDB skills — CRUD operations, indexing strategies, and performance tuning in production environments … knowledge and query optimisation in Oracle — you know how to make queries fast and keep them that way Solid experience with messaging technologies — Apache Kafka and/or Solace Proficiency in Linux environments and scripting — comfortable on the command line and automating where it matters Experience deploying and maintaining ...

maintain automation scripts in Python and Bash to streamline operational tasks and infrastructure management. Workflow Management: Configure, monitor, and maintain orchestration pipelines using Apache Airflow. System Monitoring & Reliability: Perform Linux system administration, configure system reliability monitoring using Datadog, and resolve complex production incidents. Operational Excellence: Provide technical support …/Linux administration and strong scripting skills (Python & Bash). Monitoring & Workflows: Experience with Datadog (or similar monitoring tools) and workflow orchestration platforms like Apache Airflow. Operations: Experience working with ITSM and task tracking tools (ServiceNow, Jira, Confluence), with comfort working in shift-based models supporting global teams. Proficiency ...

systèmes distribués La participation aux choix d’architecture et aux design reviews Environnement technique Langages : Rust (principal) Architectures distribuées : microservices, API gRPC Middleware : Apache Pulsar, RabbitMQ Cloud : AWS Stockage HPC : Lustre (ou équivalent) Réseaux (atout) : RDMA, libfabric GPU (connaissances appréciées) : CUDA, architecture mémoire Profil recherché Expérience significative en développement ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/… such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python, SQL, or an Object-Oriented language (Java/Scala). Nice to Haves Experience operating data assets ...

MLflow, VS Code or JupyterHub for model development, experimentation and deployment.* Work with technologies to access, manage and analyse data at scale (e.g., Apache Iceberg and Trino).**Delivery Excellence*** Participate fully in Agile ceremonies including sprint planning, backlog refinement, demonstrations and retrospectives.* Produce high-quality technical documentation … machine-learning models, including monitoring, drift detection and performance management.* Awareness of modern lakehouse or enterprise data platforms and technologies such as Trino and Apache Iceberg.* Experience in NLP, large language models, Generative AI, deep learning, graph analytics.* Responsible AI or retrieval-augmented generation.* Delivery of data products ...

MLflow, VS Code or JupyterHub for model development, experimentation and deployment. Work with technologies to access, manage and analyse data at scale (e.g., Apache Iceberg and Trino). Delivery Excellence Participate fully in Agile ceremonies including sprint planning, backlog refinement, demonstrations and retrospectives. Produce high-quality technical documentation … machine-learning models, including monitoring, drift detection and performance management. Awareness of modern lakehouse or enterprise data platforms and technologies such as Trino and Apache Iceberg. Experience in NLP, large language models, Generative AI, deep learning, graph analytics. Responsible AI or retrieval-augmented generation. Delivery of data products ...

robust, efficient, and ready to support advanced analytics and business insights. Responsibilities Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data. Collaborate with cross-functional teams to understand data requirements … with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles. Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components. Experience working with ETL tools such as Informatica for data integration tasks. Demonstrated ability to analyze complex datasets using ...

Apache Associates is looking for an organised, proactive Service Delivery Manager to lead Level 1 and Level 2 Support teams and Project Engineers. You will own day-to-day delivery of managed services and client projects, ensuring SLA adherence and clear communication to clients. The role offers a hybrid ...

cloud-scale storage systems. Ideal candidates should have over 5 years of experience and a strong background in operating systems. Familiarity with tools like Apache Arrow and an understanding of machine learning infrastructure are preferred. The role requires in-person work in either NYC or London, supporting innovative storage ...

Consultant to support the implementation and deployment of Astronomer (Astro) within a leading asset management organisation. Job Responsibilities/Objectives Astronomer is built around Apache Airflow and is used to develop, schedule, automate and manage complex data pipelines. The organisation is currently implementing the platform and requires an experienced … ownership of the implementation and providing training and support to upskill the wider team. Experience with Astronomer/Astro is essential, alongside knowledge of Apache Airflow, dbt and Snowflake. Key Responsibilities Lead the implementation, build and deployment of Astronomer (Astro). Configure and manage Apache Airflow to schedule ...

Engineering Strong experience working with AWS in data engineering environments. Hands‐on experience with AWS Glue for data integration and processing. Strong experience using Apache Airflow for workflow orchestration and pipeline management. Advanced Python development skills. Experience with Apache Spark or similar distributed data processing technologies would ...

British nationals only; dual citizenship is not permitted The opportunity We're urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract. You'll help build and maintain reliable data pipelines, develop cloud-based … essential. What you'll be doing Developing and maintaining data pipelines using Python and AWS services. Building, scheduling and monitoring data workflows with Apache Airflow. Integrating data from multiple sources and preparing it for downstream use. Improving pipeline reliability, performance and data quality. Investigating data processing issues and implementing ...

Scala programming to develop robust, scalable, and high-performance data processing applications. Build and optimise large-scale data processing and analytics pipelines using Apache Spark. Develop and maintain end-to-end data pipelines for both batch and real-time data processing. Apply solid understanding of data engineering concepts, including … business stakeholders. Skills & Experience: Proven experience as a Software Engineer with a strong focus on Scala development. Extensive hands-on experience with OpenShift and Apache Spark. In-depth understanding of data engineering principles and practises. Experience in developing and maintaining scalable data pipelines for batch and real-time processing. ...

Build repeatable evaluations, investigate failure cases and use the results to guide model and pipeline improvements. Orchestrate data and model workflows. Build and maintain Apache Airflow pipelines, with monitoring, retries and clear approaches to failure recovery. Deploy and operate AI services. Work with AWS services including Lambda, ECS/… through unfamiliar problems. You’re comfortable discussing trade-offs, asking questions and taking responsibility for delivery. Useful additional experience LLMs or NLP, GPU workloads, Apache Airflow, AWS, infrastructure-as-code tools such as Pulumi, or financial-market data. You don’t need experience with every tool in our stack. ...

system deployment using tools such as Ansible, Puppet or Chef Desirable Skills/Experience Familiar with the Big Data tech stacks, including: Trino Spark Apache Hive Apache Airflow Zeppelin notebooks Our Package Tailored benefits make a real difference. That’s why we offer a comprehensive range to support ...