3 of 3 Apache Spark Jobs in Bristol

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

search, LLM orchestration (e.g. LangGraph, LlamaIndex, Semantic Kernel), or LLM evaluation/observability (e.g. LangSmith, Ragas). Streaming and event-driven experience (e.g. Kafka, Spark Structured Streaming). Relevant cloud and/or data engineering certifications. Specialist tracks (we'd love depth in one of these … need all of them): Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search and Unity Catalog, or Azure OpenAI, Azure AI Foundry and Azure AI Search. AWS: Glue, Lambda, Step Functions ...

writing, talks, or threads about building with AI. MLOps and model serving experience (BentoML, MLflow, Vertex AI, SageMaker). Streaming and batch ingestion pipelines (Spark, Airflow, Beam, Glue). Healthcare or life sciences domain exposure. AWS Professional certification or other relevant industry certifications. What We Offer At Newpage ...