1 of 1 Apache Spark Jobs in North Yorkshire

architectures. Familiarity with document processing pipelines, chunking strategies, and semantic search patterns. Familiarity with data pipeline and orchestration tools (e.g., Airflow, dbt, Spark, Kafka, cloud-native ETL tools) and batch vs. streaming patterns. Understanding of data governance (catalog, lineage, security, RBAC, masking, compliance requirements like GDPR/CCPA). … data science and ML workflows (feature engineering, experimentation, model training/deployment, RAG pipeline development, prompt engineering) and tools/languages such as Python, Spark, notebooks, and ML frameworks (e.g., scikit-learn, MLflow, TensorFlow/PyTorch, LangChain, LlamaIndex at a conceptual level). Consulting Skills Skilled at asking ...