2 of 2 Apache Spark Jobs in County Antrim

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...