1 to 25 of 27 Apache Spark Jobs in the East of England

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … data Billing & revenue assurance Build models and pipelines to support network analytics, customer 360, churn prediction, fraud detection , etc. 7. Performance Optimization & Monitoring Tune Spark/Glue jobs for performance and cost. Monitor Redshift/Athena/S3 efficiency and implement best practices. Perform data quality checks and validation ...

also have Experience developing or using AI applications Experience with NoSQL databases (e.g. MongoDB). Experience with big data processing frameworks (e.g. Apache Spark). Knowledge of Large Language Model (LLM) integration, Retrieval-Augmented Generation (RAG), or Agentic AI frameworks. Experience with high-performance computing (HPC) environments (e.g. ...

tools (eg, Matplotlib, Seaborn, Tableau). Ability to work independently and lead projects from inception to deployment. Experience with big data technologies (eg, Hadoop, Spark) and cloud platforms (eg, AWS, GCP, Azure) is desirable. ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Apply now! Benefits and Contract Information Financial incentives: depending on circumstances, monthly family/marriage allowance of £278 monthly child allowance ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...

data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical ...