6 of 6 Apache Spark Jobs in Cheltenham

skills, with experience of Java or Scala beneficial Experience building large-scale ETL/ELT and data processing pipelines Hands-on experience with Apache Spark and distributed data processing technologies Experience designing and operating cloud-native data platforms, particularly within AWS Familiarity with Docker, Kubernetes and CI/ ...

robust data models, ETL pipelines, metadata frameworks, and modern data warehousing solutions. Design and optimise large-scale streaming data platforms using technologies such as Apache Flink and other real-time processing frameworks. Ensure all solutions comply with industry best practices, governance frameworks, and regulatory requirements, maintaining the highest standards … Lambda, Redshift , and related data services. Proven experience designing secure architectures within sensitive or highly regulated environments. Hands-on experience with Apache Flink and real-time data processing architectures. Strong understanding of data modelling methodologies, architectural patterns, and industry standards. Expertise across ETL processes, data integration, data warehousing, distributed ...

large language model (LLM) systems, including retrieval augmented generation (RAG) and fine-tuning. Build scalable ETL/ELT pipelines using tools such as Spark or dbt, so data is high quality, time-stamped, and ready for both training and real-time inference. Design and deploy data collection systems ...

. Experience with Natural Language Processing (NLP) and Large Language Models (LLMs). Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). These lists are not exhaustive ...

Automated system deployment using tools such as Ansible, Puppet or ChefDesirable Skills/Experience• Familiar with the Big Data tech stacks, including: o Trinoo Spark o Apache Hiveo Apache Airflowo Zeppelin notebooksOur PackageTailored benefits make a real difference. That’s why we offer a comprehensive range ...

implement robust data models, ETL pipelines, metadata frameworks, and modern data warehousing solutions.Design and optimise large-scale streaming data platforms using technologies such as Apache Flink and other real-time processing frameworks.Ensure all solutions comply with industry best practices, governance frameworks, and regulatory requirements, maintaining the highest standards … services, including EC2, S3, RDS, Lambda, Redshift, and related data services.Proven experience designing secure architectures within sensitive or highly regulated environments.Hands-on experience with Apache Flink and real-time data processing architectures.Strong understanding of data modelling methodologies, architectural patterns, and industry standards.Expertise across ETL processes, data integration, data warehousing ...