6 of 6 Permanent Apache Spark Jobs in Surrey

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

automation to ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client … languages like Python, Bash, or Go to automate tasks and build necessary tools. Expertise in designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. ...

such as Kubernetes, Docker, MLflow, Airflow, Terraform, and CI/CD. Preferred Skills Data Streaming and Orchestration: Familiarity with tools such as Kafka, Flink, Spark, dbt, and Airflow. Multi-Modal LLM Systems: Experience with multi-modal LLM systems (text + image embeddings). AI Observability and Evaluation: Exposure ...

such as Kubernetes, Docker, MLflow, Airflow, Terraform, and CI/CD. Preferred Skills Data Streaming and Orchestration: Familiarity with tools such as Kafka, Flink, Spark, dbt, and Airflow. Multi-Modal LLM Systems: Experience with multi-modal LLM systems (text + image embeddings). AI Observability and Evaluation: Exposure ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts at speed ...