4 of 4 Remote/Hybrid Apache Spark Jobs in the South East

Data Engineer, working with large-scale, complex datasets in regulated environments Scala development experience supporting analytics or data-processing solutions Hands-on experience with Apache Spark for large-scale distributed data processing Experience with model calibration, threshold management, and score explainability to meet AML governance and regulatory standards … Analyst or Data Engineer, working with large, complex datasets in regulated environments Solid Scala development experience, writing and supporting scalable data and analytics solutions Apache Spark experience, including batch and/or dynamic processing of high-volume data About Us FDM is an award-winning global leader ...

while also ensuring the stability and reliability of existing workloads. Key Responsibilities Design, build, and optimise data pipelines within Azure Databricks using PySpark and Spark SQL Develop and manage Delta Lake-based data models , supporting a structured Lakehouse/Medallion architecture (Bronze, Silver, Gold layers) Support the ingestion … downstream consumption Required Skills & Experience Strong commercial experience working with Azure Databricks as a core data processing platform Deep expertise in: PySpark/Apache Spark for distributed data processing Delta Lake (ACID transactions, optimisation, data versioning) Spark SQL and advanced SQL techniques Python for data engineering ...

source models or integrating with managed foundation model platforms. Hands-on experience building data pipelines and model workflows using tools such as Python, SQL, Spark or similar data processing technologies. Experience deploying and operating AI systems in cloud environments using containerisation, managed ML services or serverless architectures. Understanding ...

backend services using Java Work within cloud-native AWS environments Contribute to containerised workloads (Docker/Kubernetes) Build and support data-intensive systems (including Spark where applicable) Collaborate with architects and engineers on system design and delivery Participate in agile delivery, code reviews, and technical discussions Required Skills & Experience … background Experience working in distributed systems Conditional (must meet at least 2 of the below) AWS 3+ years hands-on experience Big Data/Spark 3+ years Containerisation Docker and/or Kubernetes, 3+ years Payments domain 23 years experience Nice to Have Infrastructure as Code (Terraform) Event-driven ...