10 of 10 Permanent Apache Spark Jobs in the City of London

data services. DataOps Knowledge: Experienced with CI/CD for data workflows, version control (e.g., Git), and automation in data engineering. Desirable: Experience with Apache Spark Familiarity with machine learning frameworks and libraries Understanding of data governance and compliance Strong problem-solving and analytical skills Excellent communication and More ❯

proficiency - from writing queries to basic database operations Exposure to cloud infrastructure, ideally AWS Bonus: Experience with streaming/data tools such as Kafka, Spark, or Delta Lake Technology Stack & Environment You'll be working with: AWS, Kubernetes, Kafka, Argo Java 17, Python 3, HDF5 Distributed systems processing large More ❯

proficiency - from writing queries to basic database operations Exposure to cloud infrastructure, ideally AWS Bonus: Experience with streaming/data tools such as Kafka, Spark, or Delta Lake Technology Stack & Environment You'll be working with: AWS, Kubernetes, Kafka, Argo Java 17, Python 3, HDF5 Distributed systems processing large More ❯

proficiency - from writing queries to basic database operations Exposure to cloud infrastructure, ideally AWS Bonus: Experience with streaming/data tools such as Kafka, Spark, or Delta Lake Technology Stack & Environment You'll be working with: AWS, Kubernetes, Kafka, Argo Java 17, Python 3, HDF5 Distributed systems processing large More ❯

Fabric, AWS Redshift). Strong understanding of data modelling (relational, dimensional, NoSQL) and ETL/ELT processes . Experience with data integration tools (e.g., Apache Kafka, Talend, Informatica) and APIs . Familiarity with big data technologies (e.g., Hadoop, Spark) and real-time streaming Expertise in cloud security , data More ❯

availability architectures Background creating reporting and reconciliation applications Undertsanding of OTC products with CDS, Interest Rate Swaps, Variance Swaps etc. needed Expertise with C++, Spark, Kafka would be hugely beneficial The key skillset is Python, but your expertise should extend to managing large datasets with PostgreSQL, and you should More ❯

Highlights: Spearheading the evolution of the company's data platform as it scales beyond MVP Building and maintaining scalable data pipelines using Python, Java, Spark, SQL, and more Partnering with cross-functional teams (Product, Finance, Ops, Customer Success) to deliver actionable insights and reliable data solutions Designing data models … environments Proficiency in Python (preferred), with experience in other languages like Java, Scala, or TypeScript Strong knowledge of cloud-based big data tools (AWS, Spark, EMR, Lambda, etc.) Excellent communication and problem-solving skills, with a collaborative mindset A passion for supporting SMEs through innovative, data-led technology Background … analytics-driven companies is a plus Tech Environment Includes: TypeScript (React.js/Node.js) Python & Java AWS Cloud Infrastructure Modular Monolith Architecture Big Data Tools (Spark, EMR, Lambda More ❯

as a Senior Data Scientist with Machine Learning expertise Strong understanding of ML models and observability tools Proficiency in Python and SQL Experience with Spark and Apache Airflow Knowledge of ML frameworks (PyTorch, TensorFlow, Scikit-Learn) Experience with cloud platforms, preferably AWS Experience with containerization technologies Useful information More ❯

Prior Senior Data Scientist with Machine Learning experience ** Strong understanding and experience with ML models and ML observability tools ** Strong Python and SQL experience ** Spark/Apache Airflow ** ML frame work experience (PyTorch/TensorFlow/Scikit-Learn) ** Experience with cloud platforms (preferably AWS) ** Experience with containerisation technologies More ❯

to enhance the user experience. Key skills: ** Senior Data Scientist experience ** Commercial experience in Generative AI and recommender systems ** Strong Python and SQL experience ** Spark/Apache Airflow ** LLM experience ** MLOps experience ** AWS Additional information: This role offers a strong salary of up to £95,000 (Depending on More ❯