Java & Spark Engineer
Java & Spark Engineer
12 month contract
Hybrid - London (3 days per week in the office)
INSIDE IR35
AM Analytics offers a scalable, ML-ready platform for rapid portfolio model development and deployment. It combines data governance, Big Data, and AI—including GenAI capabilities— to boost alpha generation, enhance client services, and ensure regulatory compliance, while improving data quality and cost efficiency.
Join a strong Pune/US team to migrate from an IaaS Big Data platform to Azure-native Databricks. Responsibilities include:
- migrating and optimizing 500+ jobs using Databricks optimization techniques,
- managing 12 TB of data,
- tuning models for Azure with Java Spark and Delta tables,
- and addressing vulnerabilities through library version updates.
Current Tech Stack:
Python, Data Science, Gen AI (GPT, Embeddings, Document Intelligence), Java Spark- ETL, PostgreSQL, Cassandra, Service Bus, AKS (Azure Kubernetes), Terraform, Gitlab CICD, Autosys
Your expertise
You enjoy contributing collaboratively as part of a team as well as being recognized for your contribution and you have a pragmatic approach to challenges. You can listen as well as advise and guide others. You keep abreast of technical development in the industry and are keen to learn and develop.
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
- Worked as a software engineer for ideally 8+ years
- Experience with Java programming language
- Proficiency in Spark, Databricks, ETL tools and processes, and APIs.
- Strong knowledge of SQL and experience with data modeling and database design
- Strong knowledge of Microsoft Azure, e.g., SQL, ADF, ADLS, APIM, Functions
- Strong communication and collaboration skills