Senior Compute Platform Engineer

As a Senior Compute Platform Engineer on the Data Platform team, you will be part of the group responsible for building and running the data infrastructure that powers Zeta's platform, including Zeta’s lakehouse platform. The Data Platform team delivers reliable, cost‐efficient data processing that scales with growth — so engineers and analysts can focus on business problems instead of wrestling with infrastructure.

The Data Platform team empowers data scientists and data engineers through a Scala data warehouse framework designed for data modeling and the creation of type‐safe and easily testable batch jobs. The team also orchestrates a compute environment that simplifies the execution of Spark jobs, facilitating the analysis of terabytes of data with ease and cost‐effectiveness. The runtime environment is based on Hadoop clusters on EC2 spot instances, dynamically scaling up as required, ensuring high resource utilization and stability.

Our team is responsible for the development and deployment of the company's next‐generation technology, closely collaborating with other branches in San Francisco and Berlin. You will help grow the team through mentoring, code reviews, and knowledge sharing so others can work effectively with our stack.

• Operate and implement new features in the framework and the services managed by the team.
• Engage with data scientists and identify ways of improving their experience and productivity when using our framework and services.
• Identify and implement computational improvements.
• Make improvements and/or fix bugs by submitting patches to open‐source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others.
• Act as an expert on Spark and Scala.
• Mentor engineers (including through pairing, design discussions, and knowledge‐sharing sessions) and help raise the bar on quality, reliability, and good practices across the team.

• Minimum 7 years of software engineering experience.
• A degree in Computer Science, Software Engineering, Physics, Math, or a related field.
• 2+ years of experience and proficiency in Scala or other JVM‐based languages.
• Experience with Spark and/or other large‐scale data‐processing frameworks.
• Experience with Kubernetes is a plus.
• Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.).
• Interest in back‐end technologies, architecture, and passion for learning new things.
• Interest in math, statistics, or data science technology is a plus.
• Analytical approach to problems and pragmatic approach to solutions.
• Ability to work independently and enterprisingly in a dynamic environment where work priorities can change.
• Excellent interpersonal and communication skills, with the ability to discuss ideas in a distant and constructive manner.

The salary range for this role is £100,000 - £112,000, depending on location and experience.

Zeta considers applicants for employment without regard to, and does not discriminate on the basis of an individual’s sex, race, color, religion, age, disability, status as a veteran, or national or ethnic origin; nor does Zeta discriminate on the basis of sexual orientation, gender identity or expression.