City of London, London, United Kingdom Hybrid / WFH Options
AMS CWS
enterprise data systems. Migrate on-prem systems to Google Cloud Platform (GCP), leveraging Dataproc, BigQuery, and other GCP-native tooling. Use technologies such as ApacheSpark, Hadoop, and Scala to process large-scale distributed datasets. Contribute to infrastructure automation (CI/CD) and hybrid cloud deployment pipelines using … to architecture and system design. Skills and Qualifications: Technical Essentials: Strong Scala development skills with experience in large-scale Big Data environments. Proficiency in ApacheSpark; working knowledge of Hadoop. Familiarity with GCP (Dataproc, BigQuery) or other public cloud platforms (AWS, Azure). Experience with Kubernetes or OpenShift More ❯
tools (AWS, Azure, GCP) and associated data services (e.g., S3, Redshift, BigQuery). Familiarity with Docker, k8s Proficiency with big data processing frameworks (e.g., ApacheSpark, Kafka, Flink). Knowledge of time-series databases and tools like KDB+, InfluxDB, or QuestDB. Experience with market data feeds (e.g., Bloomberg More ❯
architects to design scalable solutions. Ensure adherence to best practices in Databricks data engineering. Required Skills & Experience: Hands-on experience with Microsoft Databricks and Apache Spark. Strong knowledge of Git, DevOps integration, and CI/CD pipelines. Expertise in Unity Catalog for data governance and security. Proven ability to More ❯
integration and customer data platforms (CDPs) such as Adobe Experience Platform, Salesforce Data Cloud, or Segment. Hands-on experience with tools like SQL, Python, Spark, Kafka, Airflow, or dbt. More ❯
