3 of 3 Apache Spark Jobs in the East of England

orchestration — DAG design, scheduling, backfills, and reliabilityBuild and maintain data models and SQL-based warehouse/lakehouse structures for AdsApply distributed data processing (e.g., Spark) to handle scale and performance requirementsPartner with engineering and business stakeholders to define and track key Ads metricsCommunicate technical trade-offs clearly to engineering ...

Excellent verbal and written communication skills BS or MS degree in Computer Science or equivalent Experience in distributed computing frameworks like Hive/Hadoop, Apache Spark Experience in developing Finance or HR related applications Experience with cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic … Cache, Lambda Working experience with Terraform Experience in creating workflows for Apache Airflow What the job involves As a senior technical lead, you consider yourself a platform services developer and develop innovative solutions using modern software frameworks and paradigms You are self‐driven and a problem solver, with ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Other helpful information Hybrid Working: At EMBL-EBI we are pleased to offer hybrid working options for all our employees. A dedicated ...