you'll among other things work with: Design and implement bespoke distributed compute platforms on AWS , architecting high-performance pipelines for machine learning, data processing, and analytics. Champion robust and scalable data workflows , leveraging your orchestration expertise to integrate diverse data sources, from lab equipment and scientific instruments to … not limited to: Workflow Orchestration platforms (Such as dagster.io) Data Engineering R Pandas Snowflake Data Catalogs Data Dashboarding SQL AI/ML Distributed/Parallelprocessing We welcome all levels of expertise, from junior to experienced professionals, to be part of our engineering team so don’t hesitate more »
underpin most data platforms. Ability to ingest, transform, integrate data from diverse sources into well-structured information assets. Knowledge of distributed computing techniques like parallelprocessing, streaming, batch workflow orchestration that enable handling large data volumes. Experience with ETL, data pipelines, and building automated workflows for moving and … processing data. Ability to optimize data systems for performance, scalability, reliability and monitoring. Information security knowledge to ensure proper access controls, encryption, anonymity for sensitive data assets. Understanding of data governance frameworks, metadata management, data quality, and lineage tracking We are specifically looking for candidates with both technical and more »
4+ years of relevant systems engineering experience 4 years of object-oriented Python Experience with distributed system technologies such as REST, gRPC, asynchronous and parallelprocessing Paxos - and raft-based consensus and coordination systems (etcd, consul, zookeeper) STEM degree If interested please interact with this advert or get more »
Preferred qualifications Engineering experience. People management experience, managing business intelligence engineers. Experience in designing and delivering cross functional custom reporting solutions. Experience with Massively ParallelProcessing (MPP) databases - Redshift (preferred) Excellent oral and written communication skills including the ability to communicate effectively with both technical and non-technical more »