1 of 1 Data Pipeline Jobs in Suffolk

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...