Data Storage in the Model R&D Lifecycle
· β 4 min read
1. Data Delivery Based on Object Storage As shown above, model R&D mainly involves three sub-platforms:
Data platform The data platform is mainly responsible for data-related management, such as data ingestion and data processing, ultimately producing the data needed for training.
The data platform stores raw data in object storage. During processing, it fetches data from object storage, processes it, and stores the result back in object storage.