Hi team,
I’d like to ask for shared storage for serverless containers. It’s telling me to add /data storage 500GB, but when I deploy the container, I don’t see any shared storage in the shared filesystems tab.
How can I get access to that storage? How can I upload files up there so I can use it for my containers?
Hi,
As of right now via UI, we have a scratch disk which is 500GB and it’s only accessible via deployment and all instances within that deployment share that. Essentially, for things like cache and model weights, you can download them once during container first startup. Afterwards, it’s then shared between all instance of a given deployment.
We also recently launched beta for SFS for Serverless Deployment and that is right now only accessible via API and soon will be released on UI. You can provision a SFS from the Storage tab under Serverless containers and then use the API to mount it to your deployment and use a CPU VM to access the SFS.