New to the system, how long does cold start take on serverless containers?
Hi NovaPulse
Sorry for the late response. That very much depends on how large weights the container handles. Usually it won’t be a complete cold start as our system tries to start the container on nodes which haves the container image already cached.
Thanks for the answer, another one regarding serverless containers:
If I have my custom comfyui docker images, deployed on serverless, but it’s not generating anything, it’s basically idle, am I still being charged for it?
Thanks for the questions, you are charged for time your containers are running. If you want them to shut down when you aren’t sending them requests, set minumum replicas to 0 and adjust scale down delays to what suits you. The containers will scale up when messages are received