# Finetuning LLM model using serverless container

**URL:** https://forum.verda.com/t/finetuning-llm-model-using-serverless-container/67
**Category:** General Discussion
**Created:** [October 20, 2025, 1:57pm UTC](https://forum.verda.com/t/finetuning-llm-model-using-serverless-container/67 "2025-10-20T13:57:03Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![Alpaca](https://avatars.discourse-cdn.com/v4/letter/a/ecccb3/32.png) [@Alpaca](https://forum.verda.com/u/Alpaca)
#### Post date: [October 20, 2025, 1:57pm UTC](https://forum.verda.com/t/finetuning-llm-model-using-serverless-container/67/1 "2025-10-20T13:57:03Z")

</div>

Hi, I want to deploy a finetuned LLM model using serverless container. Since the model is quite large (\>100GB), it’s not super practical to download the model before the request.

I have also noticed sometimes a new request creates a container and it’d download the image again. How can I make sure that my image and its models are downloaded just once?

---

<div class="post-metadata">

### Author: ![TeamVerda](https://dub1.discourse-cdn.com/flex014/user_avatar/forum.verda.com/teamverda/32/36_2.png) [@TeamVerda](https://forum.verda.com/u/TeamVerda)
#### Post date: [October 21, 2025, 6:28am UTC](https://forum.verda.com/t/finetuning-llm-model-using-serverless-container/67/2 "2025-10-21T06:28:57Z")

</div>

Hi @Alpaca, you can use the general storage for storing weights. This volume will then be shared between all replicas of your deployment. Please download to `/data` in your container or change the mount to whatever location your container would save the weights to.

 ![image](https://europe1.discourse-cdn.com/flex014/uploads/datacrunch1/original/1X/c026e5010a6b5974f9e29d4fd645d165a9f6d1fa.png)
