# Run Ollama on the cloud server

**URL:** https://forum.verda.com/t/run-ollama-on-the-cloud-server/39
**Category:** Product Q&A
**Created:** [September 2, 2025, 10:56am UTC](https://forum.verda.com/t/run-ollama-on-the-cloud-server/39 "2025-09-02T10:56:17Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![Sky\_drifty](https://avatars.discourse-cdn.com/v4/letter/s/f19dbf/32.png) [@Sky\_drifty](https://forum.verda.com/u/Sky_drifty)
#### Post date: [September 2, 2025, 10:56am UTC](https://forum.verda.com/t/run-ollama-on-the-cloud-server/39/1 "2025-09-02T10:56:17Z")

</div>

How can I run ollama using serverless container on DataCrunch’s cloud server?

---

<div class="post-metadata">

### Author: ![TeamVerda](https://dub1.discourse-cdn.com/flex014/user_avatar/forum.verda.com/teamverda/32/36_2.png) [@TeamVerda](https://forum.verda.com/u/TeamVerda)
#### Post date: [September 2, 2025, 12:57pm UTC](https://forum.verda.com/t/run-ollama-on-the-cloud-server/39/2 "2025-09-02T12:57:27Z")

</div>

1. Create a DataCrunch account and top it up
2. Go to “Serverless containers” page and press

**New deployment:**

1. Choose a GPU, you need to ensure it has enough VRAM depending on what model you plan to run on the Ollama. H100 or H200 is generally a good choice to start experimenting with.
2. Set container image to: [docker.io/ollama/ollama:0.11.5](http://docker.io/ollama/ollama:0.11.5) Set exposed HTTP port to: 11434 Set Healthcheck path to: /api/tags
3. Now update your deployment and wait until it updates to running state. Make sure Start command is off. To pull a model to your Ollama deployment run following script (SQL):

> `#!/bin/bash`  
> `PAYLOAD=‘{`  
> `“name”: “llama3.1:8b”`  
> `}’`  
> `curl -X POST “``https://containers.datacrunch.io/``{name of your deployment}/api/pull” \`  
> `-H “Authorization: Bearer $TOKEN” \`  
> `-H ‘Content-Type: application/json’ \`  
> `-d “$PAYLOAD”`

Now test inference with your Ollama deployment

> ```sql
> #!/bin/bash
> PAYLOAD=‘{
> “model”: “llama3.1:8b”,
> “messages”: [
> {
> “role”: “user”,
> “content”: “What is deep learning?”
> }
> ],
> “stream”: false
> }’
> 
> ```
> 
> ```sql
> curl -X POST “https://containers.datacrunch.io/{name of your deployment}/api/chat” \
> -H “Authorization: Bearer $TOKEN” \
> -H ‘Content-Type: application/json’ \
> -d “$PAYLOAD”
> 
> ```

Remember to update `$TOKEN` to your DataCrunch API token and {name of your deployment} to actual name of your deployment.