How to use vast.ai with SillyTavern for dummies
Support my addiction
Signup on vast.ai using my ref link to support my AI addiction
What you need:
- SillyTavern installed and ready to use
- Modefied Vast.ai Template
- A little bit of patience
Step1:
- Click on Console.
Step2:
- Login or Signup.
Step3:
Step4:
- Wait for the instance to load, when its done you will see: Status: success, running atinoda/text-generation-webui_default-nvidia-nightly/jupyter
Step5:
- Open the logs, scroll to the bottom and copy the cloudflare link(If you cant see the link close the log window and open it again)
Step6:
- In SillyTavern, click on the API settings, select text completion API, select default API type, paste the link into the server url field and click connect.
Step7:
- Go back to vast.ai and click on open, it will open text-generation-webui(oobabooga)
Done:
- You successfully launched textgenwebui and connected it to sillytavern.