How to use vast.ai with SillyTavern for dummies

What you need:

Step1:

  • Click on Console.
    Console

Step2:

  • Login or Signup.
    Signup

Step3:

Step4:

  • Wait for the instance to load, when its done you will see: Status: success, running atinoda/text-generation-webui_default-nvidia-nightly/jupyter
    Wait for instance to load

Step5:

  • Open the logs, scroll to the bottom and copy the cloudflare link(If you cant see the link close the log window and open it again)
    Open the logs
    Cloudflare link

Step6:

  • In SillyTavern, click on the API settings, select text completion API, select default API type, paste the link into the server url field and click connect.
    ST Connect

Step7:

  • Go back to vast.ai and click on open, it will open text-generation-webui(oobabooga)
    Open textgen

Done:

  • You successfully launched textgenwebui and connected it to sillytavern.
    Done
Edit
Pub: 24 Sep 2024 17:13 UTC
Views: 69