Set up API

Home Website Guide


To search in the rentry with keywords (on computer):

  • On Windows: CTRL + F
  • On Mac: Command + F


Configure the LLM

Prompt

This section allow to change the API/Model, edit everything "written" (Pre-history Instructions/System Prompt, Post-history Instructions/Jailbreak, assistant prefill, etc. It also has a lot of toggles (ban emojis, use names, text streaming, etc.)

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. After editing anything, remember to save.

Prompt

Parameters

This section allow to change lorebooks settings, and more generally everything with numbers (Temperature, Penalties, Top P, Top K, etc.)

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Generation Parameters'.
  4. After editing anything, remember to save.

Parameters

Choose an existing preset

With a preset, the API, model, prompt and settings are already configured. It's plug and play.

You can choose an existing preset

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select a preset in the 'Search for preset' dropdown menu.
  4. Save.

Preset

Mars & Mercury

Only with a subscription ! No need to set up the API, just configure it.

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select Mars or Mercury in the 'API' dropdown menu.
  5. Select your model in the 'model' dropdown menu.
  6. Save.

Mars preset

Mercury preset

Some default settings

Click here for recommended presets

1
2
3
4
5
6
7
Temperature : 0.6-0.8
Repetition penalty : 1.1-1.2
Frequency penalty : 1.1-1.2
Top P : 0.99
Top K : 50 (Doesn't work currently)
Context size : No more than your model's
Max new tokens : 300

Chub Freemium

No need to set up the API, just configure it.

  • Context size: 8192 tokens
  • 300 messages per day.
  1. Tap on the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select Free/Mobile in the 'API' dropdown menu.
  5. Select Free/Mobile in the 'model' dropdown menu.
  6. Save.

Free preset

Some default settings

Click here for recommended presets

1
2
3
4
5
6
7
Temperature : 0.6-0.8
Repetition penalty : 1.2
Frequency penalty : 1.2
Top P : 0.99
Top K : 50 (Doesn't work currently)
Context size : No more than your model's
Max new tokens : 300

OpenAI

Adding the key

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'OpenAI'.
  4. Add your API key.
  5. Check your API key. !!! If you don't, you may get errors !!!

Ìt saves automatically.

Set API OpenAI

Setting up Reverse proxy/OpenAI mimic

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'OpenAI'.
  4. Select 'Reverse proxy'.
  5. Add your URL.
  6. Add your key.
  7. Check your proxy.

You won't be able to see the key if you open the page again, it's normal. The key is still saved. If you have any issue with generating, contact your provider.

Set OpenAI mimic

Select API/Model

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select OpenAI in the 'API' dropdown menu.
  5. Select your model in the 'model' dropdown menu.
  6. Save.

Preset

Some default settings

1
2
3
4
5
6
7
Temperature : 0.8
Repetition penalty : 0.1 - 0.3
Frequency penalty : 0.1 - 0.3
Top P : 0.99
Top K : 50 (Doesn't work currently)
Context size : No more than your model's
Max new tokens : 300

Anthropic

Adding the key

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'Anthropic'.
  4. Add your API key.
  5. Check your API key.

Ìt saves automatically.

Set API Anthropic

Setting up Reverse proxy

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'Anthropic'.
  4. Select 'Reverse proxy'.
  5. Add your URL.
  6. Add your key.
  7. Check your proxy.

You won't be able to see the key if you open the page again, it's normal. The key is still saved. If you have any issue with generating, contact your provider.

Set Anthropic mimic

Select API/Model

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select Anthropic in the 'API' dropdown menu.
  5. Select your model in the 'model' dropdown menu.
  6. Save.

Preset

Some default settings

1
2
3
4
5
6
7
Temperature : 0.8
Repetition penalty : 0
Frequency penalty : 0
Top P : 1
Top K : 0
Context size : No more than your model's
Max new tokens : Depending on your taste

Kobold

Adding the URL

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'Kobold'.
  4. Add your URL.
  5. Check your URL.

Ìt saves automatically.

Set API Kobold

Select API/Model

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select Kobold in the 'API' dropdown menu.
  5. Save.

Preset


Ooba

Adding the URL

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'Ooba'.
  4. Add your URL.
  5. Check your URL.

Ìt saves automatically.

Set API Ooba

Select API/Model

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select Ooba in the 'API' dropdown menu.
  5. Save.

Preset


OpenRouter

Adding the key

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'OpenRouter'.
  4. Add your API key.
  5. Check your API key. !!! If you don't, you may get errors !!!

Ìt saves automatically.

Set API OpenRouter

Select API/Model

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select OpenRouter in the 'API' dropdown menu.
  5. Select your model in the 'model' dropdown menu.
  6. Save.

Preset


Palm 2

Adding the key

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'Palm 2'.
  4. Add your API key.
  5. Check your API key.

Ìt saves automatically.

Set API Google

Select API/Model

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select Google in the 'API' dropdown menu.
  5. Select your model in the 'model' dropdown menu.
  6. Save.

Preset


NovelAI

Adding the key

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Secrets'.
  3. Select 'NovelAI'.
  4. Add your API key.
  5. Check your API key.

Ìt saves automatically.

Set API NovelAI

Select API/Model

  1. Press the three lines on the top right corner of your chat window.
  2. Select 'Configuration'.
  3. Select 'Prompt Structure'.
  4. Select NovelAI in the 'API' dropdown menu.
  5. Select your model in the 'model' dropdown menu.
  6. Save.

Preset

Settings

NovelAI can only generate 150 tokens at a time.

Click here for recommended presets

Edit
Pub: 06 May 2024 13:05 UTC
Edit: 01 Dec 2024 11:28 UTC
Views: 4900