How to use S/Zlaude or Reverse Proxy?

This rentry has answers to all the possible problems a user might come across while setting up Slaude/Zlaude. Anything that's not in here, you might have to figure it out by yourself.


Table of contents


  • How to add Claude to Slack?

    • Go to apps and search for Claude.
    • "But the Install button is greyed out", then click on learn more, you will be redirected to Antrhopic's official website.
    • Click on "Add Claude to Slack" or whatever the black button in the middle says. And give it the necessary permissions in the next page.
    • Now go back to your workspace and Enable slack connect trial and create a channel using Slack Connect. How? Like that👇
      • Step 1 Step 1
      • Step 2 Step 2
    • Now ping claude and accept TOS.
  • Token is abnormal and similar errors.

    • Something is definitely wrong with the cookies, tokens or the member ID you added to config.js. "But i did it like it asked me to!", Well apparently you did not because the console won't show the error if you did, so be a good boy/girl/rebel and do it all over again until its fixed.
  • "Ping_Message" is undefined and similar errors

    • You forgot to place a comma at the end of the field right above the "Ping_message" line. Anything's "Undefined"? Check if there's a comma at the end of the line before.
  • Syntax error with the ping message

    • Ping is supposed to be wrapped in backticks (`), so it should look like: PING MESSAGE: `r(funny symbol)- blah blah blah`,. Pay attention to the comma here
  • Message generated on Slack, but does not appear in SillyTavern

    • Slaude ignores threads sometimes, it will be apparent since it is logged in the console whenever slaude does it. Relax, nothing's wrong, maybe restart slaude once again.
  • What is Zlaude?

    • Read the README.md of Zlaude, it contains everything, any error you face while using this, its either already covered in this rentry, or you did not read the guidelines for Zlaude properly.
  • Const has already been defined kind of errors with Zlaude.

    • You tried to add the filter for the same tags more than once, The steps to deal with this have been addressed in the README.md of FilterConfigurationModule. You either change the name of the regular expression and update its new name in the replace part for it if the regex patterns are diff, or you delete the duplicate entries if you just added the same patterns twice.
  • Claude acting dumb, short responses

    • As of 2/7/2023, Claude on Slack seems to have been replaced with Claude-instant, hence the drop in quality of responses. You can still get good responses out of it with good prompts.
  • Does Zlaude Support API keys?

    • If you need XML filtering for API keys (or Poe), go here.
  • I launched the instance, what do i do, how do i connect?

    • Write some random letters in the bar under the OPEN AI key heading here and use open ai as the Chat completion source: Type random shit in the bar
    • Now click on that button the white arrow points towards and enter the http://localhost:5004 url under the OpenAI/Claude reverse proxy heading (where there's https://api.openai.co... written in the picture).
      URL goes here
  • How to use reverse proxy?

    Proxies log your chats, use of your own volition. Use a VPN if possible.

    • So where you put that localhost URL above, you will now put the reverse proxy URL there and in the API bar you have to put the password for the proxy(if any), write random letters if no password is setup. Do not leave your API key in there if you are connecting to a proxy, the proxy owner will receive it otherwise. Select Claude as the Chat completion source if its a claude reverse proxy and use OAI if the proxy offers OAI models.
  • How to deal with repetition?

    • For Zlaude users

      • Read the default ping_message in Zlaude's config.js, that will help you the concept of making prompts for Zlaude. You make the AI do bg taks in XML tags to help it craft a proper and desired response, and Zlaude filters the bg tasks out of the response. Except for the approach used in the Ping_Message, you can also ask the AI to produce a draft response in <draft></draft> tags along with the repetitions/probable repetitions in the <prune></prune> tags, then ask it to scan the draft response for repetitions that it enclosed in <prune> and other repetitions that it might have missed in <ooc>, you can also ask it to perform other optimizations here, and then you can have it generate a final response. The prompt for this can be tricky to make, as it can get a bit difficult for the AI to maintain coherency while performing these tasks, and the response time also goes up. You can also add drive the plot forward in your prompts.
    • For reverse proxies

      • You can use XML with Reverse proxies too with FilterConfigurationModule, but i prefer playing with the parameters here. Here's an oversimplied explanation generated by GPT-4 of what some of the parameters are supposed to do:

        Hi there! Imagine you have a bowl of colorful jelly beans. Each jelly bean has a letter on it, and the AI model helps you pick the next jelly bean (or letter) to create words and sentences.
        Top P: Let's say you want the AI to pick the most likely jelly beans, but not always the same ones. You set Top P to 0.9, so the AI will choose from the top 90% most likely jelly beans. This way, you get a good mix of jelly beans (or letters) without always picking the same ones.
        Top K: Imagine you only want the AI to pick from the top 5 most likely jelly beans. You set Top K to 5, so the AI can only choose from those top 5 jelly beans. This creates more predictable words and sentences.
        Temperature: This is like a "fun" dial for the AI. If you set the temperature high (like 1.0), the AI will pick more random jelly beans, making the words and sentences more creative but sometimes weird. If you set it low (like 0.1), the AI will pick more predictable jelly beans, making the words and sentences safer but less creative.
        In summary, Top P, Top K, and Temperature are settings for AI models that help control how creative or predictable the generated words and sentences will be.

  • Claude's response shows up as "undefined" in the console, even though i have the right password for the proxy

    • Add /v1 at the end of the proxy url.

Regards,
Flamanon

Edit
Pub: 02 Jul 2023 18:17 UTC
Edit: 06 Jul 2023 07:30 UTC
Views: 536