📜 The Pygmalion Wiki — If you're new to Pygmalion, please read this first. This will answer most of your basic questions.
☁️ To run Pygmalion on the cloud, choose one of the links below and follow the instructions to get started:
- TextGen WebUI — Simple CAI-like interface. Also known as Oobabooga. Runs on a Gradio app, but you can also connect it to SillyTavern for a more feature-rich interface.
- KoboldAI Horde — The Horde lets you run Pygmalion online with the help of generous people who are donating their GPU resources.
- Agnaistic — Free online interface with no registration needed. It runs on the Horde by default so there's no setup needed, but you can also use any of the AI services it accepts as long as you have the respective access key.
🖥️ To run Pygmalion locally (on your own computer), follow one of the guides below:
Make sure your machine meets the system requirements before downloading.
- TextGen WebUI — This guide will help you install the TextGen WebUI (also known as Oobabooga).
- KoboldAI — This guide will help you install KoboldAI, a browser-based frontend.
- koboldcpp — Use KoboldCPP to run models on CPU, or a mix of GPU+CPU.
- SillyTavern — Atmospheric interface. This is only a UI; you need to connect it to a service like TextGen or Kobold.
🤖 To create and share characters, refer to the links below:
- Character Card Creator — Most interfaces use character cards, which are images that have extra data inside them that define the character.
- Character Hub — A place to share and download character cards (the site is SFW by default but has a NSFW toggle)
- Pygmalion Links
- List of Pygmalion models
- Includes all Pygmalion base models and fine-tunes (models built off of the original). Newer models are recommended.
- Pygmalion 2 7B and Pygmalion 2 13B are chat/roleplay models based on Meta's Llama 2.
- Mythalion 13B is a merge between Pygmalion 2 and Gryphe's MythoMax.
- Blog post (including suggested generation parameters for SillyTavern)
Quantized by TheBloke:
Quantized models can run on less powerful machines, though they tend to hallucinate more than full-precision models.
GGUF is recommended for those without a powerful GPU, since these models can be offloaded to CPU (although it's a lot slower).
- Pygmalion 2 7B GPTQ
- Pygmalion 2 7B GGUF
- Pygmalion 2 13B GPTQ
- Pygmalion 2 13B GGUF
- Mythalion 13B GPTQ
- Mythalion 13B GGUF
These models are outdated and not guaranteed to work on all text generation services.
- Metharme 13B — Instruction model based on Meta's LLaMA 13B
- Metharme 7B — Instruction model based on Meta's LLaMA 7B
- Pygmalion 13B — Chat model based on Meta's LLaMA 13B
- Pygmalion 7B — Chat model based on Meta's LLaMA 7B
- Pygmalion 6B — Based on EleutherAI's GPT-J 6B
- Pygmalion 2.7B — Based on EleutherAI's GPT-Neo 2.7B
- Pygmalion 1.3B — Based on EleutherAI's Pythia 1.3B
- Pygmalion 350M — Based on Facebook's OPT 350M
Colab users: Due to high resource usage, Google does not allow the string
PygmalionAI in Colab code. You can still use Colab with other models. Almost all Colabs now use different unbanned versions of Pygmalion.
Developers have been working on an official UI, which will eventually be hosted here. In the meantime, you can enjoy Pygmalion using one of the following interfaces:
A combined front-end and back-end for running models like LLaMA, GPT-J, Pythia, etc.
- Installation guide by Oobabooga
- Installation guide by PygmalionAI
- Colab — This is your go-to if you want to run ooba without installing locally.
- Local Installers — One-click installer. For Windows, Linux, and MacOS systems.
A back-end for running a wide range of open language models.
- Installation guide
- TPU Colab — Runs larger (20B) models.
- GPU Colab — Runs smaller (6B/13B) models.
- Horde Client (More info on AI hordes)
A backend for running GGUF models for CPU+GPU inference.
An atmospheric interface forked from TavernAI that features lots of customization options. Note that SillyTavern is only a front-end; it needs to connect with a back-end such as Kobold or TextGen (see above).
- Harpy Chat
- Spicy Chat
- Chub Venus
- Persona AI
- Unhinged AI
- miku.gg — Open-source UI to run chatbots. Allows visual and text-to-speech (TTS).
- RisuAI — Tavern-like frontend, feature-rich and has plugins. Run in web or with installer.
- AgnAIstic — UI based on Pygmalion's Galatea interface. Runs chatbots anonymously, no login required.
- Faraday.dev — Run open-source LLMs on your computer. Completely offline. Zero configuration.
- Open Playground — An LLM playground you can run on your laptop.
- Laika's LiteVN UI — Highly customizable visual novel-like UI.
- RenAI Chat — Virtual Novel interface to chat with AI models.
- MonikA.I. — "This project aims to add new AI based features to Monika After Story mod with the submod API."
- Pygmalion Wiki — Work-in-progress Wiki. Answers most of your basic questions about Pygmalion and LLMs in general.
- Alpin's Pygmalion Guide — Very thorough guide for installing and running Pygmalion on all types of machines and systems.
- Spiritual successor to the original rentry guide.
- "Okay, so what the heck is a chatbot?" — Very simple and helpful guide to getting a chatbot up and running on Tavern.
- CharacterAI chatlog dumping
- General guide to open-source chatbots
- The Novice's LLM Training Guide — Read this if you want to learn how to train your own LLMs
- Bot Creation Guide
- Ali:Chat — "Ali:Chat’s principle idea is using dialogue as the formatting to express and reinforce traits/characteristics. Ali:Chat can either be used by itself or combined with another style."
- Ali:Chat Lite — Token-optimized character format
- PLists — "PLists are where you describe the traits of a character. This includes personality, clothing, body, and even the environment of your RP."
- Pygmalion Tips
- Pygmalion character creation + writing tips
- How to make a character
- Importing CAI characters to Pygmalion
- Character Hub (Chub) — Share and download Tavern cards (SFW; has a NSFW toggle)
- Tavern card booru — Share and download Tavern cards (NSFW)
- BotPrompts — List of JSON files for Pygmalion (Inactive)
- /aids/ Prompts — Story prompts for KoboldAI bots
- AVAKson's Character Editor
- JSON character creator — Enter your character info to create Pygmalion-compatible JSON files
- TAIConvert — Convert TavernAI cards to JSON files
- CAI tools — A Chrome extension made for CAI data scraping. Allows you to download all of your CAI bot's chat history, as well as their definitions (if you have access to them).
- Awesome Marketing Datascience — An absolutely exhaustive list of resources and tools regarding LLMs, image/audio generation software, and more.
- LLM Explorer — Almost every open LLM you can think of is listed here.
- TheBloke's model list — Thousands of quantized open models to choose from, take your pick.
- Local Llama Subreddit
- Machine Learning subreddit
- What LLM to Use? — A repository of up-to-date LLM lists.
- Awesome Totally Open Chatgpt — A list of open-source alternatives to ChatGPT
- Pickaxe Project — Build, manage, and deploy custom LLM tools
- There's An AI For That — Massive list of user-submitted AIs from a wide variety of categories, including conversational, image gen, audio, and a lot more. The site itself was written by ChatGPT.
- Simon Willison's Weblog — News on LLMs and machine learning
- Local model links
- More local model links
- Ayumi's RP Rankings
- Local Model General Resource Guide
Keep your Smile. Keep on Smiling.