Deploy Zenith-GPT2-124M Locally
⚠️ Not compatible with third-party clients
🖥️ Windows only — if you're on Linux, you probably already know how to adapt this
What You’ll Need
Download the fine-tuned model (you’ll need two things):
- The model file: Link
- A folder to store it
- The run script: https://files.catbox.moe/ocvfnu.py
- A Python environment
Step-by-Step Setup
- Go to python.org and download the latest version of Python.
Install it as admin, and make sure “Add to PATH” is checked during setup. - Put the model file and the run script into the same folder.
- Make sure the model zip is extracted, and the folder is named exactly:
Zenith-GPT2-124M.
It should be in the same directory as the run script. - Rename the run script to
run.py. - Click the folder path bar, type
cmd, and hit Enter to open a command prompt in that location.
For CUDA GPU Users
Once you're in the command prompt:
Now you're good to go — you can chat with the model.
For CPU Users
Same steps, just skip the CUDA-specific install:
And that’s it — the model should be up and running.