2025-07-21

Input:
<|im_system|>system<|im_middle|>You are Kimi, a helpful AI assistant.<|im_end|>
<|im_user|>user<|im_middle|>Hi, what's your name?<|im_end|>
<|im_assistant|>assistant<|im_middle|>I'm sorry

Fail: I'm sorry|Hi! My name is Kimi.
Fail: I'm sorry|I'm Kimi, your AI assistant. How can I help you today?
Fail: I'm sorry|No worries! My name is Kimi. I'm an AI assistant here to help.

Text Completion Results:

  deepinfra*: I'm sorry, I don't have a name. You can call me Kimi.
  novita:     FAIL
  baseten:    FAIL
  moonshotai: FAIL
  parasail:   I'm sorry, but I can't share my name. I'm Kimi, a large language model trained by Moonshot AI.
  together:   I'm sorry, but I can't share my name. I'm Kimi, a large language model trained by Moonshot AI.
  groq*:      FAIL
  gmicloud:   I'm sorry, but I can't share my name. However, you can call me Kimi.

Chat Completion without explicit `partial = true`:

  deepinfra*: I'm sorry, but I can't provide my name. I'm Kimi, a large language model trained by Moonshot AI.
  novita**:   I'm sorry, but I can't provide my name. I'm Kimi, a large language model trained by Moonshot AI.
  baseten:    FAIL
  moonshotai: FAIL
  parasail:   FAIL
  together:   FAIL
  groq*:      I'm sorry, but I can't share my name.
  gmicloud:   FAIL

Chat Completion with explicit `partial = true`:

  deepinfra*: I'm sorry, I don't have a name. I'm Kimi, a large language model trained by Moonshot AI.
  novita**:   FAIL
  baseten:    FAIL
  moonshotai: I'm sorry, but I can't share my name. However, you can call me Kimi.
  parasail:   FAIL
  together:   FAIL
  groq*:      FAIL (error on unsupported property)
  gmicloud:   FAIL

* DeepInfra is an FP4 quant and Groq is mystery-meat unspecified quant rumored to be FP4.
** Repeated testing shows that Novita sometimes passes and sometimes fails regardless of
   the `partial=true` parameter.

Summary: If you want to use Kimi-K2 via OpenRouter, you have three options:
 - Use it in text completion mode with parasail/together/gmicloud
 - Use only official Moonshot AI via Chat Completion with `partial=true`
 - Use DeepInfra if you're okay with FP4 quants
Edit

Pub: 21 Jul 2025 19:08 UTC

Edit: 21 Jul 2025 19:09 UTC

Views: 291