vLLM/Recipes
Search
Previewof vllm-project/vllm#64586 at 90781b3.

Moonshot AI

moonshotai·8 recipesHuggingFace

Multimodal

5
Kimi-K3.1-Pro
2.8T / 16 experts/token + shared (of 896 routed)
moe
MXFP41874G
v0.34.0+→
Kimi-K3
2.8T / 16 experts/token + shared (of 896 routed)
moe
MXFP41680GNVFP41650GFP83360GINT41711G
v0.29.0+→
Kimi-K2.7-Code
1T / 32B
moe
INT4714G
v0.19.1+→
Kimi-K2.6
1T / 32B
moe
INT4714GNVFP4600GFP81200GNVFP4600G
v0.25.0+→
Kimi-K2.5
1T / 32B
moe
INT4714GNVFP4600GMXFP4669G
v0.19.1+→

Text

3
Kimi-K2-Thinking
1T / 32B
moe
INT4600GNVFP4600GFP81200G
v0.12.0+→
Kimi-Linear-48B-A3B-Instruct
48B / 3B
moe
BF16115G
v0.11.2+→
Kimi-K2-Instruct
1T / 32B
moe
FP81200G
v0.12.0+→