THE SOURCE IN CONTEXT
The pinned Kimi-K3 recipe defaults to moonshotai/Kimi-K3 (mxfp4). Its effective default-variant minimum is vLLM 0.29.0. Select the exact variant, hardware override and topology before treating it as a launch plan. No deployment was run by this site.
Which artifact and engine does this recipe select?
The recipe identifies moonshotai/Kimi-K3 as its model family entry and selects moonshotai/Kimi-K3 by default. The default precision label is mxfp4; model-wide and variant-specific runtime requirements are kept separately below. The document revision fixes what the recipe said, while the weight revision and executed runtime revision remain separate fields. A model-family title alone cannot establish either artifact identity.
Source: vllm-project · pinned document
What needs special attention for this model?
The default MXFP4 footprint is explicitly described as estimated in the pinned recipe. Do not promote that estimate to a measured deployment just because the current model repository is available. Quantization-aware-trained MXFP4 with MXFP8 activations is a particular kernel path. Keep decode-context parallelism, tensor parallelism and draft options separate.
Source: vllm-project · pinned document
How should the settings be applied?
Choose one artifact variant and one hardware profile from the original recipe, then resolve its shared, variant, hardware, strategy and optional-feature settings together. The base arguments listed here are only one layer and are deliberately not presented as a complete runnable command. Check any nightly-image requirement and the model’s parsers before loading weights. A context declaration is a model limit, while batched-token and sequence settings control a serving workload.
Source: vllm-project · pinned document
What does the memory number mean?
The GB figure is the recipe’s declared planning minimum for the selected variant. It is not a site measurement, a universal peak allocation or a promise of maximum context. KV cache, auxiliary/draft models, image encoders, temporary workspace and active requests still require memory. Keep GB and GiB distinct, and use the actual artifact size and runtime allocation for a machine-specific budget.
Source: vllm-project · pinned document
What is needed to reproduce a deployment?
Save the model and conversion revisions, weight hashes, tokenizer/template, container or runtime digest, device count/topology and complete resolved launch. First check one short public request. For a subsequent measurement, fix input and output counts, concurrency, cache state, warmup, sampling, reasoning effort, repetitions and failures. The declarations on this page are source configuration facts; no throughput or quality outcome follows from them.
Source: vllm-project · pinned document
What does the source specify?
These declarations belong to the cited document. A planning minimum, model limit and measured runtime allocation are different quantities.
| Architecture | moe |
|---|---|
| Total parameters as counted by recipe | 2.8T |
| Active parameters as counted by recipe | 16 experts/token + shared (of 896 routed) |
| Native context declaration (tokens) | 1048576 |
| Model-wide minimum vLLM | 0.29.0 |
| Effective default-variant minimum vLLM | 0.29.0 |
| Default artifact | moonshotai/Kimi-K3 |
| Default precision label | mxfp4 |
| Default planning minimum (GB; recipe declaration) | 1680 |
| Default variant hardware allowlist | ["h100", "h200", "b200", "b300", "gb200", "gb300", "mi300x", "mi325x", "mi355x"] |
| Shared base arguments (incomplete launch) | ["--trust-remote-code", "--gpu-memory-utilization", "0.95"] |
| Declared compatible strategies | ["single_node_tp", "multi_node_tp", "multi_node_tep", "multi_node_tp_pp", "multi_node_dep", "pd_cluster"] |
| Optional feature names | ["tool_calling", "reasoning", "spec_decoding", "text_only", "decode_context_parallelism"] |
| Features selected by default | ["spec_decoding", "text_only", "decode_context_parallelism"] |
AI-assisted source reading and original editorial synthesis; no independent model execution.