Interface: ModelConfig

Properties

expert _ dtype

• Optional expert_dtype: string

Some MoEs store their experts at a narrower precision than the rest of the model and declare it here, outside quantization_config (e.g. DeepSeek-V4 is quant_method: "fp8" for attention but expert_dtype: "fp4" for the experts, which dominate the parameter count).

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:724

---

quantization

• Optional quantization: MlxQuantizationConfig

Current MLX format, optionally with per-module overrides keyed by module name.

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:716

---

quantization _ config

• Optional quantization_config: MlxQuantizationConfig | QuantizationConfig

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:717

---

text _ config

• Optional text_config: Pick<ModelConfig, "expert_dtype" | "quantization" | "quantization_config">

Defined in

packages/hub/src/lib/parse-safetensors-metadata.ts:718

Update on GitHub