HuggingFaceFileName

HuggingFaceFileName names the specific file within HuggingFaceRepoId to download. Many Hugging Face repos host several GGUF variants (different quantizations) — this field picks one.

Quick reference
Type string?
Default null (set by built-in presets)
Category Model source
Field on ModelSourceParameters.HuggingFaceFileName

What it does

Used alongside HuggingFaceRepoId. Built-in presets pick a sensible default (usually Q4_K_M); override to switch quantization.

For Qwen25Preset, the default is "Qwen2.5-7B-Instruct-Q4_K_M.gguf". Common alternatives in the same repo: Q4_0, Q5_K_M, Q6_K, Q8_0.

When to change it

Scenario Value
Default (preset’s value) unchanged
Higher quality, more memory Q5_K_M, Q6_K, Q8_0
Lower memory, lower quality Q4_0, IQ3_M, IQ2_XXS
Testing a specific quant Full file name from Hugging Face listing

See Understand quantization for a primer on which variant to pick.

Example

var preset = new Qwen25Preset();
// Switch to Q8 for higher quality — about 2x the file size
preset.BaseModelSourceParameters.HuggingFaceFileName = "Qwen2.5-7B-Instruct-Q8_0.gguf";

Or smaller for memory-tight hardware:

preset.BaseModelSourceParameters.HuggingFaceFileName = "Qwen2.5-7B-Instruct-IQ3_M.gguf";

Interactions

What’s next

HuggingFaceRepoId