DynatempRange

DynatempRange enables dynamic temperature (dynatemp). Instead of a fixed Temperature, the engine varies temperature per step based on how confident the model is at that step. Low-entropy (confident) steps drop the temperature; high-entropy (uncertain) steps raise it.

Quick reference
Type float
Default 0.0 (disabled)
Range 0.0 = disabled, typical active values 0.1 to 0.5
Category Adaptive temperature
Field on SamplerParameters.DynatempRange

What it does

At each step, llama.cpp computes the Shannon entropy of the current token distribution. It then adjusts Temperature within [Temperature - DynatempRange/2, Temperature + DynatempRange/2]:

  • When entropy is low (model is confident about the next token), temperature drops toward the lower bound: preserves the confident choice.
  • When entropy is high (many plausible tokens), temperature rises toward the upper bound: encourages variety where the model has no strong preference.

The exact shape of the entropy-to-temperature curve is controlled by DynatempExponent.

  • DynatempRange = 0.0 (default): dynatemp disabled; Temperature is used as-is.
  • DynatempRange = 0.3: moderate adaptive variation.
  • DynatempRange = 0.5: wide swing; near-greedy on confident steps, high variety on uncertain steps.

When to change it

Scenario Value
Default (disabled) 0.0
Slight adaptation 0.2
Classical dynatemp recipe 0.3 to 0.4
Aggressive adaptation 0.5

Dynatemp shines on mixed-content generation (structured plus creative) where fixed Temperature struggles. For pure factual tasks, leave disabled. For pure creative writing, fixed high Temperature is simpler.

Example

var preset = new Qwen25Preset();
preset.SamplerParameters.Temperature = 0.8f;          // mid-point
preset.SamplerParameters.DynatempRange = 0.3f;        // effective range [0.65, 0.95]
preset.SamplerParameters.DynatempExponent = 1.0f;     // linear entropy-to-temperature curve

using var api = AsposeLLMApi.Create(preset);

Interactions

  • Temperature: the base / mid-point around which dynatemp varies.
  • DynatempExponent: shapes the entropy-to-temperature curve.
  • Mirostat: alternative entropy-aware sampler; do not combine.

What’s next

FrequencyPenalty DynatempExponent