NoNormalizationConfig

Module: fast_llm.layers.common.normalization.config

Variant of: NormalizationConfig — select with type: none

Inherits from: NormalizationConfig, ModuleConfig

Fields

lr_scale — feature

Type: float or None    Default: None

Scaling factor for the layer learning rate. Combines multiplicatively with the scale set by the parent layer and individual parameters, if applicable.