NormalInitializationConfig

Module: fast_llm.engine.config_utils.initialization

Variant of: InitializationConfig — select with type: normal

Inherits from: InitializationConfig

Fields

max — optional

Type: float or None    Default: None

Max value for initialization clamping.

mean — optional

Type: float    Default: 0

Mean for normal initialization.

min — optional

Type: float or None    Default: None

Min value for initialization clamping.

std — optional

Type: float    Default: 1

Standard deviation for normal initialization.