PatternBlockSequenceConfig

Module: fast_llm.layers.block.config

Variant of: BlockSequenceConfig — select with type: pattern

Inherits from: BlockSequenceConfig, BlockConfig, ModuleConfig

Fields

num_blocks — architecture

Type: int    Default: 12

Number of blocks in the model.

pattern — architecture

Type: list[str]    Default: None

The name of each block (key in blocks) in the repeated pattern.

lr_scale — feature

Type: float or None    Default: None

Scaling factor for the layer learning rate. Combines multiplicatively with the scale set by the parent and child layers, if applicable.

blocks

Type: dict[str, BlockConfig]    Default: (required)