PretrainedGPTModelConfig

Module: fast_llm.models.gpt.config

Inherits from: PretrainedFastLLMModelConfig

Fields

model — core

Type: GPTModelConfig    Default: (sub-fields optional)

Configuration for the Fast-LLM model.

pretrained — feature

Type: CheckpointLoadConfig    Default: (sub-fields optional)

Configuration for loading the configuration and state of a pretrained model.

Used in

• reference_models in GPTTrainerConfig