Skip to content

FastLLMModelConfig

Abstract

This class cannot be instantiated directly. Use one of the variants listed below.

Module: fast_llm.engine.multi_stage.config

Fields

base_modelcore

Type: BaseModelConfig    Default: (sub-fields optional)

Configuration for the base model.

distributedcore

Type: DistributedConfig    Default: (sub-fields optional)

Distributed configuration.

multi_stagecore

Type: MultiStageConfig    Default: (sub-fields optional)

Configuration for the stage breakdown of the model.

Variants

Select a variant by setting type: to one of the following values.

type value Class Description
gpt GPTModelConfig Configuration for the GPT model, including distributed, multi-stage, and HuggingFace checkpoint formats
multimodal MultiModalModelConfig

Used in