DocumentSourceConfig

Module: fast_llm.data.preparation.gpt_memmap.config

Variant of: LanguageModelSourceConfig — select with type: document

Inherits from: LanguageModelSourceConfig

Fields

advantages — optional

Type: str or None    Default: None

Field containing advantaged for policy optimization. Mainly for debugging purposed as advantages are typically generated at runtime.

chosen_span — optional

Type: str or None    Default: None

Field containing chosen text for preference optimization.

image_positions — optional

Type: str or None    Default: None

Field containing image positions in the text.

images — optional

Type: str or None    Default: None

Field containing images.

loss_masking_spans — optional

Type: str or None    Default: None

Field containing character spans to mask for loss computation.

rejected_span — optional

Type: str or None    Default: None

Field containing rejected text for preference optimization.

text — optional

Type: str    Default: "text"

Field containing the document text.