Skip to content

LanguageModelReaderConfig

Module: fast_llm.data.dataset.memmap.config

Variant of: MemmapReaderBaseConfig — select with type: language_model

Inherits from: MemmapIndexDatasetReaderConfig, MemmapReaderConfig, MemmapReaderBaseConfig

Fields

advantages
Type: MemmapReaderBaseConfig    Default: (sub-fields optional)
begin
Type: int    Default: (required)
chosen_spans
Type: MemmapReaderBaseConfig    Default: (sub-fields optional)
end
Type: int    Default: (required)
image_patches
Type: MemmapReaderBaseConfig    Default: (sub-fields optional)
loss_masking_spans
Type: MemmapReaderBaseConfig    Default: (sub-fields optional)
old_log_probabilities
Type: MemmapReaderBaseConfig    Default: (sub-fields optional)
rejected_spans
Type: MemmapReaderBaseConfig    Default: (sub-fields optional)
tokens
Type: TokenReaderConfig    Default: (sub-fields optional)