Skip to content

Data / Dataset / Memmap

Classes

Class Description
LanguageModelReaderConfig
MemmapDatasetConfig
MemmapIndexDatasetReaderConfig (abstract) Configuration for a standard memmap reader matching the indexed dataset interface, i.e.,
MemmapReaderBaseConfig (abstract) Configuration for a memmap reader or reader-like object
MemmapReaderConfig (abstract) Configuration for a standard memmap reader
NullReaderConfig Configuration for a dynamically disabled reader
PatchReaderBaseConfig
PatchReaderConfig
RangeReaderBaseConfig
RangeReaderConfig
TokenDataReaderConfig
TokenReaderConfig