src.corpora.indexer

Functions

read_cache_file

Reads the cache files produced by cache_and_group and yields tokenized sequences.

Classes

IndexedDataset