src.corpora.tokenization_utils.batched

batched(iterable: Iterable[T], batch_size: int) Iterable[List[T]][source]

Yields batches of the given size from the given iterable.