src.core.trainerΒΆ

trainer.py

Custom Hugging Face Trainer that allows for online eval of multiple datasets.

Classes

LMDataCollator

OnlineBenchmarkTrainer

Trainer that handles online evaluation datasets -- e.g., LAMBADA and Wikitext 103 Perplexity Scores.