Package edu.stanford.nlp.trees.international

Classes for character set conversion and Unicode-based tokenization.

See:
          Description

Class Summary
CHTBTokenizer A simple tokenizer for tokenizing Penn Chinese Treebank files.
 

Package edu.stanford.nlp.trees.international Description

Classes for character set conversion and Unicode-based tokenization.

Author:
Roger Levy


Stanford NLP Group