edu.stanford.nlp.trees
Class PennTreebankStreamTokenizer

java.lang.Object
  |
  +--edu.stanford.nlp.io.StreamTokenizerAdapter
        |
        +--edu.stanford.nlp.trees.PennTreebankStreamTokenizer
All Implemented Interfaces:
StreamTokenizer

public class PennTreebankStreamTokenizer
extends StreamTokenizerAdapter
implements StreamTokenizer

Builds a tokenizer for English PennTreebank (release 2) trees.

Author:
Christopher Manning, Roger Levy

Constructor Summary
PennTreebankStreamTokenizer(Reader r)
           
 
Methods inherited from class edu.stanford.nlp.io.StreamTokenizerAdapter
isEol, next, pushBack, setEolString
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 
Methods inherited from interface edu.stanford.nlp.io.StreamTokenizer
next, pushBack
 

Constructor Detail

PennTreebankStreamTokenizer

public PennTreebankStreamTokenizer(Reader r)


Stanford NLP Group