edu.stanford.nlp.trees.international.negra
Class NegraPennTokenizer

java.lang.Object
  edu.stanford.nlp.process.AbstractTokenizer<java.lang.String>
      edu.stanford.nlp.process.LexerTokenizer
          edu.stanford.nlp.trees.international.negra.NegraPennTokenizer

All Implemented Interfaces:

Tokenizer<java.lang.String>, java.util.Iterator<java.lang.String>

public class NegraPennTokenizer
extends LexerTokenizer

Produces a tokenizer for the NEGRA corpus in context-free Penn Treebank format.

Author:

Roger Levy

Field Summary

Fields inherited from class edu.stanford.nlp.process.AbstractTokenizer

nextToken

Constructor Summary

NegraPennTokenizer(java.io.Reader r)

Method Summary

static void

main(java.lang.String[] args)

Methods inherited from class edu.stanford.nlp.process.LexerTokenizer

getNext

Methods inherited from class edu.stanford.nlp.process.AbstractTokenizer

hasNext, next, peek, remove, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NegraPennTokenizer

public NegraPennTokenizer(java.io.Reader r)

Method Detail

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Throws:

java.io.IOException