edu.stanford.nlp.trees.international.negra

Class NegraPennTokenizer

java.lang.Object

edu.stanford.nlp.process.AbstractTokenizer<java.lang.String>

edu.stanford.nlp.process.LexerTokenizer

edu.stanford.nlp.trees.international.negra.NegraPennTokenizer

All Implemented Interfaces:

Tokenizer<java.lang.String>, java.util.Iterator<java.lang.String>

public class NegraPennTokenizer
extends LexerTokenizer

Produces a tokenizer for the NEGRA corpus in context-free Penn Treebank format.

Author:

Roger Levy

Field Summary

Fields inherited from class edu.stanford.nlp.process.AbstractTokenizer

NEWLINE_TOKEN, nextToken

Constructor Summary

Constructors

Constructor and Description
NegraPennTokenizer(java.io.Reader r)

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)

Methods inherited from class edu.stanford.nlp.process.LexerTokenizer

getNext

Methods inherited from class edu.stanford.nlp.process.AbstractTokenizer

hasNext, next, peek, remove, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Constructor Detail

NegraPennTokenizer

public NegraPennTokenizer(java.io.Reader r)

Method Detail

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Throws:

java.io.IOException