edu.stanford.nlp.sequences

Class ColumnTabDocumentReaderWriter<IN extends CoreMap>

java.lang.Object

edu.stanford.nlp.sequences.ColumnTabDocumentReaderWriter<IN>

All Implemented Interfaces:

IteratorFromReaderFactory<java.util.List<IN>>, DocumentReaderAndWriter<IN>, java.io.Serializable

public class ColumnTabDocumentReaderWriter<IN extends CoreMap>
extends java.lang.Object
implements DocumentReaderAndWriter<IN>

Version of ColumnDocumentReaderAndWriter that doesn't read in entire file and stores it in memory before parsing it. Reads in one line at a time. Assumes that sequences are broken up by empty lines. Also differs from ColumnDocumentReaderAndWriter in following ways:

• Splits on tabs (delimiterPattern)
• Replaces within field whitespaces with "_" (replaceWhitespace)
• Assumes that a line with just one column and starts with "* xxxxx" indicates the document id (hasDocId)

Accepts the following properties

Field	Type	Default	Description
columns	String		Comma separated list of mapping between annotation (see AnnotationLookup) and column index (starting from 0). Example: word=0,tag=1
delimiter	String	\t	Regular expression for delimiter
replaceWhitespace	Boolean	true	Replace whitespaces with "_"
tokens	Class	edu.stanford.nlp.ling.CoreAnnotations$TokensAnnotation	Annotation field for tokens
tokenFactory	Class	edu.stanford.nlp.process.CoreLabelTokenFactory	Factory for creating tokens

Author:

Angel Chang, Sonal Gupta (made the class generic)

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ColumnTabDocumentReaderWriter()

Method Summary

Modifier and Type	Method and Description
java.util.Iterator<Annotation>	getDocIterator(java.io.Reader r)
java.util.Iterator<Annotation>	getDocIterator(java.io.Reader r, boolean includeText)
java.util.Iterator<java.util.List<IN>>	getIterator(java.io.Reader r) Return an iterator over the contents read from r.
void	init(java.util.Properties props)
void	init(SeqClassifierFlags flags) reads the tokenFactory and tokensAnnotationClassName from SeqClassifierFlags
void	init(SeqClassifierFlags flags, CoreTokenFactory<IN> tokenFactory, java.lang.String tokensAnnotationClassName)
void	init(java.lang.String map)
void	init(java.lang.String map, CoreTokenFactory<IN> tokenFactory, java.lang.String tokensAnnotationClassName)
void	init(java.lang.String name, java.util.Properties props)
void	printAnswers(java.util.List<IN> doc, java.io.PrintWriter out) This method prints the output of the classifier to a PrintWriter.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ColumnTabDocumentReaderWriter

public ColumnTabDocumentReaderWriter()

Method Detail

init

public void init(SeqClassifierFlags flags)

reads the tokenFactory and tokensAnnotationClassName from SeqClassifierFlags

Specified by:

init in interface DocumentReaderAndWriter<IN extends CoreMap>

Parameters:

flags - Flags specifying behavior

init

public void init(java.util.Properties props)

init

public void init(java.lang.String name,
                 java.util.Properties props)

init

public void init(java.lang.String map)

init

public void init(SeqClassifierFlags flags,
                 CoreTokenFactory<IN> tokenFactory,
                 java.lang.String tokensAnnotationClassName)

init

public void init(java.lang.String map,
                 CoreTokenFactory<IN> tokenFactory,
                 java.lang.String tokensAnnotationClassName)

getIterator

public java.util.Iterator<java.util.List<IN>> getIterator(java.io.Reader r)

Description copied from interface: IteratorFromReaderFactory

Return an iterator over the contents read from r.

Specified by:

getIterator in interface IteratorFromReaderFactory<java.util.List<IN extends CoreMap>>

Parameters:

r - Where to read objects from

Returns:

An Iterator over the objects

getDocIterator

public java.util.Iterator<Annotation> getDocIterator(java.io.Reader r)

getDocIterator

public java.util.Iterator<Annotation> getDocIterator(java.io.Reader r,
                                                     boolean includeText)

printAnswers

public void printAnswers(java.util.List<IN> doc,
                         java.io.PrintWriter out)

Description copied from interface: DocumentReaderAndWriter

This method prints the output of the classifier to a PrintWriter.

Specified by:

printAnswers in interface DocumentReaderAndWriter<IN extends CoreMap>

Parameters:

doc - The document which has answers (it has been classified)

out - Where to send the output