edu.stanford.nlp.international.arabic.process
Class ArabicTokenizer.ArabicTokenizerFactory<T extends HasWord>

java.lang.Object
  extended by edu.stanford.nlp.international.arabic.process.ArabicTokenizer.ArabicTokenizerFactory<T>
All Implemented Interfaces:
IteratorFromReaderFactory<T>, TokenizerFactory<T>, java.io.Serializable
Enclosing class:
ArabicTokenizer<T extends HasWord>

public static class ArabicTokenizer.ArabicTokenizerFactory<T extends HasWord>
extends java.lang.Object
implements TokenizerFactory<T>, java.io.Serializable

See Also:
Serialized Form

Field Summary
protected  LexedTokenFactory<T> factory
           
protected  java.util.Properties lexerProperties
           
 
Method Summary
 java.util.Iterator<T> getIterator(java.io.Reader r)
          Return an iterator over the contents read from r.
 Tokenizer<T> getTokenizer(java.io.Reader r)
           
 Tokenizer<T> getTokenizer(java.io.Reader r, java.lang.String extraOptions)
           
static TokenizerFactory<CoreLabel> newTokenizerFactory()
           
 void setOptions(java.lang.String options)
          options: A comma-separated list of options
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

factory

protected final LexedTokenFactory<T extends HasWord> factory

lexerProperties

protected java.util.Properties lexerProperties
Method Detail

newTokenizerFactory

public static TokenizerFactory<CoreLabel> newTokenizerFactory()

getIterator

public java.util.Iterator<T> getIterator(java.io.Reader r)
Description copied from interface: IteratorFromReaderFactory
Return an iterator over the contents read from r.

Specified by:
getIterator in interface IteratorFromReaderFactory<T extends HasWord>
Parameters:
r - Where to read objects from
Returns:
An Iterator over the objects

getTokenizer

public Tokenizer<T> getTokenizer(java.io.Reader r)
Specified by:
getTokenizer in interface TokenizerFactory<T extends HasWord>

setOptions

public void setOptions(java.lang.String options)
options: A comma-separated list of options

Specified by:
setOptions in interface TokenizerFactory<T extends HasWord>

getTokenizer

public Tokenizer<T> getTokenizer(java.io.Reader r,
                                 java.lang.String extraOptions)
Specified by:
getTokenizer in interface TokenizerFactory<T extends HasWord>


Stanford NLP Group