edu.stanford.nlp.trees.international.arabic
Class ArabicTokenizer.ArabicTokenizerFactory
java.lang.Object
edu.stanford.nlp.trees.international.arabic.ArabicTokenizer.ArabicTokenizerFactory
- All Implemented Interfaces:
- IteratorFromReaderFactory<Word>, TokenizerFactory<Word>, Serializable
- Enclosing class:
- ArabicTokenizer
public static class ArabicTokenizer.ArabicTokenizerFactory
- extends Object
- implements TokenizerFactory<Word>, Serializable
A factory which vends ArabicTokenizers.
- Author:
- Christopher Manning
- See Also:
- Serialized Form
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
ArabicTokenizer.ArabicTokenizerFactory
public ArabicTokenizer.ArabicTokenizerFactory()
ArabicTokenizer.ArabicTokenizerFactory
public ArabicTokenizer.ArabicTokenizerFactory(boolean eolIsSignificant)
newTokenizerFactory
public static TokenizerFactory<Word> newTokenizerFactory()
- Constructs a new TokenizerFactory that returns Word objects and
treats carriage returns as normal whitespace.
THIS METHOD IS INVOKED BY REFLECTION BY SOME OF THE JAVANLP
CODE TO LOAD A TOKENIZER FACTORY. IT SHOULD BE PRESENT IN A
TokenizerFactory.
- Returns:
- A TokenizerFactory that returns Word objects
getIterator
public Iterator<Word> getIterator(Reader r)
- Specified by:
getIterator
in interface IteratorFromReaderFactory<Word>
getTokenizer
public Tokenizer<Word> getTokenizer(Reader r)
- Specified by:
getTokenizer
in interface TokenizerFactory<Word>
Stanford NLP Group