edu.stanford.nlp.parser.lexparser

Class ChineseMarkovWordSegmenter

java.lang.Object

edu.stanford.nlp.parser.lexparser.ChineseMarkovWordSegmenter

All Implemented Interfaces:

WordSegmenter, Serializable

public class ChineseMarkovWordSegmenter
extends Object
implements WordSegmenter

Performs word segmentation with a hierarchical markov model over POS and over characters given POS.

Author:

Galen Andrew

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ChineseMarkovWordSegmenter(ChineseCharacterBasedLexicon lex, Index<String> wordIndex, Index<String> tagIndex)
ChineseMarkovWordSegmenter(ChineseTreebankParserParams params, Index<String> wordIndex, Index<String> tagIndex)

Method Summary

Modifier and Type	Method and Description
void	finishTraining()
void	initializeTraining(double numTrees)
void	loadSegmenter(String filename)
List<HasWord>	segment(String s)
void	train(Collection<Tree> trees)
void	train(List<TaggedWord> sentence)
void	train(Tree tree)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ChineseMarkovWordSegmenter

public ChineseMarkovWordSegmenter(ChineseCharacterBasedLexicon lex,
                                  Index<String> wordIndex,
                                  Index<String> tagIndex)

ChineseMarkovWordSegmenter

public ChineseMarkovWordSegmenter(ChineseTreebankParserParams params,
                                  Index<String> wordIndex,
                                  Index<String> tagIndex)

Method Detail

initializeTraining

public void initializeTraining(double numTrees)

Specified by:

initializeTraining in interface WordSegmenter

train

public void train(Collection<Tree> trees)

Specified by:

train in interface WordSegmenter

train

public void train(Tree tree)

Specified by:

train in interface WordSegmenter

train

public void train(List<TaggedWord> sentence)

Specified by:

train in interface WordSegmenter

finishTraining

public void finishTraining()

Specified by:

finishTraining in interface WordSegmenter

segment

public List<HasWord> segment(String s)

Specified by:

segment in interface WordSegmenter

loadSegmenter

public void loadSegmenter(String filename)

Specified by:

loadSegmenter in interface WordSegmenter