edu.stanford.nlp.stats
Class MultiClassChunkEvalStats

java.lang.Object
  extended by edu.stanford.nlp.stats.MultiClassPrecisionRecallStats<L>
      extended by edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats<String>
          extended by edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats.MultiClassStringLabelStats
              extended by edu.stanford.nlp.stats.MultiClassChunkEvalStats
All Implemented Interfaces:
Scorer<String>

public class MultiClassChunkEvalStats
extends MultiClassPrecisionRecallExtendedStats.MultiClassStringLabelStats

Calculates phrase based precision and recall (similar to conlleval) Handles various encodings such as IO, IOB, IOE, BILOU, SBEIO, [] Usage: java edu.stanford.nlp.stats.MultiClassChunkEvalStats [options] < filename -r - Do raw token based evaluation -d - Specifies delimiter to use (instead of tab) -b - Boundary token (default is -X- ) -t - Default tag to use if tag is not prefixed (i.e. is not X-xxx ) -ignoreProvidedTag - Discards the provided tag (i.e. if label is X-xxx, just use xxx for evaluation)

Author:
Angel Chang

Nested Class Summary
 
Nested classes/interfaces inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats
MultiClassPrecisionRecallExtendedStats.MultiClassStringLabelStats, MultiClassPrecisionRecallExtendedStats.StringStringConverter
 
Field Summary
 
Fields inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats
correctGuesses, foundCorrect, foundGuessed, stringConverter, tokensCorrect, tokensCount
 
Fields inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallStats
fnCount, fpCount, labelIndex, negIndex, negLabel, tpCount
 
Constructor Summary
MultiClassChunkEvalStats(Classifier<String,F> classifier, GeneralDataset<String,F> data, String negLabel)
           
MultiClassChunkEvalStats(Index<String> dataLabelIndex, String negLabel)
           
MultiClassChunkEvalStats(String negLabel)
           
 
Method Summary
protected  void addGuess(LabeledChunkIdentifier.LabelTagType guess, LabeledChunkIdentifier.LabelTagType correct, boolean addUnknownLabels)
           
protected  void addGuess(String guess, String trueLabel, boolean addUnknownLabels)
           
 void clearCounts()
           
protected  void finalizeCounts()
           
 LabeledChunkIdentifier getChunker()
           
 String getConllEvalString()
           
static void main(String[] args)
           
protected  void markBoundary()
           
 
Methods inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats
addGuess, addGuesses, getAccuracy, getAccuracyDescription, getAccuracyInfo, getConllEvalString, getCorrect, getCorrect, getLabels, getRelevant, getRelevant, getRetrieved, getRetrieved, score, score, score, score, score, score, score, score, setLabelIndex
 
Methods inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallStats
getDescription, getF1Description, getF1Description, getFMeasure, getFMeasure, getPrecision, getPrecision, getPrecisionDescription, getPrecisionDescription, getPrecisionInfo, getPrecisionInfo, getRecall, getRecall, getRecallDescription, getRecallDescription, getRecallInfo, getRecallInfo, score
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

MultiClassChunkEvalStats

public MultiClassChunkEvalStats(Classifier<String,F> classifier,
                                GeneralDataset<String,F> data,
                                String negLabel)

MultiClassChunkEvalStats

public MultiClassChunkEvalStats(String negLabel)

MultiClassChunkEvalStats

public MultiClassChunkEvalStats(Index<String> dataLabelIndex,
                                String negLabel)
Method Detail

getChunker

public LabeledChunkIdentifier getChunker()

clearCounts

public void clearCounts()
Overrides:
clearCounts in class MultiClassPrecisionRecallExtendedStats<String>

finalizeCounts

protected void finalizeCounts()
Overrides:
finalizeCounts in class MultiClassPrecisionRecallExtendedStats<String>

markBoundary

protected void markBoundary()
Overrides:
markBoundary in class MultiClassPrecisionRecallExtendedStats<String>

addGuess

protected void addGuess(String guess,
                        String trueLabel,
                        boolean addUnknownLabels)
Overrides:
addGuess in class MultiClassPrecisionRecallExtendedStats<String>

addGuess

protected void addGuess(LabeledChunkIdentifier.LabelTagType guess,
                        LabeledChunkIdentifier.LabelTagType correct,
                        boolean addUnknownLabels)

getConllEvalString

public String getConllEvalString()
Overrides:
getConllEvalString in class MultiClassPrecisionRecallExtendedStats<String>

main

public static void main(String[] args)
                 throws Exception
Throws:
Exception


Stanford NLP Group