edu.stanford.nlp.ie.crf

Class CRFClassifierNonlinear<IN extends CoreMap>

java.lang.Object

edu.stanford.nlp.ie.AbstractSequenceClassifier<IN>

edu.stanford.nlp.ie.crf.CRFClassifier<IN>

edu.stanford.nlp.ie.crf.CRFClassifierNonlinear<IN>

All Implemented Interfaces:

java.util.function.Function<java.lang.String,java.lang.String>

public class CRFClassifierNonlinear<IN extends CoreMap>
extends CRFClassifier<IN>

Subclass of CRFClassifier for implementing the nonlinear architecture in [Wang and Manning IJCNLP-2013 Effect of Nonlinear ...].

Author:

Mengqiu Wang

Field Summary

Fields inherited from class edu.stanford.nlp.ie.crf.CRFClassifier

DEFAULT_CLASSIFIER

Fields inherited from class edu.stanford.nlp.ie.AbstractSequenceClassifier

classIndex, featureFactories, flags, knownLCWords, pad, windowSize

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	CRFClassifierNonlinear()
	CRFClassifierNonlinear(java.util.Properties props)
	CRFClassifierNonlinear(SeqClassifierFlags flags)

Method Summary

Modifier and Type	Method and Description
Triple<int[][][],int[],double[][][]>	documentToDataAndLabels(java.util.List<IN> document) Convert a document List into arrays storing the data features and labels.
protected CliquePotentialFunction	getCliquePotentialFunctionForTest()
void	loadClassifier(java.io.ObjectInputStream ois, java.util.Properties props) Loads a classifier from the specified InputStream.
protected void	loadTextClassifier(java.io.BufferedReader br)
void	serializeClassifier(java.io.ObjectOutputStream oos) Serialize the classifier to the given ObjectOutputStream.
protected void	serializeTextClassifier(java.io.PrintWriter pw)
protected double[]	trainWeights(int[][][][] data, int[][] labels, Evaluator[] evaluators, int pruneFeatureItr, double[][][][] featureVals)

Methods inherited from class edu.stanford.nlp.ie.crf.CRFClassifier

addProcessedData, allLabels, classify, classifyGibbs, classifyGibbs, classifyMaxEnt, classifyWithGlobalInformation, combine, documentsToDataAndLabels, documentsToDataAndLabelsList, dropFeaturesBelowThreshold, dumpFeatures, extractDatumSequence, getClassifier, getClassifier, getClassifier, getClassifier, getClassifier, getClassifier, getClassifierNoExceptions, getCliqueTree, getCliqueTree, getCliqueTrees, getDefaultClassifier, getDefaultClassifier, getMinimizer, getMinimizer, getNumWeights, getObjectiveFunction, getSequenceModel, loadAuxiliaryData, loadClassIndexFromFile, loadDefaultClassifier, loadDefaultClassifier, loadFeatureIndexFromFile, loadProcessedData, loadTagIndex, loadTextClassifier, loadWeightsFromFile, main, makeAnswerArraysAndTagIndex, makeDatum, printFactorTable, printFactorTableDocument, printFactorTableDocuments, printFeatures, printFirstOrderProbs, printFirstOrderProbsDocument, printFirstOrderProbsDocuments, printLabelInformation, printLabelValue, printProbsDocument, pruneNodeFeatureIndices, saveProcessedData, scaleWeights, serializeClassifier, serializeClassIndex, serializeFeatureIndex, serializeTextClassifier, serializeWeights, to2D, topWeights, toString, train, updateWeightsForTest, writeWeights, zeroOrderProbabilities

Methods inherited from class edu.stanford.nlp.ie.AbstractSequenceClassifier

apply, backgroundSymbol, classify, classifyAndWriteAnswers, classifyAndWriteAnswers, classifyAndWriteAnswers, classifyAndWriteAnswers, classifyAndWriteAnswers, classifyAndWriteAnswers, classifyAndWriteAnswers, classifyAndWriteAnswersKBest, classifyAndWriteAnswersKBest, classifyAndWriteViterbiSearchGraph, classifyFile, classifyFilesAndWriteAnswers, classifyFilesAndWriteAnswers, classifyKBest, classifyRaw, classifySentence, classifySentenceWithGlobalInformation, classifyStdin, classifyStdin, classifyToCharacterOffsets, classifyToString, classifyToString, classifyWithInlineXML, countResults, countResultsSegmenter, defaultReaderAndWriter, finalizeClassification, getKnownLCWords, getSampler, labels, loadClassifier, loadClassifier, loadClassifier, loadClassifier, loadClassifier, loadClassifier, loadClassifierNoExceptions, loadClassifierNoExceptions, loadClassifierNoExceptions, loadClassifierNoExceptions, loadClassifierNoExceptions, makeObjectBankFromFile, makeObjectBankFromFile, makeObjectBankFromFiles, makeObjectBankFromFiles, makeObjectBankFromFiles, makeObjectBankFromReader, makeObjectBankFromString, makePlainTextReaderAndWriter, makePlainTextReaderAndWriter, makeReaderAndWriter, plainTextReaderAndWriter, printFeatureLists, printFeatures, printProbs, printProbs, printProbsDocuments, printResults, reinit, segmentString, segmentString, train, train, train, train, train, train, windowSize, writeAnswers

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.function.Function

andThen, compose, identity

Constructor Detail

CRFClassifierNonlinear

protected CRFClassifierNonlinear()

CRFClassifierNonlinear

public CRFClassifierNonlinear(java.util.Properties props)

CRFClassifierNonlinear

public CRFClassifierNonlinear(SeqClassifierFlags flags)

Method Detail

documentToDataAndLabels

public Triple<int[][][],int[],double[][][]> documentToDataAndLabels(java.util.List<IN> document)

Description copied from class: CRFClassifier

Convert a document List into arrays storing the data features and labels. This is used at test time.

Overrides:

documentToDataAndLabels in class CRFClassifier<IN extends CoreMap>

Parameters:

document - Testing documents

Returns:

A Triple, where the first element is an int[][][] representing the data, the second element is an int[] representing the labels, and the third element is a double[][][] representing the feature values (optionally null)

getCliquePotentialFunctionForTest

protected CliquePotentialFunction getCliquePotentialFunctionForTest()

Overrides:

getCliquePotentialFunctionForTest in class CRFClassifier<IN extends CoreMap>

trainWeights

protected double[] trainWeights(int[][][][] data,
                                int[][] labels,
                                Evaluator[] evaluators,
                                int pruneFeatureItr,
                                double[][][][] featureVals)

Overrides:

trainWeights in class CRFClassifier<IN extends CoreMap>

serializeTextClassifier

protected void serializeTextClassifier(java.io.PrintWriter pw)
                                throws java.lang.Exception

Overrides:

serializeTextClassifier in class CRFClassifier<IN extends CoreMap>

Throws:

java.lang.Exception

loadTextClassifier

protected void loadTextClassifier(java.io.BufferedReader br)
                           throws java.lang.Exception

Overrides:

loadTextClassifier in class CRFClassifier<IN extends CoreMap>

Throws:

java.lang.Exception

serializeClassifier

public void serializeClassifier(java.io.ObjectOutputStream oos)

Description copied from class: CRFClassifier

Serialize the classifier to the given ObjectOutputStream.
(Since the classifier is a processor, we don't want to serialize the whole classifier but just the data that represents a classifier model.)

Overrides:

serializeClassifier in class CRFClassifier<IN extends CoreMap>

loadClassifier

public void loadClassifier(java.io.ObjectInputStream ois,
                           java.util.Properties props)
                    throws java.lang.ClassCastException,
                           java.io.IOException,
                           java.lang.ClassNotFoundException

Description copied from class: CRFClassifier

Loads a classifier from the specified InputStream. This version works quietly (unless VERBOSE is true). If props is non-null then any properties it specifies override those in the serialized file. However, only some properties are sensible to change (you shouldn't change how features are defined).

Note: This method does not close the ObjectInputStream. (But earlier versions of the code used to, so beware....)

Overrides:

loadClassifier in class CRFClassifier<IN extends CoreMap>

Parameters:

ois - The InputStream to load the serialized classifier from

props - This Properties object will be used to update the SeqClassifierFlags which are read from the serialized classifier

Throws:

java.lang.ClassCastException - If there are problems interpreting the serialized data

java.io.IOException - If there are problems accessing the input stream

java.lang.ClassNotFoundException - If there are problems interpreting the serialized data