edu.stanford.nlp.optimization

Class InefficientSGDMinimizer<T extends Function>

java.lang.Object

edu.stanford.nlp.optimization.StochasticMinimizer<T>

edu.stanford.nlp.optimization.InefficientSGDMinimizer<T>

All Implemented Interfaces:

HasEvaluators, Minimizer<T>

public class InefficientSGDMinimizer<T extends Function>
extends StochasticMinimizer<T>

Stochastic Gradient Descent Minimizer.

The basic way to use the minimizer is with a null constructor, then the simple minimize method:

Minimizer smd = new InefficientSGDMinimizer();
DiffFunction df = new SomeDiffFunction(); //Note that it must be a incidence of AbstractStochasticCachingDiffFunction
double tol = 1e-4;
double[] initial = getInitialGuess();
int maxIterations = someSafeNumber;
double[] minimum = qnm.minimize(df,tol,initial,maxIterations);

Constructing with a null constructor will use the default values of

batchSize = 15;
initialGain = 0.1;

NOTE: This class was previously called SGDMinimizer. SGDMinimizer is now what was StochasticInPlaceMinimizer. New projects should use that class, since it uses the ideas of Bottou's work to provide efficient SGD.

Since:

1.0

Version:

1.0

Author:

Alex Kleeman

Nested Class Summary

Nested classes/interfaces inherited from class edu.stanford.nlp.optimization.StochasticMinimizer

StochasticMinimizer.PropertySetter<T1>

Field Summary

Fields inherited from class edu.stanford.nlp.optimization.StochasticMinimizer

bSize, file, gain, gen, grad, gradList, infoFile, k, maxTime, memory, newGrad, newX, nf, numBatches, numPasses, outputFrequency, outputIterationsToFile, quiet, v, x

Constructor Summary

Constructors

Constructor and Description
InefficientSGDMinimizer()
InefficientSGDMinimizer(double SGDGain, int batchSize)
InefficientSGDMinimizer(double SGDGain, int batchSize, int passes)
InefficientSGDMinimizer(double SGDGain, int batchSize, int passes, boolean outputToFile)
InefficientSGDMinimizer(double SGDGain, int batchSize, int passes, long maxTime)
InefficientSGDMinimizer(double SGDGain, int batchSize, int passes, long maxTime, boolean outputToFile)

Method Summary

Modifier and Type	Method and Description
protected java.lang.String	getName()
static void	main(java.lang.String[] args)
void	setBatchSize(int batchSize)
void	shutUp()
protected void	takeStep(AbstractStochasticCachingDiffFunction dfunction)
Pair<java.lang.Integer,java.lang.Double>	tune(Function function, double[] initial, long msPerTest)
Pair<java.lang.Integer,java.lang.Double>	tune(Function function, double[] initial, long msPerTest, double gainLow, double gainHigh)

Methods inherited from class edu.stanford.nlp.optimization.StochasticMinimizer

gainSchedule, init, minimize, minimize, say, sayln, setEvaluators, smooth, tune, tuneBatch, tuneDouble, tuneDouble, tuneGain

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InefficientSGDMinimizer

public InefficientSGDMinimizer()

InefficientSGDMinimizer

public InefficientSGDMinimizer(double SGDGain,
                               int batchSize)

InefficientSGDMinimizer

public InefficientSGDMinimizer(double SGDGain,
                               int batchSize,
                               int passes)

InefficientSGDMinimizer

public InefficientSGDMinimizer(double SGDGain,
                               int batchSize,
                               int passes,
                               boolean outputToFile)

InefficientSGDMinimizer

public InefficientSGDMinimizer(double SGDGain,
                               int batchSize,
                               int passes,
                               long maxTime)

InefficientSGDMinimizer

public InefficientSGDMinimizer(double SGDGain,
                               int batchSize,
                               int passes,
                               long maxTime,
                               boolean outputToFile)

Method Detail

shutUp

public void shutUp()

Overrides:

shutUp in class StochasticMinimizer<T extends Function>

setBatchSize

public void setBatchSize(int batchSize)

getName

protected java.lang.String getName()

Specified by:

getName in class StochasticMinimizer<T extends Function>

tune

public Pair<java.lang.Integer,java.lang.Double> tune(Function function,
                                                     double[] initial,
                                                     long msPerTest,
                                                     double gainLow,
                                                     double gainHigh)

tune

public Pair<java.lang.Integer,java.lang.Double> tune(Function function,
                                                     double[] initial,
                                                     long msPerTest)

Specified by:

tune in class StochasticMinimizer<T extends Function>

takeStep

protected void takeStep(AbstractStochasticCachingDiffFunction dfunction)

Specified by:

takeStep in class StochasticMinimizer<T extends Function>

main

public static void main(java.lang.String[] args)