edu.stanford.nlp.scenegraph

Class BoWSceneGraphParser

java.lang.Object

edu.stanford.nlp.scenegraph.AbstractSceneGraphParser

edu.stanford.nlp.scenegraph.BoWSceneGraphParser

public class BoWSceneGraphParser
extends AbstractSceneGraphParser

A MaxEnt classifier-based scene graph parser. Takes a dependency parse, performs some enhancements using SemanticGraphEnhancer, extracts objects and attributes using the EntityExtractor and a EntityClassifier and predicts the relations between theese objects and attributes to build a SceneGraph.

Author:

Sebastian Schuster

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DEFAULT_ENTITY_MODEL_PATH
static java.lang.String	DEFAULT_MODEL_PATH
static java.lang.String	IS_RELATION
static java.lang.String	NONE_RELATION

Fields inherited from class edu.stanford.nlp.scenegraph.AbstractSceneGraphParser

pipeline

Constructor Summary

Constructors

Constructor and Description
BoWSceneGraphParser(java.lang.String model, java.lang.String entityModel, Embedding embeddings) Constructor.

Method Summary

Modifier and Type	Method and Description
Dataset<java.lang.String,java.lang.String>	getTrainingExamples(java.lang.String trainingFile, boolean sampleNeg) Generate training examples.
static java.util.List<SceneGraphImage>	loadImages(java.lang.String filename) Loads scene graphs from JSON file.
static void	main(java.lang.String[] args)
SceneGraph	parse(SemanticGraph sg)
void	train(java.lang.String trainingFile, java.lang.String modelPath) Trains a classifier using the examples in trainingFile and saves it to modelPath.

Methods inherited from class edu.stanford.nlp.scenegraph.AbstractSceneGraphParser

parse, parse

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NONE_RELATION

public static final java.lang.String NONE_RELATION

See Also:

Constant Field Values

IS_RELATION

public static final java.lang.String IS_RELATION

See Also:

Constant Field Values

DEFAULT_MODEL_PATH

public static final java.lang.String DEFAULT_MODEL_PATH

See Also:

Constant Field Values

DEFAULT_ENTITY_MODEL_PATH

public static final java.lang.String DEFAULT_ENTITY_MODEL_PATH

See Also:

Constant Field Values

Constructor Detail

BoWSceneGraphParser

public BoWSceneGraphParser(java.lang.String model,
                           java.lang.String entityModel,
                           Embedding embeddings)

Constructor.

Parameters:

model - Path to relation prediction model.

entityModel - Path to entity model.

Method Detail

parse

public SceneGraph parse(SemanticGraph sg)

Specified by:

parse in class AbstractSceneGraphParser

loadImages

public static java.util.List<SceneGraphImage> loadImages(java.lang.String filename)
                                                  throws java.io.IOException

Loads scene graphs from JSON file.

Parameters:

filename - Path to JSON file.

Returns:

List with images parsed to SceneGraphImage.

Throws:

java.io.IOException

getTrainingExamples

public Dataset<java.lang.String,java.lang.String> getTrainingExamples(java.lang.String trainingFile,
                                                                      boolean sampleNeg)
                                                               throws java.io.IOException

Generate training examples.

Parameters:

trainingFile - Path to JSON file with training images and scene graphs.

sampleNeg - Whether to sample the same number of negative examples as positive examples.

Returns:

Dataset to train a classifier.

Throws:

java.io.IOException

train

public void train(java.lang.String trainingFile,
                  java.lang.String modelPath)
           throws java.io.IOException

Trains a classifier using the examples in trainingFile and saves it to modelPath.

Parameters:

trainingFile - Path to JSON file with images and scene graphs.

modelPath -

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Throws:

java.io.IOException