edu.stanford.nlp.scenegraph

Class SceneGraphSentenceMatcher

java.lang.Object

edu.stanford.nlp.scenegraph.SceneGraphSentenceMatcher

public class SceneGraphSentenceMatcher
extends java.lang.Object

Matches nodes in a scene graph to words in an image description.

Author:

Sebastian Schuster

Constructor Summary

Constructors

Constructor and Description
SceneGraphSentenceMatcher(Embedding embeddings)

Method Summary

Modifier and Type	Method and Description
static Pair<IndexedWord,IndexedWord>	findClosestPair(java.util.List<IndexedWord> subjects, java.util.List<IndexedWord> objects) Picks one IndexedWord from subjects and one IndexedWord from objects such that the distance between them is minimal.
java.util.List<Triple<IndexedWord,IndexedWord,java.lang.String>>	getRelationTriples(SceneGraphImageRegion region) Aligns nodes in the scene graph to words in the corresponding sentence.
static void	main(java.lang.String[] args)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SceneGraphSentenceMatcher

public SceneGraphSentenceMatcher(Embedding embeddings)

Method Detail

findClosestPair

public static Pair<IndexedWord,IndexedWord> findClosestPair(java.util.List<IndexedWord> subjects,
                                                            java.util.List<IndexedWord> objects)

Picks one IndexedWord from subjects and one IndexedWord from objects such that the distance between them is minimal. Considers multiple appearances of the word in a sentence due to resolved pronouns.

Parameters:

subjects - List of subject candidates.

objects - List of object candidates.

Returns:

Subject-object pair.

getRelationTriples

public java.util.List<Triple<IndexedWord,IndexedWord,java.lang.String>> getRelationTriples(SceneGraphImageRegion region)

Aligns nodes in the scene graph to words in the corresponding sentence. Returns a list of Triple of the IndexedWord corresponding to the subject, the IndexedWord corresponding to the object or attribute and the relation between them.

Parameters:

region - SceneGraphRegion with sentence and corresponding scene graph.

Returns:

List of relation triples.

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Throws:

java.io.IOException