edu.stanford.nlp.parser.metrics

Class EvaluateExternalParser

java.lang.Object

edu.stanford.nlp.util.ProcessProtobufRequest

edu.stanford.nlp.parser.metrics.EvaluateExternalParser

public class EvaluateExternalParser
extends ProcessProtobufRequest

Constructor Summary

Constructors

Constructor and Description
EvaluateExternalParser(java.lang.String... args)

Method Summary

Modifier and Type	Method and Description
CoreNLPProtos.EvaluateParserResponse	buildResponse(double f1, java.lang.Double kbestF1, java.util.List<java.lang.Double> f1History)
java.util.List<Pair<ParserQuery,Tree>>	convertDataset(java.util.List<Tree> goldTrees, java.util.List<java.util.List<Tree>> results)
static java.util.List<Tree>	getGoldTrees(CoreNLPProtos.EvaluateParserRequest parses) Extract the gold trees from a list of requests
static java.util.List<java.util.List<Tree>>	getResults(CoreNLPProtos.EvaluateParserRequest parses) Extract the predicted trees from a list of requests
static void	main(java.lang.String[] args) Command line tool for processing a parser evaluation request.
void	processInputStream(java.io.InputStream in, java.io.OutputStream out) Reads a single request from the InputStream, then writes back a single response.
CoreNLPProtos.EvaluateParserResponse	processRequest(CoreNLPProtos.EvaluateParserRequest parses)
CoreNLPProtos.EvaluateParserResponse	scoreDataset(java.util.List<Tree> goldTrees, java.util.List<java.util.List<Tree>> results) Puts the list of gold trees and a list of list of results into EvaluateTreebank

Methods inherited from class edu.stanford.nlp.util.ProcessProtobufRequest

leftoverArgs, process, processMultipleInputs

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EvaluateExternalParser

public EvaluateExternalParser(java.lang.String... args)

Method Detail

getGoldTrees

public static java.util.List<Tree> getGoldTrees(CoreNLPProtos.EvaluateParserRequest parses)

Extract the gold trees from a list of requests

getResults

public static java.util.List<java.util.List<Tree>> getResults(CoreNLPProtos.EvaluateParserRequest parses)

Extract the predicted trees from a list of requests

convertDataset

public java.util.List<Pair<ParserQuery,Tree>> convertDataset(java.util.List<Tree> goldTrees,
                                                             java.util.List<java.util.List<Tree>> results)

buildResponse

public CoreNLPProtos.EvaluateParserResponse buildResponse(double f1,
                                                          java.lang.Double kbestF1,
                                                          java.util.List<java.lang.Double> f1History)

scoreDataset

public CoreNLPProtos.EvaluateParserResponse scoreDataset(java.util.List<Tree> goldTrees,
                                                         java.util.List<java.util.List<Tree>> results)

Puts the list of gold trees and a list of list of results into EvaluateTreebank

processRequest

public CoreNLPProtos.EvaluateParserResponse processRequest(CoreNLPProtos.EvaluateParserRequest parses)
                                                    throws java.io.IOException

Throws:

java.io.IOException

processInputStream

public void processInputStream(java.io.InputStream in,
                               java.io.OutputStream out)
                        throws java.io.IOException

Reads a single request from the InputStream, then writes back a single response.

Specified by:

processInputStream in class ProcessProtobufRequest

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)
                 throws java.io.IOException

Command line tool for processing a parser evaluation request.

Throws:

java.io.IOException