edu.stanford.nlp.trees.tregex
Class TregexPattern

java.lang.Object
  extended by edu.stanford.nlp.trees.tregex.TregexPattern
All Implemented Interfaces:
Serializable

public abstract class TregexPattern
extends Object
implements Serializable

A TregexPattern is a tgrep-type pattern for matching tree node configurations. Unlike tgrep but like Unix grep, there is no pre-indexing of the data to be searched. Rather there is a linear scan through the trees where matches are sought.

TregexPattern instances can be matched against instances of the Tree class. The main(java.lang.String[]) method can be used to find matching nodes of a treebank from the command line.

Currently supported node/node relations and their symbols:

SymbolMeaning
A << B A dominates B
A >> B A is dominated by B
A < B A immediately dominates B
A > B A is immediately dominated by B
A $ B A is a sister of B (and not equal to B)
A .. B A precedes B
A . B A immediately precedes B
A ,, B A follows B
A , B A immediately follows B
A <<, B B is a leftmost descendent of A
A <<- B B is a rightmost descendent of A
A >>, B A is a leftmost descendent of B
A >>- B A is a rightmost descendent of B
A <, B B is the first child of A
A >, B A is the first child of B
A <- B B is the last child of A
A >- B A is the last child of B
A <` B B is the last child of A
A >` B A is the last child of B
A <i B B is the ith child of A (i > 0)
A >i B A is the ith child of B (i > 0)
A <-i B B is the ith-to-last child of A (i > 0)
A >-i B A is the ith-to-last child of B (i > 0)
A <: B B is the only child of A
A >: B A is the only child of B
A <<: B A dominates B via an unbroken chain (length > 0) of unary local trees.
A >>: B A is dominated by B via an unbroken chain (length > 0) of unary local trees.
A $++ B A is a left sister of B (same as $.. for context-free trees)
A $-- B A is a right sister of B (same as $,, for context-free trees)
A $+ B A is the immediate left sister of B (same as $. for context-free trees)
A $- B A is the immediate right sister of B (same as $, for context-free trees)
A $.. B A is a sister of B and precedes B
A $,, B A is a sister of B and follows B
A $. B A is a sister of B and immediately precedes B
A $, B A is a sister of B and immediately follows B
A <+(C) B A dominates B via an unbroken chain of (zero or more) nodes matching description C
A >+(C) B A is dominated by B via an unbroken chain of (zero or more) nodes matching description C
A .+(C) B A precedes B via an unbroken chain of (zero or more) nodes matching description C
A ,+(C) B A follows B via an unbroken chain of (zero or more) nodes matching description C
A <<# B B is a head of phrase A
A >># B A is a head of phrase B
A <# B B is the immediate head of phrase A
A ># B A is the immediate head of phrase B
A == B A and B are the same node
A : B[this is a pattern-segmenting operator that places no constraints on the relationship between A and B]

Label descriptions can be literal strings, which much match labels exactly, or regular expressions in regular expression bars: /regex/. Literal string matching proceeds as String equality. In order to prevent ambiguity with other Tregex symbols, only standard "identifiers" are allowed as literals, i.e., strings matching [a-zA-Z]([a-zA-Z0-9_])* . If you want to use other symbols, you can do so by using a regular expression instead of a literal string. A disjunctive list of literal strings can be given separated by '|'. The special string '__' (two underscores) can be used to match any node. (WARNING!! Use of the '__' node description may seriously slow down search.) If a label description is preceeded by '@', the label will match any node whose basicCategory matches the description. NB: A single '@' thus scopes over a disjunction specified by '|': @NP|VP means things with basic category NP or VP. The basicCategory is defined according to a Function mapping Strings to Strings, as provided by AbstractTreebankLanguagePack.getBasicCategoryFunction(). Label description regular expressions are matched as find(), as in Perl/tgrep; you need to specify ^ or $ to constrain matches.

In a chain of relations, all relations are relative to the first node in the chain. For example, (S < VP < NP) means "an S over a VP and also over an NP". If instead what you want is an S above a VP above an NP, you should write "S < (VP < NP)".

Nodes can be grouped using parens '(' and ')' as in S < (NP $++ VP) to match an S over an NP, where the NP has a VP as a right sister.

Boolean relational operators

Relations can be combined using the '&' and '|' operators, negated with the '!' operator, and made optional with the '?' operator. Thus (NP < NN | < NNS) will match an NP node dominating either an NN or an NNS. (NP > S & $++ VP) matches an NP that is both under an S and has a VP as a right sister.

Relations can be grouped using brackets '[' and ']'. So the expression

NP [< NN | < NNS] & > S
matches an NP that (1) dominates either an NN or an NNS, and (2) is under an S. Without brackets, & takes precidence over |, and equivalent operators are left-associative. Also note that & is the default combining operator if the operator is omitted in a chain of relations, so that the two patterns are equivalent:
(S < VP < NP)
(S < VP & < NP)
As another example, (VP < VV | < NP % NP) can be written explicitly as (VP [< VV | [< NP & % NP] ] )

Relations can be negated with the '!' operator, in which case the expression will match only if there is no node satisfying the relation. For example (NP !< NNP) matches only NPs not dominating an NNP. Label descriptions can also be negated with '!': (NP < !NNP|NNS) matches NPs dominating some node that is not an NNP or an NNS.

Relations can be made optional with the '?' operator. This way the expression will match even if the optional relation is not satisfied. This is useful when used together with node naming (see below).

Basic Categories

In order to consider only the "basic category" of a tree label, i.e. to ignore functional tags or other annotations on the label, prefix that node's description with the @ symbol. For example (@NP < @/NN.?/) This can only be used for individual nodes; if you want all nodes to use the basic category, it would be more efficient to use a TreeNormalizer to remove functional tags before passing the tree to the TregexPattern.

Segmenting patterns

The ":" operator allows you to segment a pattern into two pieces. This can simplify your pattern writing. For example, the pattern

S : NP
matches only those S nodes in trees that also have an NP node.

Naming nodes

Nodes can be given names (a.k.a. handles) using '='. A named node will be stored in a map that maps names to nodes so that if a match is found, the node corresponding to the named node can be extracted from the map. For example (NP < NNP=name) will match an NP dominating an NNP and after a match is found, the map can be queried with the name to retreived the matched node using TregexMatcher.getNode(String o) with (String) argument "name" (not "=name"). Note that you are not allowed to name a node that is under the scope of a negation operator (the semantics would be unclear, since you can't store a node that never gets matched to). Trying to do so will cause a ParseException to be thrown. Named nodes can be put within the scope of an optionality operator.

Named nodes that refer back to previous named nodes need not have a node description -- this is known as "backreferencing". In this case, the expression will match only when all instances of the same name get matched to the same tree node. For example: the pattern

(@NP <, (@NP $+ (/,/ $+ (@NP $+ /,/=comma))) <- =comma)
matches only an NP dominating exactly the sequence NP , NP , -- the mother NP cannot have any other daughters. Multiple backreferences are allowed. If the node w/ no node description does not refer to a previously named node, there will be no error, the expression simply will not match anything.

Another way to refer to previously named nodes is with the "link" symbol: '~'. A link is like a backreference, except that instead of having to be equal to the referred node, the current node only has to match the label of the referred to node. A link cannot have a node description, i.e. the '~' symbol must immediately follow a relation symbol.

Customizing headship and basic categories

The HeadFinder used to determine heads for the head relations <#, >#, <<#, and >>#, and also the Function mapping from labels to Basic Category tags can be chosen by using a TregexPatternCompiler.

Variable Groups

If you write a node description using a regular expression, you can assign its matching groups to variable names. If more than one node has a group assigned to the same variable name, then matching will only occur when all such groups capture the same string. This is useful for enforcing coindexation constraints. The syntax is

/ <regex-stuff> /#<group-number>%<variable-name>
For example, the pattern (designed for Penn Treebank trees)
@SBAR < /^WH.*-([0-9]+)$/#1%index << (__=empty < (/^-NONE-/ < /^\*T\*-([0-9]+)$/#1%index))
will match only such that the WH- node under the SBAR is coindexed with the trace node that gets the name empty.

Current known bugs/shortcomings:

Author:
Galen Andrew, Roger Levy (rog@csli.stanford.edu), Anna Rafferty (filter mode)
See Also:
Serialized Form

Method Summary
static TregexPattern compile(String tregex)
          Creates a pattern from the given string using the default Headfinder and BasicCategoryFunction.
static void main(String[] args)
          Prints out all matches of a tree pattern on each tree in the path.
 TregexMatcher matcher(Tree t)
          Get a TregexMatcher for this pattern on this tree.
 String pattern()
           
 void prettyPrint()
          Print a multi-line respresentation of the pattern illustrating it's syntax to System.out.
 void prettyPrint(PrintStream ps)
          Print a multi-line respresentation of the pattern illustrating it's syntax.
 void prettyPrint(PrintWriter pw)
          Print a multi-line respresentation of the pattern illustrating it's syntax.
static TregexPattern safeCompile(String tregex, boolean verbose)
          Creates a pattern from the given string using the default Headfinder and BasicCategoryFunction.
 void setPatternString(String patternString)
           
abstract  String toString()
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
 

Method Detail

matcher

public TregexMatcher matcher(Tree t)
Get a TregexMatcher for this pattern on this tree.

Parameters:
t - a tree to match on
Returns:
a TregexMatcher

compile

public static TregexPattern compile(String tregex)
                             throws ParseException
Creates a pattern from the given string using the default Headfinder and BasicCategoryFunction. If you want to use a different HeadFinder or BasicCategoryFunction, use a TregexPatternCompiler object.

Parameters:
tregex - the pattern string
Returns:
a TregexPattern for the string.
Throws:
ParseException - if the string does not parse

safeCompile

public static TregexPattern safeCompile(String tregex,
                                        boolean verbose)
Creates a pattern from the given string using the default Headfinder and BasicCategoryFunction. If you want to use a different HeadFinder or BasicCategoryFunction, use a TregexPatternCompiler object. Rather than throwing an exception when the string does not parse, simply returns null

Parameters:
tregex - the pattern string
verbose - whether to log errors when the string doesn't parse
Returns:
a TregexPattern for the string, or null if the string does not parse.
Throws:
ParseException - if the string does not parse

pattern

public String pattern()

setPatternString

public void setPatternString(String patternString)

toString

public abstract String toString()
Overrides:
toString in class Object
Returns:
A single-line string representation of the pattern

prettyPrint

public void prettyPrint(PrintWriter pw)
Print a multi-line respresentation of the pattern illustrating it's syntax.


prettyPrint

public void prettyPrint(PrintStream ps)
Print a multi-line respresentation of the pattern illustrating it's syntax.


prettyPrint

public void prettyPrint()
Print a multi-line respresentation of the pattern illustrating it's syntax to System.out.


main

public static void main(String[] args)
                 throws IOException
Prints out all matches of a tree pattern on each tree in the path. Usage:

java edu.stanford.nlp.trees.tregex.TregexPattern [[-TCwfosnu] [-filter] [-h <node-name>]]* pattern filepath

Arguments:

Options:

Throws:
IOException


Stanford NLP Group