About | Download | Usage | Questions | Mailing lists | Release history
TokensRegex is a generic framework included in Stanford CoreNLP for defining patterns over text and mapping to semantic objects represented as Java objects. As part of the framework, TokensRegex provides the following:
TokensRegex was used to develop SUTime, a rule-based temporal tagger for recognizing and normalizing temporal expressions. An included set of slides and the javadoc for TokenSequencePattern provide an overview of this package.
TokensRegex was written by Angel Chang. These programs also rely on classes developed by others as part of the Stanford JavaNLP project.
customAnnotatorClass.[name]=edu.stanford.nlp.pipeline.TokensRegexAnnotator [name].rules = [path to rules file]Example:
customAnnotatorClass.color=edu.stanford.nlp.pipeline.TokensRegexAnnotator color.rules = color.rules.txt
java -cp stanford-corenlp-2012-05-22.jar:stanford-corenlp-2012-05-22-models.jar:xom.jar:joda-time.jar -Xmx3g edu.stanford.nlp.pipeline.StanfordCoreNLP -annotators tokenize,ssplit,color -properties color.properties -file color.input.txt
Questions, feedback, and bug reports/fixes can be sent to our mailing lists.
We have 3 mailing lists for TokensRegex, all of which are shared
with other JavaNLP tools (with the exclusion of the parser). Each address is
java-nlp-userThis is the best list to post to in order to ask questions, make announcements, or for discussion among JavaNLP users. You have to subscribe to be able to use it. Join the list via this webpage or by emailing
email@example.com. (Leave the subject and message body empty.) You can also look at the list archives.
java-nlp-announceThis list will be used only to announce new versions of Stanford JavaNLP tools. So it will be very low volume (expect 1-3 messages a year). Join the list via this webpage or by emailing
firstname.lastname@example.org. (Leave the subject and message body empty.)
java-nlp-supportThis list goes only to the software maintainers. It's a good address for licensing questions, etc. For general use and support questions, you're better off joining and using
java-nlp-user. You cannot join
java-nlp-support, but you can mail questions to
|Version 1.3.2||2012-05-22||Added TokensRegexAnnotator that can be configured using rules file|
|Version 1.2.0||2011-09-14||Initial version of TokensRegex library|
Site design by Bill MacCartney