mark.core.text
Class WordAndPunctuationScannerTokenManager

java.lang.Object
  |
  +--mark.core.text.WordAndPunctuationScannerTokenManager

All Implemented Interfaces:

WordAndPunctuationScannerConstants

public class WordAndPunctuationScannerTokenManager

extends java.lang.Object

implements WordAndPunctuationScannerConstants

Field Summary

protected char	curChar
static java.lang.String[]	jjstrLiteralImages
static java.lang.String[]	lexStateNames

Fields inherited from interface mark.core.text.WordAndPunctuationScannerConstants

DEFAULT, EOF, tAmpersand, tAserisk, tAt, tBackSlash, tBacktick, tBar, tCaret, tColon, tComma, tDashDash, tDollar, tEqual, tExclaim, tFloat, tGreater, tInteger, tLBrace, tLBracket, tLess, tLParen, tMinus, tokenImage, tPercent, tPeriod, tPlus, tQuestion, tQuote, tRBrace, tRBracket, tRParen, tSemicolon, tSharp, tSlash, tTick, tTilde, tUnderscore, tWord

Constructor Summary

WordAndPunctuationScannerTokenManager(ASCII_CharStream stream)

WordAndPunctuationScannerTokenManager(ASCII_CharStream stream, int lexState)

Method Summary

Token	getNextToken()
void	ReInit(ASCII_CharStream stream)
void	ReInit(ASCII_CharStream stream, int lexState)
void	SwitchTo(int lexState)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

jjstrLiteralImages

public static final java.lang.String[] jjstrLiteralImages

lexStateNames

public static final java.lang.String[] lexStateNames

curChar

protected char curChar

Constructor Detail

WordAndPunctuationScannerTokenManager

public WordAndPunctuationScannerTokenManager(ASCII_CharStream stream)

WordAndPunctuationScannerTokenManager

public WordAndPunctuationScannerTokenManager(ASCII_CharStream stream,
                                             int lexState)

Method Detail

ReInit

public void ReInit(ASCII_CharStream stream)

ReInit

public void ReInit(ASCII_CharStream stream,
                   int lexState)

SwitchTo

public void SwitchTo(int lexState)

getNextToken

public final Token getNextToken()