edu.stanford.nlp.international.arabic.process

Class ArabicTokenizerTester

java.lang.Object

edu.stanford.nlp.international.arabic.process.ArabicTokenizerTester

public class ArabicTokenizerTester
extends java.lang.Object

Compares the output of the JFlex-based ArabicTokenizer to DefaultLexicalMapper, which is used in the parser and elsewhere.

Author:

Spence Green

Constructor Summary

Constructors

Constructor and Description
ArabicTokenizerTester()

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args) arg[0] := tokenizer options args[1] := file to tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ArabicTokenizerTester

public ArabicTokenizerTester()

Method Detail

main

public static void main(java.lang.String[] args)

arg[0] := tokenizer options args[1] := file to tokenize

Parameters:

args -