Wei Lu and Min-Yen Kan
AIRS 2005 (Jeju Island, Korea)

Evaluation
on Lexical Analysis
• Compiler-based tokenization and
type-binding, together with token normalization helps removing 17% of errors
• Program language features DO
positively impact program categorization
