Evaluation on Lexical Analysis
•
Compiler-based tokenization and type-binding, together with token
normalization helps removing 17% of errors
•
Program language features DO positively impact program
categorization