Hang Cui et al.
NUS at TREC-13 QA Main Task
13/20
Discussions on Evaluation Results
•The use of approximate
relation matching outperforms our previous answer extraction technique.
–22% improvement for overall questions.
–45% improvement for Non-NE questions (69 out of 230 questions).
•The two path similarity measurements do not make obvious difference.
–Total Path Matching performs slightly better than Triple
Matching.
–Triple Matching doesn’t
degrade the performance because Minipar can’t resolve long distance dependency as well.
0.41
0.42
0.29
Questions w/o NE typed targets
0.75
0.78
0.68
Questions w/ NE typed targets
0.60
0.62
0.51
Overall average
accuracy
NUSCHUA2
NUSCHUA1
Baseline