Agreement levels
Use Pearson’s R (-1 = perfect opposition, 1 = perfect agreement)
Task
9 point scale
2 class (binary)
1. Query (w/o results)
.577
.411
2. Query (w/ results)
.604
.656
3. Search Results
.745
.750
Data analysis:
Relatively strong correlation (mostly above .6)
Stronger correlation with search results shown; easier
task with more information
Most search results are not known items, high
correlation for the final task