Bigram Model in Dealing with
Gaps
•
Bigram model can deal with gaps
–
Unseen tokens have small smoothing
probabilities in specific positions
Pattern
<Search_Term>
which
is
known
for
DT$
NNP
Test sentence:
<Search_Term>
,
whose
book
is
known
for
Not too good!