Options
Statistical and Comparative Evaluation of Various Indexing and Search Models
Auteur(s)
Abdou, Samir
Date de parution
2006
In
Lecture Notes in Computer Science (LNCS), Springer, 2006/4182//362-373
Résumé
This paper first describes various strategies (character, bigram, automatic segmentation) used to index the Chinese (ZH), Japanese (JA) and Korean (KR) languages. Second, based on the NTCIR-5 test-collections, it evaluates various retrieval models, varying from classical vector-space models to more recent developments in probabilistic and language models. While no clear conclusion was reached for the Japanese language, the bigram-based indexing strategy seems to be the best choice for Korean, and the combined ”unigram & bigram” indexing strategy is best for traditional Chinese. On the other hand, <i>Divergence from Randomness</i> (DFR) probabilistic model usually results in the best mean average precision. Finally, upon an evaluation of the four different statistical tests, we find that their conclusions correlate, even more when comparing the non-parametric bootstrap with the t-test.
Identifiants
Type de publication
journal article
