Exploration of a geometric model of data fusion
Open Access
- 1 November 2002
- journal article
- information retrieval
- Published by Wiley in Proceedings of the American Society for Information Science and Technology
- Vol. 39 (1) , 124-129
Abstract
Some aspects of Data Fusion (DF) for Information Retrieval (IR) are explored using a set of data from the Fifth International Conference on Text Retrieval, TREC5. It has been observed from time to time that DF applied to a pair of systems or schemes for IR may yield results that are better than those of either participating scheme. It has been conjectured that this occurs only rarely, or occurs only when poor schemes are being combined, or occurs only for problems in which there are so few relevant documents that the results are probably due to statistical fluctuation. Based on a geometrical model of DF, we derive an equation for effective DF. This equation shows that in the ideal case the performance of a pair of IR schemes may be aproximated by a quadratic polynomial. We statistically test this assumption for TREC5 Routing data. Results of the regression analysis shows that our equation for the effect of DF is generally valid.Keywords
This publication has 8 references indexed in Scilit:
- Analyses of multiple evidence combinationACM SIGIR Forum, 1997
- Analyses of multiple evidence combination1997
- Combining the evidence of multiple query representations for information retrievalInformation Processing & Management, 1995
- Author’s replyJournal of Sound and Vibration, 1995
- Combining multiple evidence from different properties of weighting schemes1995
- Automatic Combination of Multiple Ranked Retrieval Systems1994
- Evaluation of an inference network-based retrieval modelACM Transactions on Information Systems, 1991
- A study of information seeking and retrieving. III. Searchers, searches, and overlapJournal of the American Society for Information Science, 1988