Statistical query translation models for cross-language information retrieval
Authors:
Open Access
- 1 December 2006
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Asian Language Information Processing
- Vol. 5 (4) , 323-359
Abstract
Query translation is an important task in cross-language information retrieval (CLIR), which aims to determine the best translation words and weights for a query. This article presents three statistical query translation models that focus on the resolution of query translation ambiguities. All the models assume that the selection of the translation of a query term depends on the translations of other terms in the query. They differ in the way linguistic structures are detected and exploited. The co-occurrence model treats a query as a bag of words and uses all the other terms in the query as the context for translation disambiguation. The other two models exploit linguistic dependencies among terms. The noun phrase (NP) translation model detects NPs in a query, and translates each NP as a unit by assuming that the translation of a term only depends on other terms within the same NP. Similarly, the dependency translation model detects and translates dependency triples, such as verb-object, as units. The evaluations show that linguistic structures always lead to more precise translations. The experiments of CLIR on TREC Chinese collections show that all three models have a positive impact on query translation and lead to significant improvements of CLIR performance over the simple dictionary-based translation method. The best results are obtained by combining the three models.Keywords
This publication has 40 references indexed in Scilit:
- Automatic Acquisition of Chinese–English Parallel Corpus from the WebLecture Notes in Computer Science, 2006
- Chinese Word Segmentation and Named Entity Recognition: A Pragmatic ApproachComputational Linguistics, 2005
- The Alignment Template Approach to Statistical Machine TranslationComputational Linguistics, 2004
- The Web as a Parallel CorpusComputational Linguistics, 2003
- Query expansion and query translation as logical inferenceJournal of the American Society for Information Science and Technology, 2003
- Toward a unified approach to statistical language modeling for ChineseACM Transactions on Asian Language Information Processing, 2002
- Disambiguation Strategies for Cross-Language Information Retrieval1999
- Text Chunking Using Transformation-Based Learning1999
- Integrating Query Translation and Document Translation in a Cross-Language Information Retrieval SystemLecture Notes in Computer Science, 1998
- An Introduction to Variational Methods for Graphical Models1998