Reporting incentives and biases in online review forums
Authors:
Open Access
- 29 April 2010
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on the Web
- Vol. 4 (2) , 1-27
Abstract
Online reviews have become increasingly popular as a way to judge the quality of various products and services. However, recent work demonstrates that the absence of reporting incentives leads to a biased set of reviews that may not reflect the true quality. In this paper, we investigate underlying factors that influence users when reporting feedback. In particular, we study both reporting incentives and reporting biases observed in a widely used review forum, the Tripadvisor Web site. We consider three sources of information: first, the numerical ratings left by the user for different aspects of quality; second, the textual comment accompanying a review; third, the patterns in the time sequence of reports. We first show that groups of users who discuss a certain feature at length are more likely to agree in their ratings. Second, we show that users are more motivated to give feedback when they perceive a greater risk involved in a transaction. Third, a user's rating partly reflects the difference between true quality and prior expectation of quality, as inferred from previous reviews. We finally observe that because of these biases, when averaging review scores there are strong differences between the mean and the median. We speculate that the median may be a better way to summarize the ratings.Keywords
This publication has 16 references indexed in Scilit:
- Exploring the value of online product reviews in forecasting sales: The case of motion picturesJournal of Interactive Marketing, 2007
- Can online reviews reveal a product's true quality?2006
- Reputation in Auctions: Theory, and Evidence from eBayJournal of Economics & Management Strategy, 2006
- Self-selection, slipping, salvaging, slacking, and stoning2005
- Reputation premiums in electronic peer-to-peer markets2005
- Mining and summarizing customer reviews2004
- Mining the peanut gallery2003
- Does a Seller’s eCommerce Reputation Matter? Evidence from eBay AuctionsThe Journal of Industrial Economics, 2002
- Noisytalk.com: Broadcasting Opinions in a Noisy EnvironmentSSRN Electronic Journal, 2000
- On strategy-proofness and single peakednessPublic Choice, 1980