Inferring relevant social networks from interpersonal communication
Authors:
Open Access
- 26 April 2010
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 301-310
Abstract
Researchers increasingly use electronic communication data to construct and study large social networks, effectively inferring unobserved ties (e.g. i is connected to j) from observed communication events (e.g. i emails j). Often overlooked, however, is the impact of tie definition on the corresponding network, and in turn the relevance of the inferred network to the research question of interest. Here we study the problem of network inference and relevance for two email data sets of different size and origin. In each case, we generate a family of networks parameterized by a threshold condition on the frequency of emails exchanged between pairs of individuals. After demonstrating that different choices of the threshold correspond to dramatically different network structures, we then formulate the relevance of these networks in terms of a series of prediction tasks that depend on various network features. In general, we find: a) that prediction accuracy is maximized over a non-trivial range of thresholds corresponding to 5-10 reciprocated emails per year; b) that for any prediction task, choosing the optimal value of the threshold yields a sizable (~30%) boost in accuracy over naive choices; and c) that the optimal threshold value appears to be (somewhat surprisingly) consistent across data sets and prediction tasks. We emphasize the practical utility in defining ties via their relevance to the prediction task(s) at hand and discuss implications of our empirical results.Keywords
This publication has 26 references indexed in Scilit:
- Inferring friendship network structure by using mobile phone dataProceedings of the National Academy of Sciences, 2009
- Analysis of a large-scale weighted network of one-to-one human communicationNew Journal of Physics, 2007
- Communication Networks from the Enron Email Corpus “It's Always About the People. Enron is no Different”Computational and Mathematical Organization Theory, 2005
- Comparing community structure identificationJournal of Statistical Mechanics: Theory and Experiment, 2005
- Cloning Headless Frogs and Other Important Matters: Conversation Topics and Network StructureSocial Forces, 2004
- Computational Methods for Dynamic GraphsJournal of Computational and Graphical Statistics, 2003
- Scientific collaboration networks. II. Shortest paths, weighted networks, and centralityPhysical Review E, 2001
- Stochastic Blockmodels for Directed GraphsJournal of the American Statistical Association, 1987
- The Focused Organization of Social TiesAmerican Journal of Sociology, 1981
- The Strength of Weak TiesAmerican Journal of Sociology, 1973