REVERSE ENGINEERING A SOCIAL AGENT-BASED HIDDEN MARKOV MODEL — ViSAGE
- 1 December 2008
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Neural Systems
- Vol. 18 (06) , 491-526
Abstract
We present a machine learning approach to discover the agent dynamics that drives the evolution of the social groups in a community. We set up the problem by introducing an agent-based hidden Markov model for the agent dynamics: an agent's actions are determined by micro-laws. Nonetheless, We learn the agent dynamics from the observed communications without knowing state transitions. Our approach is to identify the appropriate micro-laws corresponding to an identification of the appropriate parameters in the model. The model identification problem is then formulated as a mixed optimization problem. To solve the problem, we develop a multistage learning process for determining the group structure, the group evolution, and the micro-laws of a community based on the observed set of communications among actors, without knowing the semantic contents. Finally, to test the quality of our approximations and the feasibility of the approach, we present the results of extensive experiments on synthetic data as well as the results on real communities, such as Enron email and Movie newsgroups. Insight into agent dynamics helps us understand the driving forces behind social evolution.Keywords
This publication has 22 references indexed in Scilit:
- ViSAGEACM Transactions on Autonomous and Adaptive Systems, 2008
- An overlapping cluster algorithm to provide non-exhaustive clusteringEuropean Journal of Operational Research, 2006
- The Statistical Evaluation of Social Network DynamicsSociological Methodology, 2001
- Social Capital: Its Origins and Applications in Modern SociologyAnnual Review of Sociology, 1998
- Models for network dynamics: A Markovian frameworkThe Journal of Mathematical Sociology, 1995
- Network Data and MeasurementAnnual Review of Sociology, 1990
- Parties and networks: Stochastic models for relationship networksThe Journal of Mathematical Sociology, 1984
- A dynamic model for social networks†The Journal of Mathematical Sociology, 1977
- Growth transformations for functions on manifoldsPacific Journal of Mathematics, 1968
- An inequality with applications to statistical estimation for probabilistic functions of Markov processes and to a model for ecologyBulletin of the American Mathematical Society, 1967