Rational Probabilistic Deciders—Part I: Individual Behavior
Authors:
Open Access
- 30 April 2007
- journal article
- research article
- Published by Hindawi Limited in Mathematical Problems in Engineering
- Vol. 2007 (10) , 1-31
Abstract
This paper is intended to model a decision maker as a rational probabilistic decider (RPD) and to investigate its behavior in stationary and symmetric Markov switch environments. RPDs take their decisions based on penalty functions defined by the environment. The quality of decision making depends on a parameter referred to as level of rationality. The dynamic behavior of RPDs is described by an ergodic Markov chain. Two classes of RPDs are considered—local and global. The former take their decisions based on the penalty in the current state while the latter consider all states. It is shown that asymptotically (in time and in the level of rationality) both classes behave quite similarly. However, the second largest eigenvalue of Markov transition matrices for global RPDs is smaller than that for local ones, indicating faster convergence to the optimal state. As an illustration, the behavior of a chief executive officer, modeled as a global RPD, is considered, and it is shown that the company performance may or may not be optimized—depending on the pay structure employed. While the current paper investigates individual RPDs, a companion paper will address collective behavior.Keywords
This publication has 8 references indexed in Scilit:
- Unsteady aerodynamics and flow control for flapping wing flyersProgress in Aerospace Sciences, 2003
- Collaborative power management in WPANs using rational controllers: a case studyMathematical Problems in Engineering, 2000
- Cooperative Mobile Robotics: Antecedents and DirectionsAutonomous Robots, 1997
- On the Behavior of a Learning Automaton in a Changing Environment with Application to Telephone Traffic RoutingIEEE Transactions on Systems, Man, and Cybernetics, 1980
- Mathematical theory of behavior— Individual and collective behavior of retardable elementsMathematical Biosciences, 1979
- Application of Learning Automata to Telephone Traffic Routing and ControlIEEE Transactions on Systems, Man, and Cybernetics, 1977
- Learning control systems--Review and outlookIEEE Transactions on Automatic Control, 1970
- A variable structure automaton used as a multimodal searching techniqueIEEE Transactions on Automatic Control, 1966