An approach to large-scale collection of application usage data over the internet
Authors:
- 27 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 02705257,p. 136-145
Abstract
Empirical evaluation of software systems in actual usage situations is critical in software engineering. Prototyping, beta testing, and usability testing are widely used to refine system requirements, detect anomalous or unexpected system and user behavior, and to evaluate software usefulness and usability. The World Wide Web enables cheap, rapid, and large-scale distribution of software for evaluation purposes. However, current techniques for collecting usage data have not kept pace with the opportunities presented by Web-based deployment. This paper presents an approach and prototype system that makes large-scale collection of usage data over the Internet a practical possibility. A general framework for comparing software monitoring systems is presented and used to compare the proposed approach to existing techniques.Keywords
This publication has 22 references indexed in Scilit:
- Agent-based support for communication between developers and users in software design2002
- Agents for collecting application usage data over the Internet1998
- An event service for open distributed systems1997
- Remote evaluation1996
- Studying long-term system useCommunications of the ACM, 1995
- Debugging heterogeneous distributed systems using event-based models of behaviorACM Transactions on Computer Systems, 1995
- Yeast: a general purpose event-action systemIEEE Transactions on Software Engineering, 1995
- Designing and using integrated data collection and analysis tools: challenges and considerationsBehaviour & Information Technology, 1994
- Integrated data capture and analysis tools for research and testing on graphical user interfaces1992
- A specifier's introduction to formal methodsComputer, 1990