Evaluating a scientific collaboratory
Open Access
- 1 June 2003
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 10 (2) , 150-176
Abstract
The evaluation of scientific collaboratories has lagged behind their development. Do the capabilities afforded by collaboratories outweigh their disadvantages? To evaluate a scientific collaboratory system, we conducted a repeated-measures controlled experiment that compared the outcomes and process of scientific work completed by 20 pairs of participants (upper level undergraduate science students) working face-to-face and remotely. We collected scientific outcomes (graded lab reports) to investigate the quality of scientific work, post-questionnaire data to measure the adoptability of the system, and post-interviews to understand the participants' views of doing science under both conditions. We hypothesized that study participants would be less effective, report more difficulty, and be less favorably inclined to adopt the system when collaborating remotely. Contrary to expectations, the quantitative data showed no statistically significant differences with respect to effectiveness and adoption.The qualitative data helped explain this null result: participants reported advantages and disadvantages working under both conditions and developed work-arounds to cope with the perceived disadvantages of collaborating remotely. While the data analysis produced null results, considered as a whole, the analysis leads us to conclude there is positive potential for the development and adoption of scientific collaboratory systems.Keywords
This publication has 19 references indexed in Scilit:
- Designing to Support Collaborative Scientific Research Across Distances: The nanoManipulator Environment2001
- Controlled manipulation of molecular samples with the nanoManipulatorIEEE/ASME Transactions on Mechatronics, 2000
- Advanced interfaces to scanned-probe microscopes2000
- From Laboratories to Collaboratories: A New Organizational Form for Scientific CollaborationPsychological Science, 1997
- Steps Toward an Ecology of Infrastructure: Design and Access for Large Information SpacesInformation Systems Research, 1996
- Your place or mine? Learning from long-term use of Audio-Video communicationComputer Supported Cooperative Work (CSCW), 1996
- Collaboratories: doing science on the InternetComputer, 1996
- Groupware and social dynamicsCommunications of the ACM, 1994
- Learning from notes: Organizational issues in groupware implementationThe Information Society, 1993
- Sound Support For Collaboration1991