Use of accounting concepts to study research: return on investment in XSEDE, a US cyberinfrastructure service
Authors:
- Craig A. StewartCSCraig A. Stewart
- Claudia M. CostaCCClaudia M. Costa
- Julie A. WernertJWJulie A. Wernert
- Winona Snapp-ChildsWSWinona Snapp-Childs
- Marques BlandMBMarques Bland
- Philip BloodPBPhilip Blood
- Terry CampbellTCTerry Campbell
- Peter CouvaresPCPeter Couvares
- Jeremy FischerJFJeremy Fischer
- David Y. HancockDHDavid Y. Hancock
- David L. HartDHDavid L. Hart
- Harmony JankowskiHJHarmony Jankowski
Open Access
- 14 February 2023
- journal article
- research article
- Published by Springer Nature in Scientometrics
- Vol. 128 (6) , 3225-3255
Abstract
This paper uses accounting concepts—particularly the concept of Return on Investment (ROI)—to reveal the quantitative value of scientific research pertaining to a major US cyberinfrastructure project (XSEDE—the eXtreme Science and Engineering Discovery Environment). XSEDE provides operational and support services for advanced information technology systems, cloud systems, and supercomputers supporting non-classified US research, with an average budget for XSEDE of US$20M+ per year over the period studied (2014–2021). To assess the financial effectiveness of these services, we calculated a proxy for ROI, and converted quantitative measures of XSEDE service delivery into financial values using costs for service from the US marketplace. We calculated two estimates of ROI: a Conservative Estimate, functioning as a lower bound and using publicly available data for a lower valuation of XSEDE services; and a Best Available Estimate, functioning as a more accurate estimate, but using some unpublished valuation data. Using the largest dataset assembled for analysis of ROI for a cyberinfrastructure project, we found a Conservative Estimate of ROI of 1.87, and a Best Available Estimate of ROI of 3.24. Through accounting methods, we show that XSEDE services offer excellent value to the US government, that the services offered uniquely by XSEDE (that is, not otherwise available for purchase) were the most valuable to the facilitation of US research activities, and that accounting-based concepts hold great value for understanding the mechanisms of scientific research generally.Keywords
Funding Information
- National Science Foundation (1548562, 1053575)
- National Science Foundation (1445604, 2005506)
- National Science Foundation (1700765)
This publication has 27 references indexed in Scilit:
- An Overview of the XSEDE Extended Collaborative Support Program2016
- Peer Comparison of XSEDE and NCAR Publication Data2015
- XSEDE value added, cost avoidance, and return on investment2015
- What's Not There: Odd Lots and Market DataThe Journal of Finance, 2014
- XSEDE: Accelerating Scientific DiscoveryComputing in Science & Engineering, 2014
- Assessing the effect of high performance computing capabilities on academic research outputEmpirical Economics, 2014
- The Dialectical Tensions in the Funding Infrastructure of CyberinfrastructureComputer Supported Cooperative Work (CSCW), 2010
- Theorie der wirtschaftlichen Entwicklung2003
- LIGO: The Laser Interferometer Gravitational-Wave ObservatoryScience, 1992
- Measuring Performance of the Information Systems FunctionJournal of Management Information Systems, 1992