Assessing the assessor: a framework for BIM maturity, capacity, and competency evaluation at the organizational level
- 1 March 2023
- journal article
- research article
- Published by Canadian Science Publishing in Canadian Journal of Civil Engineering
- Vol. 50 (3) , 143-156
Abstract
Many assessment models (AMs) supporting the evaluation of Building Information Modeling (BIM) deployment within an organization or a project have recently been developed. However, it has become challenging to choose which AM is best suited to meet a user's needs in a specific context. These AMs use different criteria and apply different theoretical bases. Moreover, many have been developed with little industry involvement, feedback being given through surveys and focus groups. Lastly, they generally do not consider the context in which the assessment takes place. This paper presents a framework for a type 3 meta-evaluation assessing BIM-AMs concerning their effectiveness, relevance, and usefulness in the context in which they will be implemented. As a contribution to theory, it incorporates the criteria for BIM evaluation developed by Succar et al. (2012) and psychometric validities to evaluate theoretically different models and to incorporate industry input. As a contribution to practice, the framework was used to evaluate two BIM-AMs and provide suggestions for their improvement.Keywords
This publication has 19 references indexed in Scilit:
- Embedded contexts of innovationConstruction Innovation, 2015
- BIM Cloud Score: Benchmarking BIM PerformanceJournal of Construction Engineering and Management, 2014
- Beyond the BIM utopia: Approaches to the development and implementation of building information modelingAutomation in Construction, 2014
- Measuring BIM performance: Five metricsArchitectural Engineering and Design Management, 2012
- A review of methods for evaluation of maturity models for process improvementJournal of Software: Evolution and Process, 2011
- Mixed Method Research: Fundamental Issues of Design, Validity, and Reliability in Construction ResearchJournal of Construction Engineering and Management, 2010
- Tool for Benchmarking BIM Performance of Design, Engineering and Construction Firms in The NetherlandsArchitectural Engineering and Design Management, 2010
- A Design Science Research Methodology for Information Systems ResearchJournal of Management Information Systems, 2007
- On Validity Theory and Test ValidationEducational Researcher, 2007
- Meaning and Values in Test Validation: The Science and Ethics of AssessmentEducational Researcher, 1989