Document Understanding-Based Design Support: Application of Language Model for Design Knowledge Extraction
- 12 September 2023
- journal article
- research article
- Published by Wiley in Journal of Mechanical Design
- Vol. 145 (12) , 1-55
Abstract
Design knowledge in the vast amount of design reports and documents can be an excellent resource for designers in their practice. However, capturing such domain-specific information embedded in long-length unstructured texts is always time-consuming and sometimes tricky. Therefore, it is highly desirable for a computer system to automatically extract the main knowledge points and their corresponding inner structures from given documents. In this study of document understanding for design support (DocUDS), a design-perspective knowledge extraction approach is proposed that uses phrase-level domain-specific labeled datasets to finetune a Bidirectional Encoder Representation from Transformers (BERT) model so that it can extract design knowledge from documents. The BERT model finetuning attempts to blend in the domain-specific knowledge of well-recognized domain concepts and is based on the datasets generated from design reports. The model is utilized to map the captured sentences to the main design entities , , and . In addition, this approach uncovers inner relationships among the sentences and constructs overall structures of documents to enhance understanding. The definitions of design perspectives, inter-perspective relations, and intra-perspective relations are introduced, which together capture the main design knowledge points and their relations and constitute an understanding of the design domain knowledge of a text. The case study results have demonstrated the proposed approach's effectiveness in understanding and extracting relevant design knowledge points.Keywords
This publication has 40 references indexed in Scilit:
- BertMCN: Mapping colloquial phrases to standard medical concepts using BERT and highway networkArtificial Intelligence in Medicine, 2021
- A novel systematic method to evaluate computer-supported collaborative design technologiesResearch in Engineering Design, 2019
- Comparative analysis of requirements change prediction models: manual, linguistic, and neural networkResearch in Engineering Design, 2014
- The Function-Behaviour-Structure Ontology of Design2014
- Assessing sentence scoring techniques for extractive text summarizationExpert Systems with Applications, 2013
- Knowledge based engineering: Between AI and CAD. Review of a language based technology to support engineering designAdvanced Engineering Informatics, 2012
- A concept-based information retrieval approach for engineering domain-specific technical documentsAdvanced Engineering Informatics, 2012
- A critical review of Knowledge-Based Engineering: An identification of research challengesAdvanced Engineering Informatics, 2012
- Describing the creative design process by the integration of engineering design and cognitive psychology literatureDesign Studies, 2008
- Engineering Design1996