Formal Verification of a Decision-Tree Ensemble Model and Detection of Its Violation Ranges
Authors:
Open Access
- 1 February 2020
- journal article
- research article
- Published by Institute of Electronics, Information and Communications Engineers (IEICE) in IEICE Transactions on Information and Systems
- Vol. E103.D (2) , 363-378
Abstract
As one type of machine-learning model, a “decision-tree ensemble model” (DTEM) is represented by a set of decision trees. A DTEM is mainly known to be valid for structured data; however, like other machine-learning models, it is difficult to train so that it returns the correct output value (called “prediction value”) for any input value (called “attribute value”). Accordingly, when a DTEM is used in regard to a system that requires reliability, it is important to comprehensively detect attribute values that lead to malfunctions of a system (failures) during development and take appropriate countermeasures. One conceivable solution is to install an input filter that controls the input to the DTEM and to use separate software to process attribute values that may lead to failures. To develop the input filter, it is necessary to specify the filtering condition for the attribute value that leads to the malfunction of the system. In consideration of that necessity, we propose a method for formally verifying a DTEM and, according to the result of the verification, if an attribute value leading to a failure is found, extracting the range in which such an attribute value exists. The proposed method can comprehensively extract the range in which the attribute value leading to the failure exists; therefore, by creating an input filter based on that range, it is possible to prevent the failure. To demonstrate the feasibility of the proposed method, we performed a case study using a dataset of house prices. Through the case study, we also evaluated its scalability and it is shown that the number and depth of decision trees are important factors that determines the applicability of the proposed method.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Formal Development of Policing Functions for Intelligent Systems2017
- Safety Verification of Deep Neural Networks2017
- Monitoring organic carbon, total nitrogen, and pH for reclaimed soils using field reflectance spectroscopyCanadian Journal of Soil Science, 2017
- XGBoost2016
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- Using data mining to model and interpret soil diffuse reflectance spectraGeoderma, 2010
- Predicting clicks2007
- Variable importance in binary regression trees and forestsElectronic Journal of Statistics, 2007
- Newer Classification and Regression Tree Techniques: Bagging and Random Forests for Ecological PredictionEcosystems, 2006
- Random ForestsMachine Learning, 2001