Interactive Visual Study of Multiple Attributes Learning Model of X-Ray Scattering Images
- 26 October 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 27 (2) , 1312-1321
Abstract
Existing interactive visualization tools for deep learning are mostly applied to the training, debugging, and refinement of neural network models working on natural images. However, visual analytics tools are lacking for the specific application of x-ray image classification with multiple structural attributes. In this paper, we present an interactive system for domain scientists to visually study the multiple attributes learning models applied to x-ray scattering images. It allows domain scientists to interactively explore this important type of scientific images in embedded spaces that are defined on the model prediction output, the actual labels, and the discovered feature space of neural networks. Users are allowed to flexibly select instance images, their clusters, and compare them regarding the specified visual representation of attributes. The exploration is guided by the manifestation of model performance related to mutual relationships among attributes, which often affect the learning accuracy and effectiveness. The system thus supports domain scientists to improve the training dataset and model, find questionable attributes labels, and identify outlier images or spurious data clusters. Case studies and scientists feedback demonstrate its functionalities and usefulness.Keywords
Funding Information
- KSU graduate assistantship
- BNL LDRD (18-009)
- ECP CODAR (17-SC-20-SC)
This publication has 28 references indexed in Scilit:
- Visualizing the Hidden Activity of Artificial Neural NetworksIEEE Transactions on Visualization and Computer Graphics, 2016
- Towards Better Analysis of Deep Convolutional Neural NetworksIEEE Transactions on Visualization and Computer Graphics, 2016
- Learning Deep Features for Discriminative Localization2016
- “Why Should I Trust You?”: Explaining the Predictions of Any Classifier2016
- Periodic lattices of arbitrary nano-objects: modeling and applications for self-assembled systemsJournal of Applied Crystallography, 2013
- Synergy, redundancy, and multivariate information measures: an experimentalist’s perspectiveJournal of Computational Neuroscience, 2013
- Development of an instrument measuring user satisfaction of the human-computer interface1988
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987
- A Cluster Separation MeasureIEEE Transactions on Pattern Analysis and Machine Intelligence, 1979
- A dendrite method for cluster analysisCommunications in Statistics, 1974