Mapping visual features to semantic profiles for retrieval in medical imaging
- 1 June 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 457-465
Abstract
Content based image retrieval is highly relevant in medical imaging, since it makes vast amounts of imaging data accessible for comparison during diagnosis. Finding image similarity measures that reflect diagnostically relevant relationships is challenging, since the overall appearance variability is high compared to often subtle signatures of diseases. To learn models that capture the relationship between semantic clinical information and image elements at scale, we have to rely on data generated during clinical routine (images and radiology reports), since expert annotation is prohibitively costly. Here we show that re-mapping visual features extracted from medical imaging data based on weak labels that can be found in corresponding radiology reports creates descriptions of local image content capturing clinically relevant information. We show that these semantic profiles enable higher recall and precision during retrieval compared to visual features, and that we can even map semantic terms describing clinical findings from radiology reports to localized image volume areas.Keywords
This publication has 19 references indexed in Scilit:
- Content-based image retrieval for interstitial lung diseases2012
- Texture Bags: Anomaly Retrieval in Medical Images Based on Local 3D-Texture Similarity2012
- MIForests: Multiple-Instance Learning with Randomized Trees2010
- Randomized Locality Sensitive Vocabularies for Bag-of-Features Model2010
- Fast Keypoint Recognition Using Random FernsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Fast Keypoint Recognition in Ten Lines of Code2007
- Content-based image retrieval for pulmonary computed tomography nodule images2007
- RadLex: A New Method for Indexing Online Educational MaterialsRadioGraphics, 2006
- Unsupervised feature selection applied to content-based retrieval of lung imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Statistical and structural approaches to textureProceedings of the IEEE, 1979