MVMiloš Vrhovec

Miloš Vrhovec

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Miloš Vrhovec has a total of 14 co-authors. Here are the top co-authors by number of shared publications:

  • Alison Deatsch

    Affiliation Department of Medical Physics, University of Wisconsin-Madison, Madison, Wisconsin, United States of America

    4 shared publications
  • Andrej Studen

    University of Ljubljana Faculty of Mathematics and Physics, Jadranska 19, Ljubljana, 1000, SLOVENIA

    4 shared publications
  • Hilde Bosmans

    Department of Radiology, UZ Gasthuisberg, 49 Herestraat, 3000 Leuven, Leuven, 3000, BELGIUM

    4 shared publications
  • Katja Jarm

    Institute of Oncology Ljubljana, Zaloška cesta 2, Ljubljana, Ljubljana, 1000, SLOVENIA

    4 shared publications
  • Lesley Cockmartin

    Radiology, Universitaire Ziekenhuizen Leuven, Herestraat 49, Leuven, Vlaams-Brabant, 3000, BELGIUM

    4 shared publications
  • Mateja Krajc

    Institute of Oncology Ljubljana, Zaloška cesta 2, Ljubljana, Ljubljana, 1000, SLOVENIA

    4 shared publications

Latest Publications

  • Open Access

    Sensitivity of a deep-learning-based breast cancer risk prediction model

    by Zan Klanecek, Yao-Kuan Wang, Tobias Wagner, Lesley Cockmartin, Nicholas Marshall, Brayden Schott, Ali Deatsch, Andrej Studen, Katja Jarm, Mateja Krajc, et al.

    Objective. When it comes to the implementation of deep-learning based breast cancer risk (BCR) prediction models in clinical settings, it is important to be aware that these models could be sensitive to various factors, especially those arising from the acquisition process. In this work, we investigated how sensitive the state-of-the-art BCR prediction model is to realistic image alterations that can occur as a result of different positioning during the acquisition process. Approach. 5076 mammograms (1269 exams, 650 participants) from the Slovenian and Belgium (University Hospital Leuven) Breast Cancer Screening Programs were collected. The Original MIRAI model was used for 1–5 year BCR estimation. First, BCR was predicted for the original mammograms, which were not changed. Then, a series of different image alteration techniques was performed, such as swapping left and right breasts, removing tissue below the inframammary fold, translations, cropping, rotations, registration and pectoral muscle removal. In addition, a subset of 81 exams, where at least one of the mammograms had to be retaken due to inadequate image quality, served as an approximation of a test–retest experiment. Bland–Altman plots were used to determine prediction bias and 95% limits of agreement (LOA). Additionally, the mean absolute difference in BCR (Mean AD) was calculated. The impact on the overall discrimination performance was evaluated with the AUC. Results. Swapping left and right breasts had no impact on the predicted BCR. The removal of skin tissue below the inframammary fold had minimal impact on the predicted BCR (1–5 year LOA: [−0.02, 0.01]). The model was sensitive to translation, rotation, registration, and cropping, where LOAs of up to ±0.1 were observed. Partial pectoral muscle removal did not have a major impact on predicted BCR, while complete removal of pectoral muscle introduced substantial prediction bias and LOAs (1 year LOA: [−0.07, 0.04], 5 year LOA: [−0.06, 0.03]). The approximation of a real test–retest experiment resulted in LOAs similar to those of simulated image alterations. None of the alterations impacted the overall BCR discrimination performance; the initial 1 year AUC (0.90 [0.88, 0.92]) and 5 year AUC (0.77 [0.75, 0.80]) remained unchanged. Significance. While tested image alterations do not impact overall BCR discrimination performance, substantial changes in predicted 1–5 year BCR can occur on an individual basis.


  • Open Access

    Impact of pectoral muscle removal on deep-learning-based breast cancer risk prediction

    by Zan Klanecek, Yao-Kuan Wang, Tobias Wagner, Lesley Cockmartin, Nicholas Marshall, Brayden Schott, Ali Deatsch, Andrej Studen, Katja Jarm, Mateja Krajc, et al.

    Objective. State-of-the-art breast cancer risk (BCR) prediction models have been originally trained on mammograms with pectoral muscle (PM) included. This study investigated whether excluding PM during training/fine-tuning improves the model’s BCR discrimination performance, calibration, and robustness. Approach. First, the Original deep learning model (MIRAI), trained on the US (Massachusetts General Hospital) data, was validated, and the relative contribution of PM to BCR predictions was evaluated using saliency maps. Additionally, 23 792 mammograms from the Slovenian screening program were collected and two datasets were created, with and without screening positive exams. The original MIRAI was then fine-tuned on the training/fine-tuning set of Slovenian mammograms with and without PM, creating Fine-tuned MIRAI models. In total, four models (Original MIRAI with PM, Original MIRAI without PM, Fine-tuned MIRAI with PM, Fine-tuned MIRAI without PM) were compared on a test set in terms of discrimination performance for 1–5 Year BCR (evaluating area under the curve), calibration performance (measured with expected calibration error—ECE) and robustness to incremental PM removals/additions, and to incremental breast tissue removals. Results. The relative contribution of PM to the BCR prediction on the Original MIRAI model was low (∼5%); however, there were significant outliers where the relative contribution was more than 50%. The removal of PM did not impact the 1–5 Year BCR discrimination performance of the Original MIRAI (with screening positive exams: 0.77–0.91, without screening positive exams: 0.64–0.67). Fine-tuned MIRAI on mammograms with PM removed achieved significantly higher 1-5 Year BCR discrimination performance (with screening positive exams: 0.82–0.93, without screening positive exams: 0.71–0.79). After recalibration, all models had similar ECE (with screening positive exams: 0.04–0.05, without screening positive exams: 0.02–0.03). Significance. Improved BCR discrimination performance can be achieved when the model is trained/fine-tuned on mammograms with PM removed.


  • Open Access

    Longitudinal interpretability of deep learning based breast cancer risk prediction

    by Zan Klanecek, Yao-Kuan Wang, Tobias Wagner, Lesley Cockmartin, Nicholas Marshall, Brayden Schott, Ali Deatsch, Andrej Studen, Katja Jarm, Mateja Krajc, et al.

    : Objective. Deep-learning-based models have achieved state-of-the-art breast cancer risk (BCR) prediction performance. However, these models are highly complex, and the underlying mechanisms of BCR prediction are not fully understood. Key questions include whether these models can detect breast morphologic changes that lead to cancer. These findings would boost confidence in utilizing BCR models in practice and provide clinicians with new perspectives. In this work, we aimed to determine when oncogenic processes in the breast provide sufficient signal for the models to detect these changes. Approach. In total, 1210 screening mammograms were collected for patients screened at different times before the cancer was screen-detected and 2400 mammograms for patients with at least ten years of follow-up. MIRAI, a BCR risk prediction model, was used to estimate the BCR. Attribution heterogeneity was defined as the relative difference between the attributions obtained from the right and left breasts using one of the eight interpretability techniques. Model reliance on the side of the breast with cancer was quantified with AUC. The Mann–Whitney U test was used to check for significant differences in median absolute Attribution Heterogeneity between cancer patients and healthy individuals. Results. All tested attribution methods showed a similar longitudinal trend, where the model reliance on the side of the breast with cancer was the highest for the 0–1 years-to-cancer interval (AUC = 0.85–0.95), dropped for the 1–3 years-to-cancer interval (AUC = 0.64–0.71), and remained above the threshold for random performance for the 3–5 years-to-cancer interval (AUC = 0.51–0.58). For all eight attribution methods, the median values of absolute attribution heterogeneity were significantly larger for patients diagnosed with cancer at one point (p < 0.01). Significance. Interpretability of BCR prediction has revealed that long-term predictions (beyond three years) are most likely based on typical breast characteristics, such as breast density; for mid-term predictions (one to three years), the model appears to detect early signs of tumor development, while for short-term predictions (up to a year), the BCR model essentially functions as a breast cancer detection model.


  • Open Access

    Uncertainty estimation for deep learning-based pectoral muscle segmentation via Monte Carlo dropout

    by Zan Klanecek, Tobias Wagner, Yao-Kuan Wang, Lesley Cockmartin, Nicholas Marshall, Brayden Schott, Ali Deatsch, Andrej Studen, Kristijana Hertl, Katja Jarm, et al.

    Objective . Deep Learning models are often susceptible to failures after deployment. Knowing when your model is producing inadequate predictions is crucial. In this work, we investigate the utility of Monte Carlo (MC) dropout and the efficacy of the proposed uncertainty metric (UM) for flagging of unacceptable pectoral muscle segmentations in mammograms. Approach . Segmentation of pectoral muscle was performed with modified ResNet18 convolutional neural network. MC dropout layers were kept unlocked at inference time. For each mammogram, 50 pectoral muscle segmentations were generated. The mean was used to produce the final segmentation and the standard deviation was applied for the estimation of uncertainty. From each pectoral muscle uncertainty map, the overall UM was calculated. To validate the UM, a correlation between the dice similarity coefficient (DSC) and UM was used. The UM was first validated in a training set (200 mammograms) and finally tested in an independent dataset (300 mammograms). ROC-AUC analysis was performed to test the discriminatory power of the proposed UM for flagging unacceptable segmentations. Main results . The introduction of dropout layers in the model improved segmentation performance (DSC = 0.95 ± 0.07 versus DSC = 0.93 ± 0.10). Strong anti-correlation ( r = −0.76, p < 0.001) between the proposed UM and DSC was observed. A high AUC of 0.98 (97% specificity at 100% sensitivity) was obtained for the discrimination of unacceptable segmentations. Qualitative inspection by the radiologist revealed that images with high UM are difficult to segment. Significance . The use of MC dropout at inference time in combination with the proposed UM enables flagging of unacceptable pectoral muscle segmentations from mammograms with excellent discriminatory power.