ALAnders Lenskjold

Anders Lenskjold

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Anders Lenskjold has a total of 56 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Multinational Validation of a Radiography-Based AI Tool for Appendicular Fracture Detection and Corresponding Reader Performance

    by Huibert C. Ruitenbeek, Mathias Willadsen Brejnebøl, Gozde Gunes, Bas J. van der Zwart, Marna G. Bouwhuis, Jessica D. Lantinga-Van Den Brink, Dimitar Ivanov Radev, Yahya Fekri Avval, Tazio Maleitzke, Kristine Ifigenia Bunyoz, et al.

    In this multinational and multireader study, a radiography-based artificial intelligence tool for fracture detection showed robust performance and conferred the greatest benefits to less experienced readers.


  • Open Access

    Artificial intelligence tools trained on human-labeled data reflect human biases: a case study in a large clinical consecutive knee osteoarthritis cohort

    by Anders Lenskjold, Mathias W Brejnebøl, Martin H Rose, Henrik Gudbergsen, Akshay Chaudhari, Anders Troelsen, Anne Moller, Janus U Nybing, Mikael Boesen

    Humans have been shown to have biases when reading medical images, raising questions about whether humans are uniform in their disease gradings. Artificial intelligence (AI) tools trained on human-labeled data may have inherent human non-uniformity. In this study, we used a radiographic knee osteoarthritis external validation dataset of 50 patients and a six-year retrospective consecutive clinical cohort of 8,273 patients. An FDA-approved and CE-marked AI tool was tested for potential non-uniformity in Kellgren-Lawrence grades between the right and left sides of the images. We flipped the images horizontally so that a left knee looked like a right knee and vice versa. According to human review, the AI tool showed non-uniformity with 20–22% disagreements on the external validation dataset and 13.6% on the cohort. However, we found no evidence of a significant difference in the accuracy compared to senior radiologists on the external validation dataset, or age bias or sex bias on the cohort. AI non-uniformity can boost the evaluated performance against humans, but image areas with inferior performance should be investigated.


  • Interobserver Agreement and Performance of Concurrent AI Assistance for Radiographic Evaluation of Knee Osteoarthritis

    by Mathias W. Brejnebøl, Anders Lenskjold, Katharina Ziegeler, Huib Ruitenbeek, Felix C. Müller, Janus U. Nybing, Jacob J. Visser, Loes M. Schiphouwer, Jorrit Jasper, Behschad Bashian, et al.

    In this retrospective, three-center, multireader study using consecutive knee radiographs in patients with suspected osteoarthritis, concurrent artificial intelligence assistance improved osteoarthritis grading performance of junior readers and increased interobserver agreement across all readers.


  • Open Access

    Performance of readers and an artificial intelligence tool for grading of radiographic knee osteoarthritis at prespecified thresholds: Statistical analysis plan

    by Mathias Willadsen Brejneboel, Mikael Boesen, Kay Geert A. Hermann, Edwin Oei, Huib Ruitenbeek, Katharina Ziegeler, Jacob J. Visser, Anders Lenskjold, Philip Hansen, Janus Uhd Nybing

    Background and rationale Knee osteoarthritis (OA) is a common disease characterized by reduced function, stiffness, and pain. This clinical diagnosis is commonly supported with radiography of the weight-bearing knee. Radiographic features, such as the Kellgren-Lawrence (KL) grading system, are used as eligibility criteria for clinical studies while others, such as the OARSI grades and minimal joint space width, are used as endpoints for structural OA progression. A higher preoperative KL-grade has been correlated with better pain- and functional outcomes after knee arthroplasty surgery. Consequently, the KL-grade is a common requirement for approving knee arthroplasty among American health insurance providers and it is commonly used by orthopedic surgeons as part of determining knee arthroplasty candidacy. Historically, a radiologist was required to draw on and grade radiographs of the knee to extract the features. With increasing computational power and the increased use of deep convolutional neural networks, off-the-shelf artificial intelligence (AI) tools have become available for automatic extraction of these features. They have received regulatory approval for commercialization but it is apparent that more diligent external validation is required. Finally, as AI tools begin to mature, new versions are released. It is important to assess how these developments change the current performance of the tool. Objectives The aim of this analysis is to evaluate the performance of a commercially available AI tool for grading tibiofemoral OARSI grades, KL grades and patellar osteophytes as well as the accuracy of measuring joint space width. Additionally, a change impact analysis will be performed where the performance of the current version of the AI tool will be compared to that of the previous version. Methods This study is a secondary analysis of the data from the AutoRayValid-RBknee study, a retrospective observer performance study. It consists of non-fixed-flexion radiographs acquired from the production picture archiving and communications system (PACS) from three European centers. Root mean square error (RMSE) will be used for estimating the accuracy of minimal and fixed-location joint space width (JSW) measurements. Ordinal ROC will be used for estimating ordinal OARSI-grade and the KL-grade classification AUC. Area under the receiver operating curve (AUC) is used for estimating binary OARSI-grade and patellar osteophyte classification performance. Population Patients with knee pain referred for radiography on suspicion of knee osteoarthritis Index test RBknee-2.2.0 (CE version, KL-grading, OARSI grading, patellar osteophytes) and RBknee-fda-1.0.1 (FDA version, Joint Space Width measurement). RBknee-2.1.0 (CE version, KL-grading, OARSI grading, patellar osteophytes) will be used to perform the change impact analysis of advancing product development. Reference test For all discrete variables, the reference value will be the majority vote, arbitrated by consensus where grades differ by 2 or more. The readers will be three board-certified musculoskeletal radiologists with substantial clinical and research experience. For continuous variables, annotation will be done by a single radiologist trained in the task. The annotations will be reviewed by a board-certified musculoskeletal radiologist with substantial clinical and research experience. Sample size Not applicable as this is a secondary analysis. Framework This is a diagnostic test accuracy study assessing the performance of a commercially available AI tool for radiographic evaluation of knee osteoarthritis according to established grading systems. Additionally, change impact analysis will be performed where multiple versions of the AI tool are available. Confidence intervals and P values All 95% confidence intervals and P values will use an alpha of 5%. Multiplicity No explicit multiplicity correction will be performed. Instead a hierarchical approach will be taken based on tabular order of the tested hypotheses. Statistical software R version 4.2.2 (or newer).

  • Open Access

    Constructing a clinical radiographic knee osteoarthritis database using artificial intelligence tools with limited human labor: A proof of principle

    by Anders Lenskjold, Mathias W. Brejnebøl, Janus U. Nybing, Martin H. Rose, Henrik Gudbergsen, Anders Troelsen, Anne Moller, Henriette Raaschou, Mikael Boesen


  • Open Access

    Protocol for the AutoRayValid-RBfracture Study: Evaluating the efficacy of an AI fracture detection system

    by Huib Ruitenbeek, Liv Egnell, Katharina Ziegeler, Mathias Willadsen Brejnebøl, Janus Uhd Nybing, Anders Lensskjold, Pavel Klastrup Lisouski, Michael Lundemann, Kay Geert A. Hermann, Mikael Boesen, et al.

    Background Rapidly diagnosing fractures in appendicular skeletons is vital in the ED, where junior physicians often interpret initial radiographs. However, missed fractures remain a concern, prompting AI-assisted detection exploration. Yet, existing studies lack clinical context. We propose a multi-center retrospective study evaluating the AI aid RBfracture™ v.1, aiming to assess AI’s impact on diagnostic thinking by analyzing consecutive cases with clinical data, providing insights into fracture detection and clinical decision-making. Objectives To provide new insights on the potential value of AI tools across borders and different healthcare systems. We will evaluate the performance of the AI aid to detect fractures on conventional x-ray images and how its use could affect handling of these cases in a healthcare setting. In order to explore if the use of a trained and certified AI tool on clinical data exposes new challenges, a daily practice clinical scenario will be approached by minimising selection criteria and using consecutive cases. A multicenter, retrospective, diagnostic accuracy cross-sectional design incorporates clinical context. Methods The multicenter study spans three European sites without onsite hardware. AI system RBfracture™ v.1 maintains consistent sensitivity and specificity thresholds. Eligibility involves age ≥21 with x-ray indications for appendicular fractures. Exclusions include casts, follow-up x-rays, nearby hardware. AI aids retrospective fracture detection. Reader sessions include radiology and emergency care residents and trainees reading with and without AI. Fractures are marked, rated, with expert-established reference standards. Data Sequential patient studies at three sites yield 500 cases per site. Data includes anatomy, referral notes, radiology reports, and radiographic images. Expert readers use annotations, clinical context for standards. Statistical methods include dichotomized confidence ratings, sensitivity, specificity calculations, site-based analysis and subgroup considerations. Reference Standard Two experienced readers annotate fractures; if their annotations overlap by 25% or more, the common area is the reference. Discrepancies are resolved by a local expert. Individual fractures are labelled.


  • Open Access

    Should artificial intelligence have lower acceptable error rates than humans?

    by Anders Lenskjold, Janus Uhd Nybing, Charlotte Trampedach, Astrid Galsgaard, Mathias Willadsen Brejnebøl, Henriette Raaschou, Martin Høyer Rose, Mikael Boesen

    The first patient was misclassified in the diagnostic conclusion according to a local clinical expert opinion in a new clinical implementation of a knee osteoarthritis artificial intelligence (AI) algorithm at Bispebjerg-Frederiksberg University Hospital, Copenhagen, Denmark. In preparation for the evaluation of the AI algorithm, the implementation team collaborated with internal and external partners to plan workflows, and the algorithm was externally validated. After the misclassification, the team was left wondering: what is an acceptable error rate for a low-risk AI diagnostic algorithm? A survey among employees at the Department of Radiology showed significantly lower acceptable error rates for AI (6.8 %) than humans (11.3 %). A general mistrust of AI could cause the discrepancy in acceptable errors. AI may have the disadvantage of limited social capital and likeability compared to human co-workers, and therefore, less potential for forgiveness. Future AI development and implementation require further investigation of the fear of AI’s unknown errors to enhance the trustworthiness of perceiving AI as a co-worker. Benchmark tools, transparency, and explainability are also needed to evaluate AI algorithms in clinical implementations to ensure acceptable performance.


  • Open Access

    Protocol for the AutoRayValid-RBknee Study: a Retrospective, Multicenter, Fully-crossed, Multi-reader, Multi-case Study Investigating the Effect of a Knee Osteoarthritis Severity Classification Model on Reader Diagnostic Accuracy

    by Mathias Willadsen Brejnebøl, Liv Egnell, Michael Lundemann, Anders Lenskjold, Janus Uhd Nybing, Huib Ruitenbeek, Katharina Ziegeler, Jacob Visser, Kay Geert A. Hermann, Edwin H.G. Oei, et al.

    Background: Radiographic evaluation of knee osteoarthritis (KOA) commonly supports clinical findings. Ground truth is difficult to establish and concerns exist on the inter-and intrarater agreement of the findings. RBknee™ is a CE-marked and FDA-cleared AI tool for automatic assessment and reporting of radiographic KOA on standard projection radiographs. Objectives: To investigate how the use of an AI tool affects the accuracy among human readers across three European hospitals in grading the severity of osteoarthritis and associated individual radiographic features. In addition, the performance of the AI tool will also be compared to reference standards established by experts in a stand-alone validation. Methods: In this retrospective multicenter, fully-crossed, multi-reader, multi-case (MRMC) study, the AI support tool RBknee is introduced as a diagnostic intervention. Four Index Readers from each site (two orthopaedic surgeons and two radiologists) will read all studies twice in two runs separated by a washout period of at least four weeks. In both runs, the experiment will be arranged so that the AI-aid will be available for half of the images in the first session and for the second half of the images in the second session. The order of the images will be randomised in order to minimise temporal effects and biases. The primary endpoint is the difference in diagnostic test accuracy for radiographic KOA grading without and with the aid of the AI tool and will be measured as the ordinal weighted accuracy. Data: The data includes radiographic images from 225 studies (unique patients, retrospective data) with weight-bearing bilateral PA/AP and LAT projections of the symptomatic knee(s). Each site contributes to the cohort with 75 studies of which 70 will be consecutive and 5 will be selected to balance the prevalence of radiographic KOA severity. Reference standard: The reference standard will be established based on independent grading by three KOA Reference Experts and adjudicated by majority vote. Where impossible to resolve by majority voting, adjudication will be established by consensus. Index test, AI tool (stand-alone validation): The diagnostic accuracy of RBknee will be tested against the reference standard. Index test, Index Readers: The 12 readers will grade KL on the PA/AP projection and patellar osteophytes on the lateral projection. Administrative information: Title: The trial is titled “AutoRayValid-RBknee”. Protocol version: Revision History Funding: This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 954221 for the EIC SME Instrument project AutoRay. The work only reflects the authors’ view and the European Commission is not responsible for any use that may be made from the information it contains. Roles and responsibilities: Authors’ contributions: MWB, MB, EHGO, JV, and KGH initiated the study design and AL, JUN, KZ and HR helped with implementation. MWB, LE and MJL provided statistical expertise in clinical study design and MWB is conducting the primary statistical analysis. MWB, MJL and LE prepared the manuscript and all authors contributed to its refinement and approved the final manuscript. Sponsor Contact information: Trial Sponsor: Radiobotics ApS Contact name: Liv Egnell Address: Esplanaden 8C, 1263 Copenhagen K, Denmark Email: liv@radiobotics.com


  • The influence of physical activity during youth on structural and functional properties of the Achilles tendon

    by A. Lenskjold, M. Kongsgaard, J. O. Larsen, R. H. Nielsen, V. Kovanen, P. Aagaard, M. Kjaer, S. P. Magnusson

    Achilles tendinopathy is a highly prevalent sports injury. Animal studies show a growth response in tendons in response to loading in the immature phase but not after puberty maturation. The aim of this investigation was to examine the structural and material properties in long distance runners who were either physically active (HAY) or inactive (LAY) in young age. Twelve men in HAY group and eight men in LAY group participated. Structural, functional, and biochemical properties of Achilles tendon were estimated from magnetic resonance imaging, ultrasound video recordings, mechanical tests, and tendon biopsies, respectively. There was no difference between the groups with respect to tendon cross‐sectional area or tendon free length. There was no difference between the groups with respect to maximal force or mechanical properties. The collagen content, enzymatic and nonenzymatic cross‐link density did not differ between the groups, nor did collagen fibril density, diameter, and area. There was a correlation between age and pentosidine/collagen within the groups [(HAY: P < 0.05 and r2 = 0.47) and (LAY: P < 0.05 and r2 = 0.52)]. The data suggest that high or low activity during youth did not appreciably influence the mechanical, structural, or biochemical properties of the Achilles tendon in adult long distance runners.