Lavinia Ferrante di Ruffano
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Lavinia Ferrante di Ruffano has a total of 403 co-authors. Here are the top co-authors by number of shared publications:
- Jonathan James Deeks
Department of Applied Health Sciences, School of Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK
15 shared publications - Jacqueline Dinnes
Department of Applied Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK
9 shared publications Clare Davenport
University of Birmingham; Institute of Applied Health Research; Edgbaston Campus Birmingham UK B15 2TT
8 shared publications- Yemisi Takwoingi
Department of Applied Health Sciences, University of Birmingham, and National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, Birmingham, United Kingdom (C.F.D., Y.T., J.J.D.)
7 shared publications - Chris Hyde
University of Exeter
5 shared publications Cochrane Skin Cancer Diagnostic Test Accuracy Group
University of Birmingham
5 shared publications
Latest Publications
- Open Access
- 3 November 2025
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 189, 112040
Methodological review reveals essential gaps and inconsistencies in clinical claims, effects, and outcomes in HTA reviews of diagnostic tests
- 3 November 2025
- Published by Elsevier in Journal of Clinical Epidemiology
- Vol. 189, 112040
Open AccessMethodological review reveals essential gaps and inconsistencies in clinical claims, effects, and outcomes in HTA reviews of diagnostic tests
- Open Access
- 13 September 2025
- Published by Elsevier in The Journal of Allergy and Clinical Immunology: In Practice
- Vol. 13 (9) , 2460-2474
Reported Demographics of Primary Immunodeficiency Diseases in the United States
- 13 September 2025
- Published by Elsevier in The Journal of Allergy and Clinical Immunology: In Practice
- Vol. 13 (9) , 2460-2474
Open AccessReported Demographics of Primary Immunodeficiency Diseases in the United States
- Open Access
- 1 December 2024
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 40 (S1) , S90
PP86 Development Of A Tool To Assist In The Identification Of Study Designs For The Purposes Of Health Technology Assessment
Introduction: As the most internally rigorous design, randomized controlled trials (RCTs) are the gold standard for assessing the efficacy and safety profile of interventions. Increasingly, health technology assessment (HTA) considers evidence from non-randomized studies. Guidance recommends synthesizing different study designs separately due to their different inherent biases/limitations. But when authors or reviewers misclassify studies, this could affect which studies are included and therefore have an impact on review results.Methods: We are conducting a methods project to (i) identify a clear study design classification system, (ii) explore whether its use produces consistent study design categorizations among reviewers, and (iii) iteratively improve the classification system. We performed a pragmatic web-based search for study design categorization tools and used the resulting schemas to develop a clear algorithm for use by reviewers of all levels of experience, specifically in reviews of treatment interventions. Next, we tested tool consistency and user experience by web-based survey in a small internal sample of reviewers, each independently using the system to categorize 18 published studies.Results: A median of seven reviewers (range four to eight) categorized each study. Rater agreement using the chart varied widely, with 100 percent agreement on the designs of three studies (17%), and at least 75 percent of reviewers agreeing on one design for nine studies (50%). The most common agreement was reached on RCTs and non-randomized controlled trials. The most common sources of disagreement were between different types of cohort studies and between case series and controlled cohort studies, largely due to inconsistent reporting. We also identified several improvements: the wording of prompt questions, the ordering of designs, and the addition of new elements.Conclusions: The classification system as initially designed led to too much variation in study design categorization to be useful. Consequently, we present a revised version that we now aim to evaluate in a larger sample of reviewers. Further research will also investigate whether using the tool would change the results of systematic reviews, using a small sample of published reviews.
- 1 December 2024
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 40 (S1) , S90
Open AccessPP86 Development Of A Tool To Assist In The Identification Of Study Designs For The Purposes Of Health Technology Assessment
Introduction: As the most internally rigorous design, randomized controlled trials (RCTs) are the gold standard for assessing the efficacy and safety profile of interventions. Increasingly, health technology assessment (HTA) considers evidence from non-randomized studies. Guidance recommends synthesizing different study designs separately due to their different inherent biases/limitations. But when authors or reviewers misclassify studies, this could affect which studies are included and therefore have an impact on review results.Methods: We are conducting a methods project to (i) identify a clear study design classification system, (ii) explore whether its use produces consistent study design categorizations among reviewers, and (iii) iteratively improve the classification system. We performed a pragmatic web-based search for study design categorization tools and used the resulting schemas to develop a clear algorithm for use by reviewers of all levels of experience, specifically in reviews of treatment interventions. Next, we tested tool consistency and user experience by web-based survey in a small internal sample of reviewers, each independently using the system to categorize 18 published studies.Results: A median of seven reviewers (range four to eight) categorized each study. Rater agreement using the chart varied widely, with 100 percent agreement on the designs of three studies (17%), and at least 75 percent of reviewers agreeing on one design for nine studies (50%). The most common agreement was reached on RCTs and non-randomized controlled trials. The most common sources of disagreement were between different types of cohort studies and between case series and controlled cohort studies, largely due to inconsistent reporting. We also identified several improvements: the wording of prompt questions, the ordering of designs, and the addition of new elements.Conclusions: The classification system as initially designed led to too much variation in study design categorization to be useful. Consequently, we present a revised version that we now aim to evaluate in a larger sample of reviewers. Further research will also investigate whether using the tool would change the results of systematic reviews, using a small sample of published reviews.
- Open Access
- 1 December 2024
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 40 (S1) , S97-S98
PP109 Which Review Is Right For You? Choosing A Review Methodology
Introduction: While systematic reviews (SRs) are regarded as the gold standard in healthcare evidence reviewing (and a requirement of many health technology assessments [(HTAs)]), other types of review also play an important role throughout a product’s lifecycle. Drawing on more than thirty years’ experience in conducting reviews, we present key points to consider when deciding which review type might be required.Methods: SRs are recommended when a comprehensive search and synthesis approach is required, for example HTAs. They have highly structured methods, emphasizing bias minimization, transparency, and replicability. “Rapid,” “pragmatic,” or “targeted” reviews are increasingly popular due to their accelerated timelines and reduced costs, with methodological shortcuts possible at various stages. Scoping reviews explore what is known about a topic and typically have a broad research question. “Reviews of reviews” or “overviews” identify existing SRs on an established topic. Finally, “living reviews” follow the same process as an SR or rapid review but incorporate new evidence on a continual or regular basis.Results: Rapid reviews may be appropriate when flexibility exists regarding the scope and review methods. Any limitations due to methodological shortcuts must be acknowledged in a transparent manner. Scoping reviews are useful for pioneering research ahead of an SR, or early in a product’s development phase, when an overall understanding of the evidence base is required. Reviews of reviews are particularly useful when the size of the primary study literature means that a review of primary studies would be unfeasible. Living reviews are best suited to topics where the evidence base is changing rapidly, or the best information is needed quickly.Conclusions: When considering conducting or commissioning a review, organizations should consider the intended audience for the review, the resources, time, and budget available, and the size of the existing literature. Although SRs remain the gold standard, a rapid review, scoping review, or review of reviews may offer a more suitable way to approach a given research question.
- 1 December 2024
- Published by Cambridge University Press (CUP) in International Journal of Technology Assessment in Health Care
- Vol. 40 (S1) , S97-S98
Open AccessPP109 Which Review Is Right For You? Choosing A Review Methodology
Introduction: While systematic reviews (SRs) are regarded as the gold standard in healthcare evidence reviewing (and a requirement of many health technology assessments [(HTAs)]), other types of review also play an important role throughout a product’s lifecycle. Drawing on more than thirty years’ experience in conducting reviews, we present key points to consider when deciding which review type might be required.Methods: SRs are recommended when a comprehensive search and synthesis approach is required, for example HTAs. They have highly structured methods, emphasizing bias minimization, transparency, and replicability. “Rapid,” “pragmatic,” or “targeted” reviews are increasingly popular due to their accelerated timelines and reduced costs, with methodological shortcuts possible at various stages. Scoping reviews explore what is known about a topic and typically have a broad research question. “Reviews of reviews” or “overviews” identify existing SRs on an established topic. Finally, “living reviews” follow the same process as an SR or rapid review but incorporate new evidence on a continual or regular basis.Results: Rapid reviews may be appropriate when flexibility exists regarding the scope and review methods. Any limitations due to methodological shortcuts must be acknowledged in a transparent manner. Scoping reviews are useful for pioneering research ahead of an SR, or early in a product’s development phase, when an overall understanding of the evidence base is required. Reviews of reviews are particularly useful when the size of the primary study literature means that a review of primary studies would be unfeasible. Living reviews are best suited to topics where the evidence base is changing rapidly, or the best information is needed quickly.Conclusions: When considering conducting or commissioning a review, organizations should consider the intended audience for the review, the resources, time, and budget available, and the size of the existing literature. Although SRs remain the gold standard, a rapid review, scoping review, or review of reviews may offer a more suitable way to approach a given research question.
- Open Access
- 29 July 2024
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1
Author Correction: Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines
- 29 July 2024
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1
Open AccessAuthor Correction: Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines
- Open Access
- 22 February 2024
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1-11
Concordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77–94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
- 22 February 2024
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1-11
Open AccessConcordance of randomised controlled trials for artificial intelligence interventions with the CONSORT-AI reporting guidelines
The Consolidated Standards of Reporting Trials extension for Artificial Intelligence interventions (CONSORT-AI) was published in September 2020. Since its publication, several randomised controlled trials (RCTs) of AI interventions have been published but their completeness and transparency of reporting is unknown. This systematic review assesses the completeness of reporting of AI RCTs following publication of CONSORT-AI and provides a comprehensive summary of RCTs published in recent years. 65 RCTs were identified, mostly conducted in China (37%) and USA (18%). Median concordance with CONSORT-AI reporting was 90% (IQR 77–94%), although only 10 RCTs explicitly reported its use. Several items were consistently under-reported, including algorithm version, accessibility of the AI intervention or code, and references to a study protocol. Only 3 of 52 included journals explicitly endorsed or mandated CONSORT-AI. Despite a generally high concordance amongst recent AI RCTs, some AI-specific considerations remain systematically poorly reported. Further encouragement of CONSORT-AI adoption by journals and funders may enable more complete adoption of the full CONSORT-AI guidelines.
- Open Access
- 22 September 2022
- Published by Springer Nature in Diagnostic and Prognostic Research
- Vol. 6 (1) , 1-16
TOMAS-R: A template to identify and plan analysis for clinically important variation and multiplicity in diagnostic test accuracy systematic reviews
The Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy (DTA) provides guidance on important aspects of conducting a test accuracy systematic review. In this paper we present TOMAS-R (Template of Multiplicity and Analysis in Systematic Reviews), a structured template to use in conjunction with current Cochrane DTA guidance, to help identify complexities in the review question and to assist planning of data extraction and analysis when clinically important variation and multiplicity is present. Examples of clinically important variation and multiplicity could include differences in participants, index tests and test methods, target conditions and reference standards used to define them, study design and methodological quality. Our TOMAS-R template goes beyond the broad topic headings in current guidance that are sources of potential variation and multiplicity, by providing prompts for common sources of heterogeneity encountered from our experience of authoring over 100 reviews. We provide examples from two reviews to assist users. The TOMAS-R template adds value by supplementing available guidance for DTA reviews by providing a tool to facilitate discussions between methodologists, clinicians, statisticians and patient/public team members to identify the full breadth of review question complexities early in the process. The use of a structured set of prompting questions at the important stage of writing the protocol ensures clinical relevance as a main focus of the review, while allowing identification of key clinical components for data extraction and later analysis thereby facilitating a more efficient review process.
- 22 September 2022
- Published by Springer Nature in Diagnostic and Prognostic Research
- Vol. 6 (1) , 1-16
Open AccessTOMAS-R: A template to identify and plan analysis for clinically important variation and multiplicity in diagnostic test accuracy systematic reviews
The Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy (DTA) provides guidance on important aspects of conducting a test accuracy systematic review. In this paper we present TOMAS-R (Template of Multiplicity and Analysis in Systematic Reviews), a structured template to use in conjunction with current Cochrane DTA guidance, to help identify complexities in the review question and to assist planning of data extraction and analysis when clinically important variation and multiplicity is present. Examples of clinically important variation and multiplicity could include differences in participants, index tests and test methods, target conditions and reference standards used to define them, study design and methodological quality. Our TOMAS-R template goes beyond the broad topic headings in current guidance that are sources of potential variation and multiplicity, by providing prompts for common sources of heterogeneity encountered from our experience of authoring over 100 reviews. We provide examples from two reviews to assist users. The TOMAS-R template adds value by supplementing available guidance for DTA reviews by providing a tool to facilitate discussions between methodologists, clinicians, statisticians and patient/public team members to identify the full breadth of review question complexities early in the process. The use of a structured set of prompting questions at the important stage of writing the protocol ensures clinical relevance as a main focus of the review, while allowing identification of key clinical components for data extraction and later analysis thereby facilitating a more efficient review process.
- Open Access
- 15 January 2022
- Published by Springer Nature in Trials
- Vol. 23 (1) , 1-15
Outcome selection for tissue-agnostic drug trials for immune-mediated inflammatory diseases: a systematic review of core outcome sets and regulatory guidance
Background: Tissue-agnostic drug development provides a paradigm shift in precision medicine and requires innovative trial designs. However, outcome selection for such trials can prove challenging. The objectives of this review were to: Identify and map core outcome sets (COS), across 11 immune-mediated inflammatory diseases (IMIDs) in order to facilitate the selection of relevant outcomes across the conditions for innovative trials of tissue-agnostic drug therapies. Compare outcomes or endpoints recommended by the US Food and Drug Administration (FDA) and European Medicines Agency (EMA) to identify and highlight similarities and differences. Methods: The Core Outcome Measures in Effectiveness Trials (COMET), International Consortium for Health Outcomes Measurement (ICHOM), FDA and EMA databases were searched from inception to 28th December 2019. Two reviewers independently screened titles and abstracts of retrieved entries and conducted the subsequent full text screening. Hand searching of the reference lists and citation searching of the selected publications was conducted. The methodological quality of the included peer-reviewed articles was independently assessed by the reviewers based on the items of the COS–Standards for Development recommendations (COS–STAD) checklist. Core outcomes from the included publications were extracted and mapped across studies and conditions. Regulatory guidance from FDA and EMA, where available for clinical trials for the IMIDs, were obtained from their databases and recommendations on outcomes to measure directly compared. Results: Forty-four COS publications were included in the final analysis. Outcomes such as disease activity, pain, fatigue, quality of life, physical function, work limitation/productivity, steroid use and biomarkers were recommended across majority of the conditions. There were significant similarities and differences in FDA and EMA recommendations. The only instance where either regulatory body directly referenced a COS was for jSLE—both referenced the Paediatric Rheumatology International Trials Organization (PRINTO) COS. Conclusions: The findings from this systematic review provide valuable information to inform outcome selection in tissue-agnostic trials for IMIDs. There is a need for increased collaboration between regulators and COS developers and inclusion of regulators as key stakeholders in COS development to enhance the quality of COS. Trial registration: Not registered.
- 15 January 2022
- Published by Springer Nature in Trials
- Vol. 23 (1) , 1-15
Open AccessOutcome selection for tissue-agnostic drug trials for immune-mediated inflammatory diseases: a systematic review of core outcome sets and regulatory guidance
Background: Tissue-agnostic drug development provides a paradigm shift in precision medicine and requires innovative trial designs. However, outcome selection for such trials can prove challenging. The objectives of this review were to: Identify and map core outcome sets (COS), across 11 immune-mediated inflammatory diseases (IMIDs) in order to facilitate the selection of relevant outcomes across the conditions for innovative trials of tissue-agnostic drug therapies. Compare outcomes or endpoints recommended by the US Food and Drug Administration (FDA) and European Medicines Agency (EMA) to identify and highlight similarities and differences. Methods: The Core Outcome Measures in Effectiveness Trials (COMET), International Consortium for Health Outcomes Measurement (ICHOM), FDA and EMA databases were searched from inception to 28th December 2019. Two reviewers independently screened titles and abstracts of retrieved entries and conducted the subsequent full text screening. Hand searching of the reference lists and citation searching of the selected publications was conducted. The methodological quality of the included peer-reviewed articles was independently assessed by the reviewers based on the items of the COS–Standards for Development recommendations (COS–STAD) checklist. Core outcomes from the included publications were extracted and mapped across studies and conditions. Regulatory guidance from FDA and EMA, where available for clinical trials for the IMIDs, were obtained from their databases and recommendations on outcomes to measure directly compared. Results: Forty-four COS publications were included in the final analysis. Outcomes such as disease activity, pain, fatigue, quality of life, physical function, work limitation/productivity, steroid use and biomarkers were recommended across majority of the conditions. There were significant similarities and differences in FDA and EMA recommendations. The only instance where either regulatory body directly referenced a COS was for jSLE—both referenced the Paediatric Rheumatology International Trials Organization (PRINTO) COS. Conclusions: The findings from this systematic review provide valuable information to inform outcome selection in tissue-agnostic trials for IMIDs. There is a need for increased collaboration between regulators and COS developers and inclusion of regulators as key stakeholders in COS development to enhance the quality of COS. Trial registration: Not registered.
- Open Access
- 4 December 2018
- Published by Wiley in Cochrane Database of Systematic Reviews
- Vol. 12 (12) , CD013189
Optical coherence tomography for diagnosing skin cancer in adults
Background Early accurate detection of all skin cancer types is essential to guide appropriate management and to improve morbidity and survival. Melanoma and squamous cell carcinoma (SCC) are high‐risk skin cancers, which have the potential to metastasise and ultimately lead to death, whereas basal cell carcinoma (BCC) is usually localised, with potential to infiltrate and damage surrounding tissue. Anxiety around missing early cases needs to be balanced against inappropriate referral and unnecessary excision of benign lesions. Optical coherence tomography (OCT) is a microscopic imaging technique, which magnifies the surface of a skin lesion using near‐infrared light. Used in conjunction with clinical or dermoscopic examination of suspected skin cancer, or both, OCT may offer additional diagnostic information compared to other technologies. Objectives To determine the diagnostic accuracy of OCT for the detection of cutaneous invasive melanoma and atypical intraepidermal melanocytic variants, basal cell carcinoma (BCC), or cutaneous squamous cell carcinoma (cSCC) in adults. Search methods We undertook a comprehensive search of the following databases from inception up to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. Selection criteria We included studies of any design evaluating OCT in adults with lesions suspicious for invasive melanoma and atypical intraepidermal melanocytic variants, BCC or cSCC, compared with a reference standard of histological confirmation or clinical follow‐up. Data collection and analysis Two review authors independently extracted data using a standardised data extraction and quality assessment form (based on QUADAS‐2). Our unit of analysis was lesions. Where possible, we estimated summary sensitivities and specificities using the bivariate hierarchical model. Main results We included five studies with 529 cutaneous lesions (282 malignant lesions) providing nine datasets for OCT, two for visual inspection alone, and two for visual inspection plus dermoscopy. Studies were of moderate to unclear quality, using data‐driven thresholds for test positivity and giving poor accounts of reference standard interpretation and blinding. Studies may not have been representative of populations eligible for OCT in practice, for example due to high disease prevalence in study populations, and may not have reflected how OCT is used in practice, for example by using previously acquired OCT images. It was not possible to make summary statements regarding accuracy of detection of melanoma or of cSCC because of the paucity of studies, small sample sizes, and for melanoma differences in the OCT technologies used (high‐definition versus conventional resolution OCT), and differences in the degree of testing performed prior to OCT (i.e. visual inspection alone or visual inspection plus dermoscopy). Pooled data from two studies using conventional swept‐source OCT alongside visual inspection and dermoscopy for the detection of BCC estimated the sensitivity of OCT as 95% (95% confidence interval (CI) 91% to 97%) and specificity of 77% (95% CI 69% to 83%). When applied to a hypothetical population of 1000 lesions at the mean observed BCC prevalence of 60%, OCT would miss 31 BCCs (91 fewer than would be missed by visual inspection alone and 53 fewer than would be missed by visual inspection plus dermoscopy), and OCT would lead to 93 false‐positive results for BCC (a reduction in unnecessary excisions of 159 compared to using visual inspection alone and of 87 compared to visual inspection plus dermoscopy). Authors' conclusions Insufficient data are available on the use of OCT for the detection of melanoma or cSCC. Initial data suggest conventional OCT may have a role for the diagnosis of BCC in clinically challenging lesions, with our meta‐analysis showing a higher sensitivity and higher specificity when compared to visual inspection plus dermoscopy. However, the small number of studies and varying methodological quality means implications to guide practice cannot currently be drawn. Appropriately designed prospective comparative studies are required, given the paucity of data comparing OCT with dermoscopy and other similar diagnostic aids such as reflectance confocal microscopy.
- 4 December 2018
- Published by Wiley in Cochrane Database of Systematic Reviews
- Vol. 12 (12) , CD013189
Open AccessOptical coherence tomography for diagnosing skin cancer in adults
Background Early accurate detection of all skin cancer types is essential to guide appropriate management and to improve morbidity and survival. Melanoma and squamous cell carcinoma (SCC) are high‐risk skin cancers, which have the potential to metastasise and ultimately lead to death, whereas basal cell carcinoma (BCC) is usually localised, with potential to infiltrate and damage surrounding tissue. Anxiety around missing early cases needs to be balanced against inappropriate referral and unnecessary excision of benign lesions. Optical coherence tomography (OCT) is a microscopic imaging technique, which magnifies the surface of a skin lesion using near‐infrared light. Used in conjunction with clinical or dermoscopic examination of suspected skin cancer, or both, OCT may offer additional diagnostic information compared to other technologies. Objectives To determine the diagnostic accuracy of OCT for the detection of cutaneous invasive melanoma and atypical intraepidermal melanocytic variants, basal cell carcinoma (BCC), or cutaneous squamous cell carcinoma (cSCC) in adults. Search methods We undertook a comprehensive search of the following databases from inception up to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We studied reference lists and published systematic review articles. Selection criteria We included studies of any design evaluating OCT in adults with lesions suspicious for invasive melanoma and atypical intraepidermal melanocytic variants, BCC or cSCC, compared with a reference standard of histological confirmation or clinical follow‐up. Data collection and analysis Two review authors independently extracted data using a standardised data extraction and quality assessment form (based on QUADAS‐2). Our unit of analysis was lesions. Where possible, we estimated summary sensitivities and specificities using the bivariate hierarchical model. Main results We included five studies with 529 cutaneous lesions (282 malignant lesions) providing nine datasets for OCT, two for visual inspection alone, and two for visual inspection plus dermoscopy. Studies were of moderate to unclear quality, using data‐driven thresholds for test positivity and giving poor accounts of reference standard interpretation and blinding. Studies may not have been representative of populations eligible for OCT in practice, for example due to high disease prevalence in study populations, and may not have reflected how OCT is used in practice, for example by using previously acquired OCT images. It was not possible to make summary statements regarding accuracy of detection of melanoma or of cSCC because of the paucity of studies, small sample sizes, and for melanoma differences in the OCT technologies used (high‐definition versus conventional resolution OCT), and differences in the degree of testing performed prior to OCT (i.e. visual inspection alone or visual inspection plus dermoscopy). Pooled data from two studies using conventional swept‐source OCT alongside visual inspection and dermoscopy for the detection of BCC estimated the sensitivity of OCT as 95% (95% confidence interval (CI) 91% to 97%) and specificity of 77% (95% CI 69% to 83%). When applied to a hypothetical population of 1000 lesions at the mean observed BCC prevalence of 60%, OCT would miss 31 BCCs (91 fewer than would be missed by visual inspection alone and 53 fewer than would be missed by visual inspection plus dermoscopy), and OCT would lead to 93 false‐positive results for BCC (a reduction in unnecessary excisions of 159 compared to using visual inspection alone and of 87 compared to visual inspection plus dermoscopy). Authors' conclusions Insufficient data are available on the use of OCT for the detection of melanoma or cSCC. Initial data suggest conventional OCT may have a role for the diagnosis of BCC in clinically challenging lesions, with our meta‐analysis showing a higher sensitivity and higher specificity when compared to visual inspection plus dermoscopy. However, the small number of studies and varying methodological quality means implications to guide practice cannot currently be drawn. Appropriately designed prospective comparative studies are required, given the paucity of data comparing OCT with dermoscopy and other similar diagnostic aids such as reflectance confocal microscopy.
- 4 December 2018
- Published by Wiley in Cochrane Database of Systematic Reviews
- Vol. 2018 (12) , CD013187
Exfoliative cytology for diagnosing basal cell carcinoma and other skin cancers in adults
Background Early accurate detection of all skin cancer types is essential to guide appropriate management, reduce morbidity and improve survival. Basal cell carcinoma (BCC) is usually localised to the skin but has potential to infiltrate and damage surrounding tissue, while cutaneous squamous cell carcinoma (cSCC) and melanoma have a much higher potential to metastasise and ultimately lead to death. Exfoliative cytology is a non‐invasive test that uses the Tzanck smear technique to identify disease by examining the structure of cells obtained from scraped samples. This simple procedure is a less invasive diagnostic test than a skin biopsy, and for BCC it has the potential to provide an immediate diagnosis that avoids an additional clinic visit to receive skin biopsy results. This may benefit patients scheduled for either Mohs micrographic surgery or non‐surgical treatments such as radiotherapy. A cytology scrape can never give the same information as a skin biopsy, however, so it is important to better understand in which skin cancer situations it may be helpful. Objectives To determine the diagnostic accuracy of exfoliative cytology for detecting basal cell carcinoma (BCC) in adults, and to compare its accuracy with that of standard diagnostic practice (visual inspection with or without dermoscopy). Secondary objectives were: to determine the diagnostic accuracy of exfoliative cytology for detecting cSCC, invasive melanoma and atypical intraepidermal melanocytic variants, and any other skin cancer; and for each of these secondary conditions to compare the accuracy of exfoliative cytology with visual inspection with or without dermoscopy in direct test comparisons; and to determine the effect of observer experience. Search methods We undertook a comprehensive search of the following databases from inception up to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We also studied the reference lists of published systematic review articles. Selection criteria Studies evaluating exfoliative cytology in adults with lesions suspicious for BCC, cSCC or melanoma, compared with a reference standard of histological confirmation. Data collection and analysis Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS‐2). Where possible we estimated summary sensitivities and specificities using the bivariate hierarchical model. Main results We synthesised the results of nine studies contributing a total of 1655 lesions to our analysis, including 1120 BCCs (14 datasets), 41 cSCCs (amongst 401 lesions in 2 datasets), and 10 melanomas (amongst 200 lesions in 1 dataset). Three of these datasets (one each for BCC, melanoma and any malignant condition) were derived from one study that also performed a direct comparison with dermoscopy. Studies were of moderate to poor quality, providing inadequate descriptions of participant selection, thresholds used to make cytological and histological diagnoses, and blinding. Reporting of participants' prior referral pathways was particularly poor, as were descriptions of the cytodiagnostic criteria used to make diagnoses. No studies evaluated the use of exfoliative cytology as a primary diagnostic test for detecting BCC or other skin cancers in lesions suspicious for skin cancer. Pooled data from seven studies using standard cytomorphological criteria (but various stain methods) to detect BCC in participants with a high clinical suspicion of BCC estimated the sensitivity and specificity of exfoliative cytology as 97.5% (95% CI 94.5% to 98.9%) and 90.1% (95% CI 81.1% to 95.1%). respectively. When applied to a hypothetical population of 1000 clinically suspected BCC lesions with a median observed BCC prevalence of 86%, exfoliative cytology would miss 21 BCCs and would lead to 14 false positive diagnoses of BCC. No false positive cases were histologically confirmed to be melanoma. Insufficient data are available to make summary statements regarding the accuracy of exfoliative cytology to detect melanoma or cSCC, or its accuracy compared to dermoscopy. Authors' conclusions The utility of exfoliative cytology for the primary diagnosis of skin cancer is unknown, as all included studies focused on the use of this technique for confirming strongly suspected clinical diagnoses. For the confirmation of BCC in lesions with a high clinical suspicion, there is evidence of high sensitivity and specificity. Since decisions to treat low‐risk BCCs are unlikely in practice to require diagnostic confirmation given that clinical suspicion is already high, exfoliative cytology might be most useful for cases of BCC where the treatments being contemplated require a tissue diagnosis (e.g. radiotherapy). The small number of included studies, poor reporting and varying methodological quality prevent us from drawing strong conclusions to guide clinical practice. Despite insufficient data on the use of cytology for cSCC or melanoma, it is unlikely that cytology would be useful in these scenarios since preservation of the architecture of the whole lesion that would be available from a biopsy provides crucial diagnostic information. Given the paucity of good quality data, appropriately designed prospective comparative studies may be required to evaluate both the diagnostic value of exfoliative cytology by comparison to dermoscopy, and its confirmatory value in adequately reported populations with a high probability of BCC scheduled for further treatment requiring a tissue diagnosis.
- 4 December 2018
- Published by Wiley in Cochrane Database of Systematic Reviews
- Vol. 2018 (12) , CD013187
Exfoliative cytology for diagnosing basal cell carcinoma and other skin cancers in adults
Background Early accurate detection of all skin cancer types is essential to guide appropriate management, reduce morbidity and improve survival. Basal cell carcinoma (BCC) is usually localised to the skin but has potential to infiltrate and damage surrounding tissue, while cutaneous squamous cell carcinoma (cSCC) and melanoma have a much higher potential to metastasise and ultimately lead to death. Exfoliative cytology is a non‐invasive test that uses the Tzanck smear technique to identify disease by examining the structure of cells obtained from scraped samples. This simple procedure is a less invasive diagnostic test than a skin biopsy, and for BCC it has the potential to provide an immediate diagnosis that avoids an additional clinic visit to receive skin biopsy results. This may benefit patients scheduled for either Mohs micrographic surgery or non‐surgical treatments such as radiotherapy. A cytology scrape can never give the same information as a skin biopsy, however, so it is important to better understand in which skin cancer situations it may be helpful. Objectives To determine the diagnostic accuracy of exfoliative cytology for detecting basal cell carcinoma (BCC) in adults, and to compare its accuracy with that of standard diagnostic practice (visual inspection with or without dermoscopy). Secondary objectives were: to determine the diagnostic accuracy of exfoliative cytology for detecting cSCC, invasive melanoma and atypical intraepidermal melanocytic variants, and any other skin cancer; and for each of these secondary conditions to compare the accuracy of exfoliative cytology with visual inspection with or without dermoscopy in direct test comparisons; and to determine the effect of observer experience. Search methods We undertook a comprehensive search of the following databases from inception up to August 2016: Cochrane Central Register of Controlled Trials; MEDLINE; Embase; CINAHL; CPCI; Zetoc; Science Citation Index; US National Institutes of Health Ongoing Trials Register; NIHR Clinical Research Network Portfolio Database; and the World Health Organization International Clinical Trials Registry Platform. We also studied the reference lists of published systematic review articles. Selection criteria Studies evaluating exfoliative cytology in adults with lesions suspicious for BCC, cSCC or melanoma, compared with a reference standard of histological confirmation. Data collection and analysis Two review authors independently extracted all data using a standardised data extraction and quality assessment form (based on QUADAS‐2). Where possible we estimated summary sensitivities and specificities using the bivariate hierarchical model. Main results We synthesised the results of nine studies contributing a total of 1655 lesions to our analysis, including 1120 BCCs (14 datasets), 41 cSCCs (amongst 401 lesions in 2 datasets), and 10 melanomas (amongst 200 lesions in 1 dataset). Three of these datasets (one each for BCC, melanoma and any malignant condition) were derived from one study that also performed a direct comparison with dermoscopy. Studies were of moderate to poor quality, providing inadequate descriptions of participant selection, thresholds used to make cytological and histological diagnoses, and blinding. Reporting of participants' prior referral pathways was particularly poor, as were descriptions of the cytodiagnostic criteria used to make diagnoses. No studies evaluated the use of exfoliative cytology as a primary diagnostic test for detecting BCC or other skin cancers in lesions suspicious for skin cancer. Pooled data from seven studies using standard cytomorphological criteria (but various stain methods) to detect BCC in participants with a high clinical suspicion of BCC estimated the sensitivity and specificity of exfoliative cytology as 97.5% (95% CI 94.5% to 98.9%) and 90.1% (95% CI 81.1% to 95.1%). respectively. When applied to a hypothetical population of 1000 clinically suspected BCC lesions with a median observed BCC prevalence of 86%, exfoliative cytology would miss 21 BCCs and would lead to 14 false positive diagnoses of BCC. No false positive cases were histologically confirmed to be melanoma. Insufficient data are available to make summary statements regarding the accuracy of exfoliative cytology to detect melanoma or cSCC, or its accuracy compared to dermoscopy. Authors' conclusions The utility of exfoliative cytology for the primary diagnosis of skin cancer is unknown, as all included studies focused on the use of this technique for confirming strongly suspected clinical diagnoses. For the confirmation of BCC in lesions with a high clinical suspicion, there is evidence of high sensitivity and specificity. Since decisions to treat low‐risk BCCs are unlikely in practice to require diagnostic confirmation given that clinical suspicion is already high, exfoliative cytology might be most useful for cases of BCC where the treatments being contemplated require a tissue diagnosis (e.g. radiotherapy). The small number of included studies, poor reporting and varying methodological quality prevent us from drawing strong conclusions to guide clinical practice. Despite insufficient data on the use of cytology for cSCC or melanoma, it is unlikely that cytology would be useful in these scenarios since preservation of the architecture of the whole lesion that would be available from a biopsy provides crucial diagnostic information. Given the paucity of good quality data, appropriately designed prospective comparative studies may be required to evaluate both the diagnostic value of exfoliative cytology by comparison to dermoscopy, and its confirmatory value in adequately reported populations with a high probability of BCC scheduled for further treatment requiring a tissue diagnosis.