PTPedro Batista Tan

Pedro Batista Tan

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Pedro Batista Tan has a total of 280 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Challenges for building up confirmatory science in lab biology: lessons learned from the Brazilian Reproducibility Initiative

    by Olavo Bohrer Amaral, Bruna Valério, Clarissa França Dias Carneiro, Gabriel Paz Souza Mota, Kleber Neves, Mariana Abreu, Pedro Batista Tan

    The Brazilian Reproducibility Initiative was a nationwide systematic replication project to assess the replicability of biomedical experiments published by Brazilian research groups. Beyond its results, the Initiative offered a privileged window to observe academic labs performing replications with a confirmatory mindset that is not usual for most researchers in the life sciences. In this article, we outline the main challenges met by the Initiative’s coordinating team, both in terms of implementing confirmatory methods in lab biology and of running large-scale collaborations within an academic environment. Our conclusions suggest steps that can be undertaken by multiple actors, from individual researchers to policymakers, in order to improve the replicability of biomedical research.

  • Open Access

    Neoadjuvant immunotherapy in mismatch-repair-proficient colon cancers

    by Pedro B. Tan, Yara L. Verschoor, José G. van Den Berg, Sara Balduzzi, Niels F. M. Kok, Marieke E. Ijsselsteijn, Kat Moore, Adham Jurdi, Antony Tin, Paulien Kaptein, et al.

    Immune checkpoint blockade has led to paradigm shifts in the treatment of various tumour types 1–4 , yet limited efficacy has been observed in patients with metastatic mismatch-repair-proficient (pMMR) colorectal cancer 5 . Here we report clinical results and in-depth analysis of patients with early-stage pMMR colon cancer from the phase II NICHE study (ClinicalTrials.gov: NCT03026140). A total of 31 patients received neoadjuvant treatment of nivolumab plus ipilimumab followed by surgery. The response rate was 26% and included six patients with a major pathological response (10% or less residual viable tumour). One patient with an ongoing clinical complete response did not undergo surgery. Circulating tumour DNA was positive in 26 of 31 patients at baseline, and clearance was observed in 5 of 6 responders before surgery, whereas 19 of 20 non-responders remained circulating tumour DNA positive. Responses were observed despite a low tumour mutational burden in all tumours, whereas chromosomal genomic instability scores were significantly higher in responders than in non-responders. Furthermore, responding tumours had significantly higher baseline expression of proliferation signatures and TCF1, and imaging mass cytometry revealed a higher percentage of Ki-67 + cancer and Ki-67 + CD8 + T cells in responders than in non-responders. These results provide a comprehensive analysis of response to neoadjuvant immune checkpoint blockade in early-stage pMMR colon cancers and identify potential biomarkers for patient selection.


  • Open Access

    A metric of knowledge as information compression reflects reproducibility predictions for biomedical experiments

    by Daniele Fanelli, Pedro Batista Tan, Olavo B. Amaral, Kleber Neves

    Forecasting the reproducibility of research findings is one of the key challenges of metascience. Above-chance predictions have mainly been achieved by pooling the subjective ratings of experts, and how these predictions are formed remains to be understood. Here, we show that reproducibility forecasts made for the Brazilian Reproducibility Initiative (BRI), a large-scale replication of experiments in the life sciences, are significantly correlated with K , a principled metric of knowledge as information compression. For each study in the BRI sample, we calculated K by dividing the effect size, measured in bits of Shannon entropy, by the descriptive length (a proxy of the complexity) of the study’s methodology, calculated as the optimal Shannon encoding of a conceptual graph representing the replication protocol. We found that experts’ predictions about reproducibility were statistically associated with K values and with the complexity of protocols. This relation was robust to controlling for study methodology and other possible confounding factors. These results suggest that expert raters partially judge the reproducibility of findings by assessing the ratio between the information yielded and the information required by a study, and they support the hypothesis that scientific knowledge may be understood and studied through the lenses of information compression.


  • Open Access

    Estimating the replicability of Brazilian biomedical science

    by The Brazilian Reproducibility Initiative, Olavo Bohrer Amaral, Clarissa França Dias Carneiro, Kleber Neves, Ana Paula Wasilewska Sampaio, Bruna Valério Gomes, Mariana Boechat de Abreu, Pedro Batista Tan, Gabriel Paz Souza Mota, Ricardo Netto Goulart, et al.

    Concerns over the replicability and reproducibility of published research have grown in many research fields, but empirical data to inform policies are still scarce. Biomedical research in Brazil expanded rapidly over the last three decades, with no systematic assessment of the replicability of its findings. With this in mind, we set up the Brazilian Reproducibility Initiative, a multicenter replication of published experiments from Brazilian science using three common experimental methods: the MTT assay, the reverse transcription polymerase chain reaction (RT-PCR) and the elevated plus maze (EPM). A total of 56 laboratories performed 143 replications of 56 experiments; of these, 90 replications of 45 experiments were considered valid by an independent committee. Replication rates for these experiments varied between 20 and 44% according to five predefined criteria. In median terms, ratios between group means were 58% lower in replications than in original experiments, while coefficients of variation were 82% higher. Effect size decrease was smaller for MTT experiments, original results with less variability and those considered more challenging to replicate, while t values for replications were positively correlated with researcher predictions about replicability, and negatively correlated with the rate of publications by the original article’s last author. Deviations from preregistered protocols were very common in replications, most frequently due to reasons inherent to the experimental model or related to infrastructure and logistics. Our results highlight factors that limit the replicability of results published by researchers in Brazil and suggest ways by which this scenario can be improved.


  • Open Access

    Mapping the content of comments on bioRxiv and medRxiv preprints

    by Clarissa F. D. Carneiro, Gabriel Costa, Kleber Neves, Mariana B. Abreu, Pedro B. Tan, Danielle Rayêe, Flávia Boos, Roberta Andrejew, Tiago Lubiana, Mario Malički, et al.

    Introduction: Preprints have been increasingly used in biomedical sciences, providing the opportunity for research to be publicly assessed before journal publication. With the increase in attention over preprints during the COVID-19 pandemic, we decided to assess the content of comments left on preprint platforms. Methods: Preprints posted on bioRxiv and medRxiv in 2020 were accessed through each platform’s API, and a random sample of preprints that had received between 1 and 20 comments was analyzed. Comments were evaluated in triplicate by independent evaluators using an instrument that assessed their features and general content. Results: 7.3% of preprints received at least 1 comment during a mean follow-up of 7.5 months. Analyzed comments had a median size of 43 words. Criticisms, corrections or suggestions were the most prevalent type of content, followed by compliments or positive appraisals and questions. Most critical comments regarded interpretation, data collection and methodological design, while compliments were usually about relevance and implications. Conclusions: Only a small percentage of preprints posted in 2020 in bioRxiv and medRxiv received comments in these platforms. When present, however, these comments address content that is similar to that analyzed by traditional peer review. A more precise taxonomy of peer review functions would be desirable to describe whether post-publication peer review fulfills these roles.


  • Open Access

    NBS Hack Week: Pilot study on ARRIVE guidelines E10 compliance

    by Juliane Cristina Ribeiro Fernandes, Cássio Morais Loss, Karina Lobo Hajdu, Régia Caroline Peixoto Lira Fusco, Pedro Batista Tan

    The ARRIVE (Animal Research: Reporting of In Vivo Experiments) guidelines are reportingguidelines designed to improve transparency and facilitate critical assessment ofexperiments involving animal research. Although it represents essential reportinginformation for animal experiments, compliance with ARRIVE items is not commonlydemanded by journals and is often lacking in animal studies. In this small pilot project, weevaluated compliance with ARRIVE 2.0 essential 10 items in 64 papers from 2018 and 2020,either citing or not the ARRIVE manuscripts. Papers that cited the ARRIVE guidelines hadslightly higher reporting scores, but we did not detect an effect of the time period nor aninteraction effect between ARRIVE versions 1.0 and 2.0. This work was conducted during theNo-Budget Science Hack Week 2021 event, an extended hackathon to discuss and developprojects in metascience. In future work, this pilot can be expanded to better estimate theeffects of the ARRIVE guidelines on reporting practices.

  • Open Access

    A metric of knowledge as information compression reflects reproducibility predictions in biomedical experiments

    by Daniele Fanelli, Pedro Batista Tan, Olavo Bohrer Amaral, Kleber Neves

    Forecasting the reproducibility of research findings is one of the key challenges of Metascience. To date, reliable above-chance predictions have mainly been achieved by pooling the subjective ratings of experts through surveys or via prediction markets. Obtaining such data is laborious, however, and unlikely to increase the theoretical understanding of reproducibility.Here we show that empirical measures of K, a principled metric of knowledge, are correlated with reproducibility forecasts made for the Brazilian Reproducibility Initiative (BRI), an ongoing replication of 60 studies that use three common methodologies in the life sciences. For each study, we calculated the K value by dividing the effect size, measured in bits of Shannon entropy explained, by the descriptive complexity of the study’s methodology, calculated as the optimal Shannon encoding of a conceptual graph representing the replication protocol.K values were statistically associated with subjective predictions about studies’ replication probabilities and relative effect sizes. This relation was robust to controlling for study methodology, and was a stronger predictor than other plausible covariates, including the originally reported effect size, subjective ratings of a study’s methodological difficulty, and raters’ self-reported expertise. The superior fit of K may be due to its particular structure and metrics, which are rooted in information theory and may more accurately reflect the implicit calculations made by raters.This is the first evidence that an objective metric hypothesized to quantify scientific knowledge captures subjective judgments about reproducibility. This finding gives the first independent support of K’s underlying assumption that scientific knowledge is a process of information compression, and it may offer a new tool for metaresearch.


  • Open Access

    Are Most Published Research Findings False In A Continuous Universe?

    by Kleber Neves, Pedro Batista Tan, Olavo Bohrer Amaral

    Diagnostic screening models for the interpretation of null hypothesis significance test (NHST) results have been influential in highlighting the effect of selective publication on the reproducibility of the published literature, leading to John Ioannidis’ much-cited claim that most published research findings are false. These models, however, are typically based on the assumption that hypotheses are dichotomously true or false, without considering that effect sizes for different hypotheses are not the same. To address this limitation, we develop a simulation model that overcomes this by modeling effect sizes explicitly using different continuous distributions, while retaining other aspects of previous models such as publication bias and the pursuit of statistical significance. Our results show that the combination of selective publication, bias, low statistical power and unlikely hypotheses consistently leads to high proportions of false positives, irrespective of the effect size distribution assumed. Using continuous effect sizes also allows us to evaluate the degree of effect size overestimation and prevalence of estimates with the wrong signal in the literature, showing that the same factors that drive false-positive results also lead to errors in estimating effect size direction and magnitude. Nevertheless, the relative influence of these factors on different metrics varies depending on the distribution assumed for effect sizes. The model is made available as an R ShinyApp interface, allowing one to explore features of the literature in various scenarios.

  • Open Access

    Are Most Published Research Findings False In A Continuous Universe?

    by Kleber Neves, Pedro Batista Tan, Olavo Bohrer Amaral

    Diagnostic screening models for the interpretation of null hypothesis significance test (NHST) results have been influential in highlighting the effect of selective publication on the reproducibility of the published literature, leading to John Ioannidis’ much-cited claim that most published research findings are false. These models, however, are typically based on the assumption that hypotheses are dichotomously true or false, without considering that effect sizes for different hypotheses are not the same. To address this limitation, we develop a simulation model that overcomes this by modeling effect sizes explicitly using different continuous distributions, while retaining other aspects of previous models such as publication bias and the pursuit of statistical significance. Our results show that the combination of selective publication, bias, low statistical power and unlikely hypotheses consistently leads to high proportions of false positives, irrespective of the effect size distribution assumed. Using continuous effect sizes also allows us to evaluate the degree of effect size overestimation and prevalence of estimates with the wrong signal in the literature, showing that the same factors that drive false-positive results also lead to errors in estimating effect size direction and magnitude. Nevertheless, the relative influence of these factors on different metrics varies depending on the distribution assumed for effect sizes. The model is made available as an R ShinyApp interface, allowing one to explore features of the literature in various scenarios.

  • Top Cited Papers
    Open Access

    Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature

    by Clarissa F. D. Carneiro, Victor G. S. Queiroz, Thiago C. Moulin, Carlos A. M. Carvalho, Clarissa B. Haas, Danielle Rayêe, David E. Henshall, Evandro A. De-Souza, Felippe E. Amorim, Flávia Z. Boos, et al.

    Background: Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. Methods: In this observational study, we initially compared independent samples of articles published in bioRxiv and in PubMed-indexed journals in 2016 using a quality of reporting questionnaire. After that, we performed paired comparisons between preprints from bioRxiv to their own peer-reviewed versions in journals. Results: Peer-reviewed articles had, on average, higher quality of reporting than preprints, although the difference was small, with absolute differences of 5.0% [95% CI 1.4, 8.6] and 4.7% [95% CI 2.4, 7.0] of reported items in the independent samples and paired sample comparison, respectively. There were larger differences favoring peer-reviewed articles in subjective ratings of how clearly titles and abstracts presented the main findings and how easy it was to locate relevant reporting information. Changes in reporting from preprints to peer-reviewed versions did not correlate with the impact factor of the publication venue or with the time lag from bioRxiv to journal publication. Conclusions: Our results suggest that, on average, publication in a peer-reviewed journal is associated with improvement in quality of reporting. They also show that quality of reporting in preprints in the life sciences is within a similar range as that of peer-reviewed articles, albeit slightly lower on average, supporting the idea that preprints should be considered valid scientific contributions.