The widespread availability real-world data (RWD) offers valuable insights into cancer treatment, disease management, disease burden, and socio-economic status in routine practice, and thus has the potential to close gaps between the existed evidence and real-world populations. It can enrich and justify the health regulatory and intervention assessment to consider evidence from RWD in a considered and balanced manner. However, even with advanced methodologies to control various biases, many challenges and misunderstandings require resolutions before RWD can be integrated into decision-making. This paper provides an outline of the enormous value of real-world study (RWS) in cancer research, the framework for the use of RWD and the potential pitfalls inherent to using RWD for the comparative effectiveness. RWSs and randomized controlled trials (RCTs) remain complementary forms for evidence in medical researches each other. RWS can be informative, but should be interpreted cautiously. It is not appropriate to adopt new therapies on the basis of RWS in isolation, particularly if there is no evidence of treatment benefit from RCTs. In this situation, claims of effectiveness may probably be misleading and artificial, and thus researchers should be critical of the plausibility of such outcomes. However, systematically incorporating real-world evidence (RWE) into the benefit-risk assessment will ultimately improve patient care and better inform health policy decisions.