YCYu-Hsuan Cheng

Yu-Hsuan Cheng

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Yu-Hsuan Cheng has a total of 8 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    AI-Assisted Materials Characterization: A Curriculum-Guided Multimodal Framework for Transmission Electron Microscopy

    by Chong-Ren Tu, Hung-Wei Hsueh, Wei-Che Chang, You-Ting Lin, Yu-Hsuan Cheng, Wen-Huei Chu, Shih-Wen Tseng, Shu-Han Hsu

    Scientific imaging techniques such as transmission electron microscopy (TEM) offer unparalleled nanoscale insights, but knowledge extraction remains severely limited by the scarcity of structured datasets and the extensive expertise required for interpretation. To overcome this bottleneck, we present an automation-driven framework for multimodal scientific image understanding, demonstrated in TEM as a representative case. Our pipeline integrates automated literature mining, figure segmentation, and GPT-based knowledge distillation to generate 216,448 question–answer pairs across 40,000 TEM images, thereby establishing an end-to-end data collection framework for constructing a large-scale visual question answering (VQA) dataset in this domain. This automated process achieves >1000× acceleration in data curation. To effectively train on this complex data, we introduce a difficulty-aware stratification strategy that organizes samples by intrinsic cognitive complexity rather than task type, mimicking the pedagogical progression of a human expert. The resulting model, TEM-LLM, achieves a 119% relative gain in human-aligned GPT scores and high accuracy in microstructural feature detection. By bridging visual perception and linguistic reasoning, this methodology establishes a scalable foundation for AI-assisted characterization, and accelerated materials discovery.

  • Open Access

    A Lightweight Data-Augmented Deep Learning Framework for Real-Time Instance Segmentation in Liquid-Phase In Situ Transmission Electron Microscopy

    by Ming-Hao Shen, Wei-Che Chang, Wen-Huei Chu, Yu-Hsuan Cheng, Shih-Wen Tseng, Shu-Han Hsu

    Liquid-phase transmission electron microscopy (LPTEM) offers critical insights into the dynamic behaviors of materials, but automated analysis is hindered by the scarcity of annotated data and the high cost of image acquisition. To address these challenges, we propose an LPTEM deep learning framework that (i) closes the annotation gap, (ii) localizes nanoparticles through real-time detection, and (iii) preserves per-pixel detail. Through CycleGAN, we are able to generate a large number of images that are style-consistent with real LPTEM frames, effectively expanding the data set without manual labeling. After augmenting the data set, our fine-tuned YOLOv11n model achieves 97.66% precision and 99.05% mAP50 for detecting nanoparticles, closely approaching the performance of models trained on real data. Three Mobile-UNet variants, optimized for different computational efficiency and accuracy trade-offs, demonstrate instance segmentation for in situ TEM with intersection over union (IoU) scores ranging from 0.8685 to 0.9207 (on a scale where 1.0 indicates perfect overlap with the ground truth), indicating highly accurate particle shapes. Our integrated framework significantly enhances real-time detection and segmentation performance of nanoparticles in LPTEM, with YOLO + Mobile-UNet Slim achieving a real-time processing speed of 102.34 FPS. This framework establishes a scalable, annotation-efficient route to high-precision, real-time LPTEM analysis, opening the door to autonomous in situ experiments and accelerated materials discovery.