SubstationAI: Multimodal Large Model-Based Approaches for Analyzing Substation Equipment Faults
Authors:
Preprint
Abstract
The reliability of substation equipment is crucial to the stability of power systems, but traditional fault analysis methods heavily rely on manual expertise, limiting their effectiveness in handling complex and large-scale data. This paper proposes a substation equipment fault analysis method based on a multimodal large language model (MLLM). We developed a database containing 40,000 entries, including images, defect labels, and analysis reports, and used an image-to-video generation model for data augmentation. Detailed fault analysis reports were generated using GPT-4. Based on this database, we developed SubstationAI, the first model dedicated to substation fault analysis, and designed a fault diagnosis knowledge base along with knowledge enhancement methods. Experimental results show that SubstationAI significantly outperforms existing models, such as GPT-4, across various evaluation metrics, demonstrating higher accuracy and practicality in fault cause analysis, repair suggestions, and preventive measures, providing a more advanced solution for substation equipment fault analysis.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Zero-Shot Visual Reasoning by Vision-Language Models: Benchmarking and Analysis2024
- Improved Baselines with Visual Instruction Tuning2024
- HuatuoGPT, Towards Taming Language Model to Be a Doctor2023
- Intelligent detection method for substation insulator defects based on CenterMaskFrontiers in Energy Research, 2022
- High-Resolution Image Synthesis with Latent Diffusion Models2022
- A review of comprehensiveness, user-friendliness, and contribution for sustainable design of whole building environmental life cycle assessment software toolsBuilding and Environment, 2022
- ERNIE-ViL: Knowledge Enhanced Vision-Language Representations through Scene GraphsProceedings of the AAAI Conference on Artificial Intelligence, 2021
- LXMERT: Learning Cross-Modality Encoder Representations from Transformers2019
- Evaluating professionalism in medical undergraduates using selected response questions: findings from an item response modelling studyBMC Medical Education, 2011