Vision Language Models for Novel Art Therapy Evaluation in Schizophrenia
Open Access
- 21 November 2025
- book chapter
- Published by The Association for Computers and the Humanities
- Vol. 3, 327-338
Abstract
Traditional methodologies for evaluating visual artistic output in art therapy remain rare and time-intensive, creating barriers to systematic assessment of therapeutic progress. This study presents the first application of multimodal dense embeddings for longitudinal evaluation of art therapy outcomes in individuals with schizophrenia. We analyzed 168 art therapy images produced by 14 participants with schizophrenia using CLIP (Contrastive Language-Image Pretraining) embeddings. CLIP embeddings successfully captured meaningful semantic patterns, with real images showing significantly greater semantic dispersion than spatially randomized controls. Longitudinal analysis revealed progressive semantic diversification over time, with significant increases in semantic distance between consecutive images (β = 0.284, p = 0.001) and cumulative semantic drift from first images (β = 0.336, p < 0.001). Individual differences analysis showed high variability in volume metrics spanning several orders of magnitude (M = 1.13 × 10¹¹, SD = 2.05 × 10¹¹), indicating highly individual semantic exploration patterns. Vision language models provide a novel and objective methodology for evaluating the progression of art therapy that reveals systematic patterns of semantic evolution during treatment. The progressive semantic diversification observed suggests that art therapy facilitates expanding creative expression and psychological exploration over time. The substantial individual differences in semantic exploration patterns indicate potential for personalized treatment approaches based on creative trajectory analysis. This methodology offers promising applications for systematic art therapy assessment, treatment monitoring, and personalized intervention strategies in clinical practice.Keywords
This publication has 18 references indexed in Scilit:
- The AI-Therapist Duo: Exploring the Potential of Human-AI Collaboration in Personalized Art Therapy for PICS InterventionInternational Journal of Human–Computer Interaction, 2025
- Active Visual Art Therapy and Health OutcomesJAMA Network Open, 2024
- A meta-analysis of the effectiveness of group art therapy for children and adolescents of multicultural families: A focus on KoreaChildren and Youth Services Review, 2024
- Exploring artificial intelligence approach to art therapy assessment: A case study on the classification and the estimation of psychological state based on a drawingNew Ideas in Psychology, 2024
- DeepThInk: Designing and probing human-AI co-creation in digital art therapyInternational Journal of Human-Computer Studies, 2023
- Measuring art: Methodical development of a quantitative rating instrument measuring pictorial expression (RizbA)The Arts in Psychotherapy, 2017
- Art therapy for people with psychosis: a narrative review of the literatureThe Lancet Psychiatry, 2016
- Reliabilität und Validität des Instruments „DoKuPro – Dokumentation Kunsttherapeutischer Prozesse”Musik-, Tanz- und Kunsttherapie, 2009
- The Descriptive Assessment for Psychiatric ArtJournal of Nervous & Mental Disease, 1996
- The diagnostic drawing series: A systematic approach to art therapy evaluation and researchThe Arts in Psychotherapy, 1988