Pujana Paliyawan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Pujana Paliyawan has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Ruck Thawonmas
Ritsumeikan University
12 shared publications Takahiro Kusano
Intelligent Computer Entertainment Lab., Graduate School of Information Science and Engineering, Ritsumeikan University, Japan
5 shared publications- Tomohiro Harada
Saitama University, Saitama, Japan
4 shared publications Ruck Thawonmas
Ritsumeikan University
3 shared publicationsWorawat Choensawat
Multimedia Intelligent Technology Lab, Bangkok University, Thailand
3 shared publications- Kingkarn Sookhanaphibarn
Center of Specialty Innovation, Bangkok University, Pathum Thani 12120, Thailand
2 shared publications
Latest Publications
- Open Access
Webcam-Based Exergame for Motor Recovery with Physical Assessment via DTW
This paper presents RehabHub, a home-based exergaming system that integrates standardized physical assessment directly into gameplay by using a common webcam and MediaPipe for real-time pose estimation. The system quantifies upper-limb movement quality, specifically abduction, shoulder flexion, and elbow flexion based on FMA-UE guidelines, by applying Dynamic Time Warping (DTW) together with a Z-score-based scoring model that relies on data from non-clinical adult participants. A pilot study, which included movements simulated with a 5-kg resistance band, evaluated three feature-extraction methods. The findings indicate that the single-angle method provides the clearest distinction between normal and abnormal movements, particularly for abduction and elbow flexion. In the case of shoulder flexion, the score separation was less distinct because of movement variability and posture-related angle fluctuations, which suggests that further refinement of feature design is needed. The cloud-based platform supports remote monitoring and gives caregivers access to both performance scores and recorded exercise videos. Overall, the results demonstrate the feasibility of a low-cost webcam-based assessment integrated into exergaming, and they highlight important trends for improving abnormal-movement detection in home rehabilitation systems.
Open AccessWebcam-Based Exergame for Motor Recovery with Physical Assessment via DTW
This paper presents RehabHub, a home-based exergaming system that integrates standardized physical assessment directly into gameplay by using a common webcam and MediaPipe for real-time pose estimation. The system quantifies upper-limb movement quality, specifically abduction, shoulder flexion, and elbow flexion based on FMA-UE guidelines, by applying Dynamic Time Warping (DTW) together with a Z-score-based scoring model that relies on data from non-clinical adult participants. A pilot study, which included movements simulated with a 5-kg resistance band, evaluated three feature-extraction methods. The findings indicate that the single-angle method provides the clearest distinction between normal and abnormal movements, particularly for abduction and elbow flexion. In the case of shoulder flexion, the score separation was less distinct because of movement variability and posture-related angle fluctuations, which suggests that further refinement of feature design is needed. The cloud-based platform supports remote monitoring and gives caregivers access to both performance scores and recorded exercise videos. Overall, the results demonstrate the feasibility of a low-cost webcam-based assessment integrated into exergaming, and they highlight important trends for improving abnormal-movement detection in home rehabilitation systems.
- Open Access
Audience participation fighting game: Exploring social facilitation for an enhanced APG experience
- Open Access
- 21 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 44608-44616
Improving Deep-Feature Image Similarity Calculation: A Case Study on an Ukiyo-e Card Matching Game Lottery
The purpose of this study is to improve AI players in Lottery. Lottery is a card matching game designed based on the concept of Audience Participation Game With a Purpose. Namely, it lets live streaming game audiences take part in gameplay and collects image similarity data perceived by these audiences. The game employs two AI players that initially calculate image similarities based on deep features (deep-feature similarities). In our previous study, it was found that similarities, between a certain pair of images, perceived by machines or computers – calculated based on deep features – were different from similarities perceived by humans. This would make gameplay by the AI players unbelievable, in other words, non-human-like. This study, therefore, proposes to use a linear model, built based on pre-collected human data, for improving the deep-feature similarities. The amount of human data required to make the model stable is also discussed. Experimental results show that the linear model only requires small quantities of human data to greatly improve the deep-feature similarities. At the same time, our results also show that the game Lottery is indispensable. This is because the linear model can only make the calculated similarity closer to that of humans, but there is still discernible difference; in order to obtain accurate similarity between images, it is necessary to collect a certain amount of human-perceived similarity data.
- 21 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 44608-44616
Open AccessImproving Deep-Feature Image Similarity Calculation: A Case Study on an Ukiyo-e Card Matching Game Lottery
The purpose of this study is to improve AI players in Lottery. Lottery is a card matching game designed based on the concept of Audience Participation Game With a Purpose. Namely, it lets live streaming game audiences take part in gameplay and collects image similarity data perceived by these audiences. The game employs two AI players that initially calculate image similarities based on deep features (deep-feature similarities). In our previous study, it was found that similarities, between a certain pair of images, perceived by machines or computers – calculated based on deep features – were different from similarities perceived by humans. This would make gameplay by the AI players unbelievable, in other words, non-human-like. This study, therefore, proposes to use a linear model, built based on pre-collected human data, for improving the deep-feature similarities. The amount of human data required to make the model stable is also discussed. Experimental results show that the linear model only requires small quantities of human data to greatly improve the deep-feature similarities. At the same time, our results also show that the game Lottery is indispensable. This is because the linear model can only make the calculated similarity closer to that of humans, but there is still discernible difference; in order to obtain accurate similarity between images, it is necessary to collect a certain amount of human-perceived similarity data.
- Open Access
- 23 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Audience Participation Fighting Game: making an APG using a concept of social facilitation
This paper presents architecture and design of a Twitch-based audience participation fighting game, where the strengths of game AI characters are dynamically adjusted based on audience cheering and jeering. Limitations underlying existing audience participation games (APGs) are discussed, and followed by solutions as demonstrated in our game. Our study includes AI tests on 500000 one-minute game rounds and a user experiment with 82 participants. We investigated user experience (UX), comparing two different kinds of gameplays (collaborative vs competitive), as well as two different kinds of interaction (cheering vs jeering). A pairwise preference, four-alternative forced choice (4-AFC), version of the Game User Experience Satisfaction Scale (GUESS) is used for UX assessment. At the end, we provided guidelines and hypotheses for future APG research.
- 23 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in TechRxiv
Open AccessAudience Participation Fighting Game: making an APG using a concept of social facilitation
This paper presents architecture and design of a Twitch-based audience participation fighting game, where the strengths of game AI characters are dynamically adjusted based on audience cheering and jeering. Limitations underlying existing audience participation games (APGs) are discussed, and followed by solutions as demonstrated in our game. Our study includes AI tests on 500000 one-minute game rounds and a user experiment with 82 participants. We investigated user experience (UX), comparing two different kinds of gameplays (collaborative vs competitive), as well as two different kinds of interaction (cheering vs jeering). A pairwise preference, four-alternative forced choice (4-AFC), version of the Game User Experience Satisfaction Scale (GUESS) is used for UX assessment. At the end, we provided guidelines and hypotheses for future APG research.
- Open Access
Toward a Minecraft Mod for Early Detection of Alzheimer's Disease in Young Adults
This paper proposes a Minecraft-based system for early detection of Alzheimer's disease in young adults. Early detection, where spatial navigation is a crucial key, is regarded as an important way to prevent the disease. The proposed system is compared with a recent existing and thoroughly studied system using a game called Sea Hero Quest (SHQ), by analyzing spatial navigational patterns of players. Our preliminary results show that spatial navigational patterns in both systems are highly correlated, indicating that the proposed system is likely as effective as the SHQ system for the detection task.
Open AccessToward a Minecraft Mod for Early Detection of Alzheimer's Disease in Young Adults
This paper proposes a Minecraft-based system for early detection of Alzheimer's disease in young adults. Early detection, where spatial navigation is a crucial key, is regarded as an important way to prevent the disease. The proposed system is compared with a recent existing and thoroughly studied system using a game called Sea Hero Quest (SHQ), by analyzing spatial navigational patterns of players. Our preliminary results show that spatial navigational patterns in both systems are highly correlated, indicating that the proposed system is likely as effective as the SHQ system for the detection task.
- Open Access
- 13 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 8103-8111
A Card Game for Collecting Human-Perceived Similarity Data of Artwork Images
In this paper, we propose a card game system named “Lottery” for collecting similarity data of artwork images. It is built based on the concept of game design called “Audience Participation Game With a Purpose (APGWAP),” which is to outsource computational steps in a given task to humans via a game that allows audiences to participate in a meaningful way. The game system is streamed on Twitch. In this game system, two Artificial Intelligence (AI) players match two cards that are most similar from a set of cards in their turn and discard them. The audiences can choose their roles between Assistant and Jury. Assistant helps the AI player of a given turn choose such a pair of cards, while Jury gives a score telling how similar a chosen pair is. In the experiments, different methods for providing rewards to audiences are investigated: equal reward, random reward, and performance-based reward. Experimental results show that the performance-based reward significantly promotes personal gratification and provides a better gaming experience on several other factors. In addition, it was found in our experiment that different groups of humans provided similar similarity scores for all the pairs of images, indicating that collecting promises reliable human data that are consistent through several trials is possible using our game system.
- 13 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 8103-8111
Open AccessA Card Game for Collecting Human-Perceived Similarity Data of Artwork Images
In this paper, we propose a card game system named “Lottery” for collecting similarity data of artwork images. It is built based on the concept of game design called “Audience Participation Game With a Purpose (APGWAP),” which is to outsource computational steps in a given task to humans via a game that allows audiences to participate in a meaningful way. The game system is streamed on Twitch. In this game system, two Artificial Intelligence (AI) players match two cards that are most similar from a set of cards in their turn and discard them. The audiences can choose their roles between Assistant and Jury. Assistant helps the AI player of a given turn choose such a pair of cards, while Jury gives a score telling how similar a chosen pair is. In the experiments, different methods for providing rewards to audiences are investigated: equal reward, random reward, and performance-based reward. Experimental results show that the performance-based reward significantly promotes personal gratification and provides a better gaming experience on several other factors. In addition, it was found in our experiment that different groups of humans provided similar similarity scores for all the pairs of images, indicating that collecting promises reliable human data that are consistent through several trials is possible using our game system.
- Open Access
- 30 December 2021
- Published by Society for Art and Science in The Journal of the Society for Art and Science
- Vol. 20 (5) , 254-263
Toward Early Detection of Alzheimer's Disease Using a Minecraft Mod
本論文ではMinecraftを用いてのアルツハイマー型認知症(AD)を早期発見するためのシステムを提案し,先行研究より開発されたSea Hero Questと比較することでその有用性を評価した.近年,認知症は世界的に社会問題とされている.早ければ未成年の頃より発症すると言われている若年性アルツハイマー症も同様で,これら認知症は早期発見が重要視されている.また,空間ナビゲーションはADを早期発見するために重要な項目とされており,これはゲームにおける移動距離として考えることができる.今回比較対象とした既存のゲームは既にリリースが停止しており,独自ゲームのため普及可能性が低いという問題点がある.そこで,本論文ではMinecraftを用いてこの問題点を解決することができる新たなシステムを構築し,両ゲームのプレイ履歴相関分析およびユーザ評価を行うことで,提案システムにおけるAD早期発見の有用性を確認することができた.
- 30 December 2021
- Published by Society for Art and Science in The Journal of the Society for Art and Science
- Vol. 20 (5) , 254-263
Open AccessToward Early Detection of Alzheimer's Disease Using a Minecraft Mod
本論文ではMinecraftを用いてのアルツハイマー型認知症(AD)を早期発見するためのシステムを提案し,先行研究より開発されたSea Hero Questと比較することでその有用性を評価した.近年,認知症は世界的に社会問題とされている.早ければ未成年の頃より発症すると言われている若年性アルツハイマー症も同様で,これら認知症は早期発見が重要視されている.また,空間ナビゲーションはADを早期発見するために重要な項目とされており,これはゲームにおける移動距離として考えることができる.今回比較対象とした既存のゲームは既にリリースが停止しており,独自ゲームのため普及可能性が低いという問題点がある.そこで,本論文ではMinecraftを用いてこの問題点を解決することができる新たなシステムを構築し,両ゲームのプレイ履歴相関分析およびユーザ評価を行うことで,提案システムにおけるAD早期発見の有用性を確認することができた.
- 13 October 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 564-565
Enhancement of Angry Birds Level Generation from Sketches Using Cycle-Consistent Adversarial Networks
This paper presents our work to enhance a state-of-the-art level generator (Sketch-to-Level Generator) that generates levels for an Angry-Birds-like game from drawn sketches. To achieve this task, Cycle-Consistent Adversarial Networks (Cycle-GAN) are used. CycleGAN is trained using two datasets: sketch drawings and typical level-structures. The former are taken from Google’s Quick, Draw! datasets, and the latter from the winning level generator at the 2017 and 2018 AIBIRDS level generation competitions. The output of the trained CycleGAN is used as the input of Sketch-to-Level Generator. Our results show that the proposed preprocessing technique using CycleGAN allows Sketch-to-Level Generator to more successfully generate levels from arbitrary sketch drawings.
- 13 October 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 564-565
Enhancement of Angry Birds Level Generation from Sketches Using Cycle-Consistent Adversarial Networks
This paper presents our work to enhance a state-of-the-art level generator (Sketch-to-Level Generator) that generates levels for an Angry-Birds-like game from drawn sketches. To achieve this task, Cycle-Consistent Adversarial Networks (Cycle-GAN) are used. CycleGAN is trained using two datasets: sketch drawings and typical level-structures. The former are taken from Google’s Quick, Draw! datasets, and the latter from the winning level generator at the 2017 and 2018 AIBIRDS level generation competitions. The output of the trained CycleGAN is used as the input of Sketch-to-Level Generator. Our results show that the proposed preprocessing technique using CycleGAN allows Sketch-to-Level Generator to more successfully generate levels from arbitrary sketch drawings.
- Open Access
- 21 December 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 7977-7988
Motion Recommender for Preventing Injuries During Motion Gaming
This paper presents an intelligent assistant for preventing injuries during motion gaming. In our previous work, we invented UKI, a middleware that allows its users to play any existing games by using body motions. The goal of this paper is to add an intelligent module to UKI for promoting healthy motion gameplay. According to the literature in sports science and medicine, several exercise injuries are caused by unbalanced use of body segments and repetitive movement. To prevent such injuries, we present a module that monitors and promotes two health metrics of the player: balancedness in use of body segments and variability in body movement. The proposed module recommends motions that will improve the two health metric during gameplay. We evaluate effectiveness of the module on 45 participants with normal health condition. Two methods for motion recommendation were compared: recommendation according to health fitness functions (HFF) and recommendation by random motion selection (RMS). Our results indicate significant improvement in the two health metrics when HFF is used.
- 21 December 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 7977-7988
Open AccessMotion Recommender for Preventing Injuries During Motion Gaming
This paper presents an intelligent assistant for preventing injuries during motion gaming. In our previous work, we invented UKI, a middleware that allows its users to play any existing games by using body motions. The goal of this paper is to add an intelligent module to UKI for promoting healthy motion gameplay. According to the literature in sports science and medicine, several exercise injuries are caused by unbalanced use of body segments and repetitive movement. To prevent such injuries, we present a module that monitors and promotes two health metrics of the player: balancedness in use of body segments and variability in body movement. The proposed module recommends motions that will improve the two health metric during gameplay. We evaluate effectiveness of the module on 45 participants with normal health condition. Two methods for motion recommendation were compared: recommendation according to health fitness functions (HFF) and recommendation by random motion selection (RMS). Our results indicate significant improvement in the two health metrics when HFF is used.
- 1 June 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 80
Smile with Angry Birds: Two Smile-Interface Implementations
This paper proposes two implementations for promoting mental well-being in Angry Birds, one of the most popular mobile games. In the first implementation, fog is introduced for hiding some parts of the game stage, and the player must smile in order to erase fog. In the second implementation, a special TNT is introduced, which can be exploded by the player's smile. We evaluate each of the two implementations by analyzing effects on the player's mental status and game satisfaction.
- 1 June 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 80
Smile with Angry Birds: Two Smile-Interface Implementations
This paper proposes two implementations for promoting mental well-being in Angry Birds, one of the most popular mobile games. In the first implementation, fog is introduced for hiding some parts of the game stage, and the player must smile in order to erase fog. In the second implementation, a special TNT is introduced, which can be exploded by the player's smile. We evaluate each of the two implementations by analyzing effects on the player's mental status and game satisfaction.