Abstract
The tremendous development of animated multimedia (AM) utilization is attributed to major advancements in computer graphics, education, gaming, and immersive perceptual technologies like augmented and virtual realities. However, neither the perceptual quality nor mathematical assessments of AM content have kept pace with the rapid growth of the content, and standard AM datasets are also quite limited. This work addresses the aforementioned shortcomings by developing a new AM video dataset with a large subjective study. The proposed study is comprehensive in terms of a variety of video content, distortion types, test stimuli count, and human rating computation. Specifically, the dataset consists of 15 pristine videos that cover a wide range of spatial and motion information, and these videos are subjected to five commonly occurring distortions, including H.264 and H.265 compressions, blur, frame freeze, and frame hanging distortions. We generate a total of 375 distorted test stimuli by applying five perceptual levels of each distortion type to the reference videos. Further, 30 participants were involved in our human-assessed study, and finally, mean opinion scores were calculated based on the subjective scores. As a part of mathematical analysis, several well-known image and video quality assessment algorithms were evaluated on the dataset, and their performances are reported in terms of correlation coefficient and error values. Based on the proposed human-assessed study and mathematical analysis, we conclude that the existing objective quality assessment models do not perform well on the AM.

This publication has 21 references indexed in Scilit: