Visual masking at video scene cuts

Authors:

Abstract
We examined the sensitivity of the human visual system to video coding artifacts following a scene cut. Based on classical studies of visual masking, we would expect that sensitivity to coding artifacts would be reduced immediately following a cut. This study focused on the visibility of coding artifacts introduced by an MPEG-2 codec. Three image sequences were selected, each with a scene cut in the middle, such that image content in the first half was different from that in the second half. Using psychophysical methods, visibility threshold were estimated for coding artifacts inserted in the first, second, or third frame following the scene cut. Visibility thresholds were also estimated for coding artifacts that were inserted simultaneously in the first and second frames following the cut. it was found that visual masking effects were present in the first frame following a scene cut, but were virtually absent by the second or the third frame. The results of this research may be used to optimize the behavior of video coding algorithms at scene cuts.