High Frame Rates and Human Vision: A View through the Window of Visibility
Author:
- Andrew B. WatsonAWAndrew B. Watson
- 1 March 2013
- journal article
- Published by Society of Motion Picture and Television Engineers (SMPTE) in SMPTE Motion Imaging Journal
- Vol. 122 (2) , 18-32
Abstract
There is new interest in higher frame rates for digital cinema. The frame rate and subsequent processing have a large impact on the presence of artifacts in the final presentation. The structure of these artifacts is revealed by transforming the sequence of frames into the spatiotemporal frequency domain. The visibility of these artifacts can be determined through application of a tool called the window of visibility. This is a simplified representation of human visual sensitivity to spatial and temporal frequencies. This paper describes the capture and display of movies in signal processing terms. It shows how the several steps in the process can by represented in space and time and in spatial and temporal frequency. It then introduces the window of visibility as a simplified version of the human visual contrast sensitivity function. It shows how the tool can be used to compute the lowest artifact-free frame rate under simplified circumstances. It also shows how it can be used to visualize the impact of various steps in processing the image sequence. Finally, the paper describes the influence of luminance, eccentricity, color, and eye movements on the size and shape of the window of visibility. In conclusion, the tool provides a useful aid to understanding the role of human visual sensitivity in the selection of frame rates and frame processing. The paper also provides an interactive demonstration that allows exploration of the trade-offs in movie capture and display.Keywords
This publication has 19 references indexed in Scilit:
- High Frame Rate DistributionSMPTE Motion Imaging Journal, 2012
- Blur clarified: A review and synthesis of blur discriminationJournal of Vision, 2011
- Display motion blur: Comparison of measurement methodsJournal of the Society for Information Display, 2010
- Contrast Sensitivity of the Human Eye and Its Effects on Image Quality1999
- Luminance Effects on Visual Acuity and Small Letter Contrast SensitivityOptometry and Vision Science, 1994
- Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion displaysJournal of the Optical Society of America A, 1986
- Temporal sensitivities related to color theoryJournal of the Optical Society of America A, 1984
- Spatial Modulation Transfer in the Human EyeJournal of the Optical Society of America, 1967
- Research into the Dynamic Nature of the Human Fovea→Cortex Systems with Intermittent and Modulated Light I Attenuation Characteristics with White and Colored LightJournal of the Optical Society of America, 1958
- Optical and Photoelectric Analog of the EyeJournal of the Optical Society of America, 1956