MAMaliha Ashraf

Maliha Ashraf

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Maliha Ashraf has a total of 16 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Supra-threshold Contrast Perception in Augmented Reality

    by Dongyeon Kim, Maliha Ashraf, Alexandre Chapiro, Rafał K. Mantiuk


  • Open Access

    Resolution limit of the eye — how many pixels can we see?

    by Maliha Ashraf, Alexandre Chapiro, Rafał K. Mantiuk

    As large engineering efforts go towards improving the resolution of mobile, augmented reality (AR), and virtual reality (VR) displays, it is important to know the maximum resolution at which further improvements bring no noticeable benefit. This limit is often referred to as the retinal resolution, although the limiting factor may not necessarily be attributed to the retina. To determine the ultimate resolution at which an image appears sharp to our eyes with no perceivable blur, we created an experimental setup with a sliding display, which allows for continuous control of the resolution. The lack of such control was the main limitation of the previous studies. We measure achromatic (black-white) and chromatic (red-green and yellow-violet) resolution limits for foveal vision, and at two eccentricities (10° and 20°). Our results demonstrate that the resolution limit is higher than what was previously believed, reaching 94 pixels per degree (ppd) for foveal achromatic vision, 89 ppd for red-green patterns, and 53 ppd for yellow-violet patterns. We also observe a much larger drop in the resolution limit for chromatic patterns (red-green and yellow-violet) than for achromatic patterns. Our results provide quantitative benchmarks for display development, with implications for future imaging, rendering, and video coding technologies.


  • Open Access

    Resolution limit of the eye: how many pixels can we see?

    by Maliha Ashraf, Alexandre Chapiro, Rafał K. Mantiuk

    As large engineering efforts go towards improving the resolution of mobile, AR and VR displays, it is important to know the maximum resolution at which further improvements bring no noticeable benefit. This limit is often referred to as the "retinal resolution", although the limiting factor may not necessarily be attributed to the retina. To determine the ultimate resolution at which an image appears sharp to our eyes with no perceivable blur, we created an experimental setup with a sliding display, which allows for continuous control of the resolution. The lack of such control was the main limitation of the previous studies. We measure achromatic (black-white) and chromatic (red-green and yellow-violet) resolution limits for foveal vision, and at two eccentricities (10 and 20 deg). Our results demonstrate that the resolution limit is higher than what was previously believed, reaching 94 pixels-per-degree (ppd) for foveal achromatic vision, 89 ppd for red-green patterns, and 53 ppd for yellow-violet patterns. We also observe a much larger drop in the resolution limit for chromatic patterns (red-green and yellow-violet) than for achromatic. Our results set the north star for display development, with implications for future imaging, rendering and video coding technologies.


  • Open Access

    ColorVideoVDP: A visual difference predictor for image, video and display distortions

    by Rafal K. Mantiuk, Param Hanji, Maliha Ashraf, Yuta Asano, Alexandre Chapiro

    ColorVideoVDP is a video and image quality metric that models spatial and temporal aspects of vision for both luminance and color. The metric is built on novel psychophysical models of chromatic spatiotemporal contrast sensitivity and cross-channel contrast masking. It accounts for the viewing conditions, geometric, and photometric characteristics of the display. It was trained to predict common video-streaming distortions (e.g., video compression, rescaling, and transmission errors) and also 8 new distortion types related to AR/VR displays (e.g., light source and waveguide non-uniformities). To address the latter application, we collected our novel XR-Display-Artifact-Video quality dataset (XR-DAVID), comprised of 336 distorted videos. Extensive testing on XR-DAVID, as well as several datasets from the literature, indicate a significant gain in prediction performance compared to existing metrics. ColorVideoVDP opens the doors to many novel applications that require the joint automated spatiotemporal assessment of luminance and color distortions, including video streaming, display specification, and design, visual comparison of results, and perceptually-guided quality optimization. The code for the metric can be found at https://github.com/gfxdisp/ColorVideoVDP.


  • Open Access

    castleCSF — A contrast sensitivity function of color, area, spatiotemporal frequency, luminance and eccentricity

    by Maliha Ashraf, Rafał K. Mantiuk, Alexandre Chapiro, Sophie Wuerger

    The contrast sensitivity function (CSF) is a fundamental visual model explaining our ability to detect small contrast patterns. CSFs found many applications in engineering, where they can be used to optimize a design for perceptual limits. To serve such a purpose, CSFs must explain possibly a complete set of stimulus parameters, such as spatial and temporal frequency, luminance, and others. Although numerous contrast sensitivity measurements can be found in the literature, none fully explains the complete space of stimulus parameters. Therefore, in this work, we first collect and consolidate contrast sensitivity measurements from 18 studies, which explain the sensitivity variation across the parameters of interest. Then, we build an analytical contrast sensitivity model that explains the data from all those studies. The proposed castleCSF model explains the sensitivity as the function of spatial and temporal frequencies, an arbitrary contrast modulation direction in the color space, mean luminance, and chromaticity of the background, eccentricity, and stimulus area. The proposed model uses the same set of parameters to explain the data from 18 studies with an error of 3.59 dB. The consolidated contrast sensitivity data and the code for the model are publicly available at https://github.com/gfxdisp/castleCSF/.


  • Open Access

    Performance Comparison of Classical Methods and Neural Networks for Colour Correction

    by Abdullah Kucuk, Graham D. Finlayson, Rafal Mantiuk, Maliha Ashraf

    Colour correction is the process of converting RAW RGB pixel values of digital cameras to a standard colour space such as CIE XYZ. A range of regression methods including linear, polynomial and root-polynomial least-squares have been deployed. However, in recent years, various neural network (NN) models have also started to appear in the literature as an alternative to classical methods. In the first part of this paper, a leading neural network approach is compared and contrasted with regression methods. We find that, although the neural network model supports improved colour correction compared with simple least-squares regression, it performs less well than the more advanced root-polynomial regression. Moreover, the relative improvement afforded by NNs, compared to linear least-squares, is diminished when the regression methods are adapted to minimise a perceptual colour error. Problematically, unlike linear and root-polynomial regressions, the NN approach is tied to a fixed exposure (and when exposure changes, the afforded colour correction can be quite poor). We explore two solutions that make NNs more exposure-invariant. First, we use data augmentation to train the NN for a range of typical exposures and second, we propose a new NN architecture which, by construction, is exposure-invariant. Finally, we look into how the performance of these algorithms is influenced when models are trained and tested on different datasets. As expected, the performance of all methods drops when tested with completely different datasets. However, we noticed that the regression methods still outperform the NNs in terms of colour correction, even though the relative performance of the regression methods does change based on the train and test datasets.


  • Open Access

    stelaCSF

    by Rafał K. Mantiuk, Maliha Ashraf, Alexandre Chapiro

    A contrast sensitivity function, or CSF, is a cornerstone of many visual models. It explains whether a contrast pattern is visible to the human eye. The existing CSFs typically account for a subset of relevant dimensions describing a stimulus, limiting the use of such functions to either static or foveal content but not both. In this paper, we propose a unified CSF, stelaCSF, which accounts for all major dimensions of the stimulus: spatial and temporal frequency, eccentricity, luminance, and area. To model the 5-dimensional space of contrast sensitivity, we combined data from 11 papers, each of which studied a subset of this space. While previously proposed CSFs were fitted to a single dataset, stelaCSF can predict the data from all these studies using the same set of parameters. The predictions are accurate in the entire domain, including low frequencies. In addition, stelaCSF relies on psychophysical models and experimental evidence to explain the major interactions between the 5 dimensions of the CSF. We demonstrate the utility of our new CSF in a flicker detection metric and in foveated rendering.


  • Open Access

    Contrast Sensitivity Functions for HDR Displays

    by Minjung Kim, Maliha Ashraf, María Pérez-Ortiz, Jasna Martinovic, Sophie Wuerger, Rafał K. Mantiuk

    Contrast sensitivity functions (CSFs) characterize the sensitivity of the human visual system at different spatial frequencies. However, little is known about CSFs at luminances above 1000 cd/m2, especially for color. Here, we measured contrast sensitivities at background luminances from 0.02 cd/m2 to 7000 cd/m2 and for three color directions (black-white or achromatic, red-green, and yellow-violet). Stimuli were Gabor patches of various spatial frequencies (0.125 to 6 cpd), displayed on a custom-built high dynamic range display (peak luminance: 15,000 cd/m2). We found that achromatic contrast sensitivity has an inverted U-shape as a function of background luminance, with peak sensitivity at 200 cd/m2, while red-green and yellow-violet contrast sensitivities were monotonic functions of background luminance, saturating at 200 cd/m2. Based on these measurements, we developed a model that predicts contrast sensitivity for the average observer. This model is intended for applications in high dynamic range imaging.


  • Evaluation of Color Correction Methods for Printed Surfaces

    by Maliha Ashraf, Luis Ricardo Sapaico

    Achieving truthful reproduction of color is a well-known problem for printing applications. In this paper, we evaluate different methods for camera color calibration, within the scope of a moving image acquisition system. The acquisition device consists of a RGB camera and two fixed tungsten lamps. Our goal is to determine the most robust end-to-end framework given the acquisition conditions. We tested some color mapping methods commonly mentioned in the literature and made modifications to our specific needs. Our modified 3D lookup table (LUT) based method performs the best in the given conditions with future possibilities of hybrid LUTs combining the best performing aspects of different types of LUTs.