I Want to Change My Floor: Dominant Plane Recognition from a Single Image to Augment the Scene
Authors:
- J. A. De Jesus Osuna-CoutinoJOJ. A. De Jesus Osuna-Coutino
- Claudia Cruz-MartinezCCClaudia Cruz-Martinez
- Jose Martinez-CarranzaJose Martinez-Carranza
- Miguel Arias-EstradaMAMiguel Arias-Estrada
- Walterio Mayol-CuevasWMWalterio Mayol-Cuevas
- 1 September 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 135-140
Abstract
Augmented reality combines real footage taken of a scene with virtual elements. However, most current methods rely on camera localisation and 3D reconstruction or point cloud generation in order to integrate augmented reality to the footage. In contrast, in this work we present a novel method to augment virtual reality to the scene based on the recognition of dominant planes in interior scenes. Our method uses a rule system to select predefined decisions on a set of variables in order to infer dominant planes in the scene. For this, we propose to combine information from texture features, a measure of blurring in the dominant planes, and a segmentation of regions in a scene based on superpixels. The rule system infers the regions corresponding to the dominant planes, whilst light intensity in the scene is inferred from segmented regions. We also propose an approach to remove regions misclassified as dominant planes. Finally, the floor in the scene is recognised as the most dominant plane and then replaced with an augmented texture. We demonstrate our approach in a video sequence where our method is applied in a frame-to-frame basis, thus, for each single image in the video sequence, the floor is automatically recognised as the most dominant plane and then replaced with a virtual texture and furthermore, whose appearance is modified according to our coarse light model inferred from our approach.Keywords
This publication has 17 references indexed in Scilit:
- Dominant plane detection using a RGB-D camera for autonomous navigation2015
- Manhattan scene understanding using monocular, stereo, and 3D features2011
- Unifying Planar and Point Mapping in Monocular SLAM2010
- Outdoors augmented reality on mobile phone using loxel-based visual feature organization2008
- Recovering Surface Layout from an ImageInternational Journal of Computer Vision, 2007
- Going out: robust model-based tracking for outdoor augmented reality2006
- Marker-less vision based tracking for mobile augmented reality2004
- Marker tracking and HMD calibration for a video-based augmented reality conferencing system2003
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Calibration requirements and procedures for a monitor-based augmented reality systemIEEE Transactions on Visualization and Computer Graphics, 1995