FireFly Mosaic: A Vision-Enabled Wireless Sensor Networking System
Authors:
- Anthony RoweARAnthony Rowe
- Dhiraj GoelDGDhiraj Goel
- Raj RajkumarRRRaj Rajkumar
- 1 December 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10528725,p. 459-468
Abstract
With the advent of CMOS cameras, it is now possible to make compact, cheap and low-power image sensors capable of on-board image processing. These embedded vision sensors provide a rich new sensing modality enabling new classes of wireless sensor networking applications. In order to build these applications, system designers need to overcome challenges associated with limited bandwidth, limited power, group coordination and fusing of multiple camera views with various other sensory inputs. Real-time properties must be upheld if multiple vision sensors are to process data, communicate with each other and make a group decision before the measured environmental feature changes. In this paper, we present FireFly Mosaic, a wireless sensor network image processing framework with operating system, networking and image processing primitives that assist in the development of distributed vision-sensing tasks. Each FireFly Mosaic wireless camera consists of a FireFly (Rowe et al., 2006) node coupled with a CMUcam3 (Rowe et al., 2007) embedded vision processor. The FireFly nodes run the nano-RK (Eswaran et al., 2005) real-time operating system and communicate using the RT-link (Rowe et al., 2006) collision-free TDMA link protocol. Using FireFly Mosaic, we demonstrate an assisted living application capable of fusing multiple cameras with overlapping views to discover and monitor daily activities in a home. Using this application, we show how an integrated platform with support for time synchronization, a collision-free TDMA link layer, an underlying RTOS and an interface to an embedded vision sensor provides a stable framework for distributed real-time vision processing. To the best of our knowledge, this is the first wireless sensor networking system to integrate multiple coordinating cameras performing local processing.Keywords
This publication has 8 references indexed in Scilit:
- Nano-RK: An Energy-Aware Resource-Centric RTOS for Sensor Networks2006
- RT-Link: A Time-Synchronized Link Protocol for Energy- Constrained Multi-hop Wireless Networks2006
- Application Development in Vision-Enabled Wireless Sensor Networks2006
- Cyclops2005
- Topology Inference for a Vision-Based Sensor Network2005
- On Real-Time Capacity Limits of Multihop Wireless Sensor Networks2005
- Real-Time Resource Reservation Protocol for Wireless Mobile Ad Hoc Networks2005
- Involutions fixing ℝℙ^{𝕠𝕕𝕕}⊔ℙ(𝕙,𝕚), ITransactions of the American Mathematical Society, 2002