Historical Data Storage for Large Scale Sensor Networks
Loic Petit, Abdelhamid Nafaa, and Raja Jurdak
Abstract
Wireless sensor networks are rapidly finding their way through a plethora of new applications like precision farming or forestry, with an ever-growing network scale, system complexity, and data rate. Previous related research works have rather focused on scalability issues from MAC and routing perspectives, and poorly addressed the underlying storage architecture which often turns to be a critical bottleneck. Inappropriate storage and retrieval architectures usually lead to an excessive cost when it comes to improving the scalability and responsiveness of the system.
In this paper, we present a backend storage and retrieval architecture to support very large volumes of real-time measurements generated by a large scale wireless sensor network. Our contribution is articulated around: (i) a database partitioning and structuring scheme coupled with a double-buffering technique to reduce the end-to-end delay while minimizing the processing power, and (ii) an optimized historical measurement data query format tailored for superior performance in terms of data retrieval responsiveness. This backend storage and retrieval system has been developed along with other the sensor network communication improvements in a testbed currently deployed in UCD campus. Performance evaluation results are presented and analyzed in this paper.
In proceedings of Ubimob Conference, Lille, France