Topological graph matching based dot pattern recognition scheme for smart book

Abstract

In this paper, we present a design and implementation of smart book system using pen based augmented reality approach. Student has been given a smart pen and a smart study book, which is a usual printed material with CMY inks for contents and K ink for perceptually invisible dot patterns. When a student touches a smart study books with our smart pen, we show his/her multimedia (visual/audio) information which is exactly related with the selected region. Smart pen includes (1) IR LED/IR pass filter for illumination independent extraction of the dot patterns, and (2) camera for image captures. From the image sequences, we perform topological graph analysis which determines the topological distance between dot pixels, and perform error correction decoding using four position symbols and five CRC symbols. Our scheme can embed 16 bit information, which is more than 200% larger than previous scheme, which supports 7 bits or 8 bits information at most. © 2011 Springer-Verlag.