On-screen marker fields for reliable screen-to-screen task migration

Abstract

Our goal is to deliver unobtrusive task migration, typically between a desktop computer and a mobile device. We propose to overlay an aesthetically acceptable marker field across (a part of) the monitor screen. This marker field must be easily detectable even by a low-end ultramobile device, unobtrusive to the user, and easy to mix in the natural screen image. We show that Uniform Marker Fields are a good choice for this task and propose a methodology for inserting them into the screen image. The experimental results show that our solution provides reliable task migration on a video stream in interactive frame rates (∼30 FPS marker detection, 340 ms whole processing time including wireless communication, HTC Desire from 2010). This substantially outperforms the existing solutions based on natural keypoints (~7 sec processing). Our user tests also led to selection and design of appropriate marker fields and their mixing parameters. © 2013 Springer-Verlag.