Heimdall: A case for encrypted displays: Extended Abstract

Abstract

It can be argued that among all the personal devices, a smartphone carries the most private information of one's life. The improved hardware, computing resource, ever-increasing storage, ubiquitous connectivity, and innovative ways of accessing useful information has slowly and steadily integrated smartphones in our lives. Whether it is interacting on social media, planning for the day using productivity apps or getting things done at work, the smartphone screen is the primary gateway between a user and the world of information accessible through the smartphones. There is always a risk of leaking sensitive information while accessing such information on one's smart-device in a public setting. Visual information can be easily taken advantage of by a malicious bystander. Even if the screen is not comprehensible to the human eye, an off-the-shelf recording device can capture the finer details displayed on the victim's smartphone. A popular way of protecting visual information displayed on smartphones is to use privacy screens [1]. However, privacy screens fail to protect visual privacy when the bystander or the recording device is pointed at it directly. To address this issue, in the poster, we propose, Heimdall, an augmented reality (AR) based system. The primary reason for the failure of privacy screens is that the medium used to broadcast the visual information is shared by the intended user and the bystanders. An AR based solution isolates the medium used to receive the visual information by the intended user from any other receiver. The primary guiding force behind the design of Heimdall are as follows: • On-demand Privacy Mode: The user should be able to interact with her smartphone without the need of the AR equipment. The user can enable privacy mode when sensitive information needs to be accessed and disable otherwise. • Minimal computation on AR device: We do not assume that the AR device will be capable of performing an intensive computation. AR glasses under Heimdall should be able to stream the user's view and replace it with an augmented view.