Wearable Smartphone: Wearable Hybrid Framework for Hand and Foot Gesture Interaction on Smartphone

Abstract

There is a increasing interest in creating wearable smartphone interaction technologies. A novel smartphone wearable hybrid interaction framework based on mixed low-cost hardware and software is proposed in this work. The software application renders touch-less application graphics and status information using smart phone's screen. Augmented reality image rendering technology is employed for a convenient hand/foot and phone interaction. The users interact with the application using hand/foot gesture motion behind the camera, which trigger the interaction event and generate activity sequences for interactive buffers. The touch-less algorithm provides a core support for hand/foot-gesture interaction by accurately detecting and tracking the hand/foot gesture. Four proof-of-concept application prototypes are developed based on the wearable hybrid framework. The user study evaluation demonstrates the social acceptability of the designed hand/foot gestures and the usability of the applications on proposed wearable hybrid framework with touch-less interaction approach.