Visual Force Sensing for 3DUI using Palm


"We proposed a method for sensing 3D force acting between a palm and a finger by using a camera to develop a ubiquitous 3DUI. The proposed method detects skin deformation by using optical flow and estimates the 3D vector from its spatial distribution. By using a calibrated force sensor, we found that the 3D force vector acting on the palm can be estimated. Moreover, we implemented mouse cursor manipulation by the force as a simple application."


Publications

  • R. Ohno, S. Yoshimoto, K. Sato, Visual Force Sensing for Device-less Interface with Finger Pushing onto Palm. The Journal of The Institute of Image Information and Television Engineers, Vol.68, No.7, pp.J287-J291, 2014 (in Japanese).
  • R. Ohno, S. Yoshimoto, K. Sato, Palm+Act: Operation by Visually Captured 3D Force on Palm. In Proc. ACM SIGGRAPH Asia 2013, Emerging Technologies, p.71, Hong Kong, 2013.


(c) 2015-2018 Shunsuke Yoshimoto.