Jing Qian, Benjamin Attal, Jiaju Ma, Xiangyu Li, Haoming Lai, James Tompkin, John F. Hughes, Jeff Huang.
What if we could play with augmented reality (AR) objects with our hands directly instead of clicking on the smartphone screen? Portal-ble enables such AR experience by introducing a series of feedback mechanisms on top of our open-source mobile hand tracking application. The result is a more intuitive, easy to use hand interaction experiences on your everyday mobile devices!
We combined motion tracking and head tracking to create 3D viewing experience on a smartphone without wearables. The first technique renders the virtual objects “stand out” of the smartphone frame visually by compensating the smartphone movements; the second technique makes the virtual objects respond to where a user stares at. Together we aim to deliver portable 3D viewing experience from a smartphone at any place and time. (Working process)
Jing Qian, Arielle Chapin, Alexandra Papoutsaki, Fumeng Yang, Klaas Nelisson, Jeff Huang
A large portion of remote user studies is done on mobile devices, and most focused on users' screen inputs. Remotion provides further contextual information by replaying user hand movements using our custom-made robotic holder. We found that motion cues reveal characteristics and engagement level of participants that the screen inputs do not.
(UbiComp 2018)
Jing Qian, Laurent Denoue, Jacob Biehl, David A. Shamma
A smartphone AR application showcases the benefit of swapping interaction linearity with sound and voice recognition in real-time.
(IEEE AIAR 2018)
A Virtual Reality “Memory Palace”
Aids Knowledge Retrieval
Fumeng Yang, Jing Qian, Johannes Novotny, David Badre, Cullen D. Jackson, and David H. Laidlaw
We present an evaluation of using virtual reality techniques to assist in research knowledge retrieval. (In Submission)
With Ian Gonsher and Ethan Mok
This project provides rigid feedback on otherwise intangible virtual objects. Through
Liu Xin, Katia Vega, Jing Qian, Joseph Paradiso, and Pattie Maes
Fluxa is a compact wearable device enabling social display through hand movement. Unlike displaying messages on a screen over the internet, Fluxa allows distant in-person communication through the effects of the persistence of vision.
(UIST 2016)