Abstract EN:

This thesis explores potentials of applying spatial visuo-proprioceptive conflicts of the real hand to 3D user interaction in Augmented Reality. A generic framework is proposed which can generate, manage and reduce sensory conflicts at hand level while providing a continuous interaction cycle. Technically, the system is based on a video see-through head-mounted display that allows for embedding the real hand into a virtual scene and to visually manipulate its position in 3D. Two novel methods are introduced on top of this basis: an intuitive virtual object touching paradigm and a hand-displacement-based active pseudo-haptics technique. Both approaches are studied with respect to their benefits, limitations, effects on the behaviour of the user and consequences for the design of Virtual Environments. It is demonstrated that new forms of human-computer interaction are possible exploiting the described visuomotor conflicts of the hand. Promising future perspectives are presented.