In this project we investigate pointing performance in handheld augmented reality interfaces. In dynamic peephole interfaces the objects of interest are only visible on the mobile device display. In magic lens interfaces the mobile device is used as a see-through tool for augmenting targets that are also visible in the physical world. We found that dynamic peephole pointing can be modeled with Fitts' law and we developed a two-part Fitts' law extension that explains magic lens pointing. We are interested in the implications of these results for the design of magic lens interfaces in handheld and mobile augmented reality applications.
When camera phones are used as magic lenses in handheld augmented reality applications involving wall maps or posters, pointing can be divided into two phases: (1) an initial coarse physical pointing phase, in which the target can be directly observed on the background surface, and (2) a fine-control virtual pointing phase, in which the target can only be observed through the device display. In two studies, we have shown that performance cannot be adequately modeled with standard Fitts' law, but can be adequately modeled with a two-component modification. One goal is to chard the performance space and analyze users' target acquisition strategies in varying conditions. We found that the standard Fitts' law model does hold for dynamic peephole pointing where there is no guiding background surface and hence the physical pointing component of the extended model is not needed.
This project is conducted by Michael Rohs Deutsche Telekom Laboratories and Antti Oulasvirta, Helsinki Institute for Information Technology HIIT, Finland.