Experimental evaluation of user performance in a pursuit tracking task with multimodal feedback

Authors

  • Željko Obrenović Faculty of Organizational Sciences, University of Belgrade Belgrade, Serbia and Montenegro

DOI:

https://doi.org/10.2298/YJOR0401099O

Keywords:

multimodal user interfaces, sonification, experimental evaluation, pursuit tracking, human factors

Abstract

In this paper we describe the results of experimental evaluation of user performance in a pursuit-tracking task with multimodal feedback. Our experimental results indicate that audio can significantly improve the accuracy of pursuit tracking. Experiments with 19 participants have shown that addition of acoustic modalities reduces the error during pursuit tracking for up to 19%. Moreover, experiments indicated the existence of perceptual boundaries of multimodal HCI for different scene complexity and target speeds. We have also shown that the most appealing paradigms are not the most effective ones, which necessitates a careful quantitative analysis of proposed multimodal HCI paradigms.

References

Akamatsu, M., MacKenzie, I.S., Hasbroucq, T. (1995) A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics, 38(4): 816-27

Arnheim, R. (1974) Art and visual perception: The psychology of creative eye. Berkeley, CA, itd: University of California Press

Barnard, P.J., May, J., ur. (1993) Computers, communication and usability: Design issues, research and methods for integrated services. Amsterdam: North Holland Series in Telecommunication

Begault, D.R. (1994) 3D sound for virtual reality and multimedia. New York-San Diego, itd: Academic Press

Blattner, M.M., Glinter, E.P. (1996) Multimodal integration. IEEE Multimedia, 3,(4), 14-24

Buxton, W. (1995) Touch, gesture & marking. u: Baecker R.M., J. Grudin W. Buxton, S. Greenberg [ur.] Readings in Human Computer Interaction: Toward the Year 2000, San Francisco, CA, itd: Morgan Kaufmann

Buxton, W. (1995) Speech, language & audition. u: Baecker R.M., J. Grudin, W. Buxton, S. Greenberg [ur.] Readings in Human Computer Interaction: Toward the Year 2000, San Francisco, CA, itd: Morgan Kaufmann

Cook, P.R. (2002) Virtual worlds, real sounds. IEEE Computer Graphics and Applications, 22, (4), 22

Deatherage, B.H. (1972) Auditory and other sensory forms of information presentation. u: Van Cott H.P., R. G. Kinkade [ur.] Human Engineering Guide to Equipment Design, Washington, DC: US Government Printing Office

di Filippo, D., Pai, D.K. (2000) The AHI: An audio and haptic interface for contact interactions. u: Symposium on User Interface Software and Technology, San Diego, California, United States, New York, NY: ACM Press, 149-159

Guiard, Y., Beaudouin-Lafon, M., Mottet, D. (1999) Navigation as multiscale pointing: Extending Fitts model to very high precision tasks. u: Conference on Human Factors and Computing Systems, Pittsburgh, Pennsylvania, United States, New York, NY: ACM Press, 450-457

International Organisation for Standardization (1998) ISO ISO/TC 159/SC4/WG3 N147: Ergonomic requirements for office work with visual display terminals VDTs - Part 9 - Requirements for non-keyboard input devices. Geneve, May 25

Ivry, R.B., Cohen, A. (1990) Dissociation of short- and long-range apparent motion in visual search. J Exp Psychol Hum Percept Perform, 16(2): 317-31

Jovanov, E., Starčević, D., Radivojević, V. (2001) Perceptualization of biomedical data. u: Akay M., A. Marsh [ur.] Information Technologies in Medicine: Medical Simulation and Education, New York, itd: Wiley, Volume I

Jovanov, E.S., Wagner, K., Radivojević, V., Starčević, D.B., Quinn, M., Karron, D. (1999) Tactical audio and acoustic rendering in biomedical applications. IEEE Transactions on Inf Technol Biomed, 3(2): 109-18

Kramer, D., ur. (1994) Auditory display, sonification, audification and auditory interfaces. Reading, MA, itd: Addison-Wesley

Mackenzie, I.S. (1992) Fitts' law as a research and design tool in human computer interaction. Human-Computer Interaction, 7, 91-139

Mackenzie, I.S., Buxton, W. (1992) Extending Fitts law to two-dimensional tasks. u: Conference on Human Factors and Computing Systems - CHI 92, Monterey, California, United States, New York, NY: ACM Press, 219-226

Martens, W.L. (2001) Psychophysical calibration for controlling the range of a virtual sound source: Multidimensional complexity in spatial auditory display. u: Proceedings of the International Conference on Auditory Display, Espoo, Finland, 231-234

Murray, J. (2000) Wearable computers in battle: Recent advances in the land warrior system. u: Proc. of the Fourth International Symposium on Wearable Computers (ISWC'00), Atlanta

Neuhoff, J.G. (2001) Perceiving acoustic source orientation in three-dimensional space. u: Proceedings of the International Conference on Auditory Display, Espoo, Finland, 231-234

Obrenović, Ž., Starčević, D., Jovanov, E. (2002) Experimental evaluation of multimodal human computer interface for tactical audio applications. u: Proceedings of IEEE International Conference on Multimedia and Expo - ICME Lausanne, Switzerland, 29-32

Oviatt, S.L. (1999) Ten myths of multimodal interaction. Communications of the ACM, vol. 42, No 11, Nov, str. 74-81

Prates, R., de Souza, D., Barbosa, S. (2000) A method for evaluating the communicability of user interfaces. ACM Interactions, 7,(1), 31-38

Satawa, R. (2001) Future technologies for medical applications. u: Akay M., A. Marsh [ur.] Information Technologies in Medicine: Medical Simulation and Education, New York, itd: Wiley, Volume I

Schar, S.G., Krueger, H. (2000) Using new learning technologies with multimedia. IEEE Multimedia, 7, (3), 40-51

Sowizral, H., Rushforth, K., Deering, M. (2000) The Java 3D API specification. Reading, MA, itd: Addison-Wesley

Wegner, K., Karron, D. (1997) Surgical navigation using audio feedback. u: Morgan K.S. i dr. [ur.] Medicine meets virtual reality: Global healthcare grid, Washington, DC: IOS Press, str. 450-458

Downloads

Published

2004-03-01

Issue

Section

Research Articles