Experimental evaluation of user performance in a pursuit tracking task with multimodal feedback
DOI:
https://doi.org/10.2298/YJOR0401099OKeywords:
multimodal user interfaces, sonification, experimental evaluation, pursuit tracking, human factorsAbstract
In this paper we describe the results of experimental evaluation of user performance in a pursuit-tracking task with multimodal feedback. Our experimental results indicate that audio can significantly improve the accuracy of pursuit tracking. Experiments with 19 participants have shown that addition of acoustic modalities reduces the error during pursuit tracking for up to 19%. Moreover, experiments indicated the existence of perceptual boundaries of multimodal HCI for different scene complexity and target speeds. We have also shown that the most appealing paradigms are not the most effective ones, which necessitates a careful quantitative analysis of proposed multimodal HCI paradigms.References
Akamatsu, M., MacKenzie, I.S., and Hasbrouq, T., "A comparation of tactile, auditory, and visual feedback in a pointing task using a mouse-type device", Ergonimics, 38 (1995) 816-827.
Arnheim, R., Art and Visual Perception, The University of California Press, Berkeley, 1974.
Barnard, P.J., and May, J. (eds.), Computers, Communication and Usability: Design Issues, Research and Methods for Integrated Services, North Holland Series in Telecommunication, Amsterdam, Elsevier, 1993.
Begault, D.R., 3D Sound for Virtual Reality and Multimedia, Academic Press, Boston, 1994.
Blattner, M.M., and Glinter, E.P., "Multimodal integration", IEEE Multimedia, IEEE CS Press, 3 (4) (1996) 14-24.
Buxton, W., "Touch, gesture & marking", in: R.M. Baecker, J. Grudin, W. Buxton, S. Greenberg (eds.), Readings in Human Computer Interaction: Toward the Year 2000, Morgan Kaufmann Publishers, San Francsco, 1995.
Buxton, W., "Speech, language & audition", in: R.M. Baecker, J. Grudin, W. Buxton, S. Greenberg (eds.), Readings in Human Computer Interaction: Toward the Year 2000, San Francisco, Morgan Kaufmann Publishers, 1995.
Cook, P.R., "Virtual worlds, real sounds", IEEE Computer Graphics and Applications, IEEE CS Press, 22 (4) (2002) 22.
Deatherage, B.H., "Auditory and other sensory forms of information presentation", in: H.P. Van Cott, R.G. Kinkade (eds.), Human Engineering Guide to Equipment Design (Revised Edition), U.S. Government Printing Office, Washington, 1972.
DiFilippo, D., and Pai, D.K., "The AHI: an audio and haptic interface for contact interactions", Symposium on User Interface Software and Technology, San Diego, California, United States, ACM Press, New York, NY, USA, 2000, 149-159.
Guiard, Y., Beaudouin-Lafon, M., and Mottet, D., "Navigation as multiscale pointing: extending Fitts model to very high precision tasks", Conference on Human Factors and Computing Systems, Pittsburgh, Pennsylvania, United States, ACM Press, New York, 1999, 450-457.
ISO ISO/TC 159/SC4/WG3 N147: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9 - Requirements for non-keyboard input devices, International Organisation for Standardisation, May 25, 1998.
Ivry, R.B., and Cohen, A., "Dissociation of short- and long-range apparent motion in visual search", Journal of Experimental Psychology: Human Perception and Performance, 16 (2) (1990) 317-331.
Jovanov, E., Wagner, K., Radivojevic, V., Starcevic, D., Quinn, M., and Karron, D., "Tactical audio and acoustic rendering in biomedical applications", IEEE Transactions on Information Technology in Biomedicine, 3 (2) (1999) 109-118.
Jovanov, E., Starcevic, D., and Radivojevic, V., "Perceptualization of biomedical data", in: M. Akay, A. Marsh (eds.), Information Technologies in Medicine, Volume I: Medical Simulation and Education, John Wiley and Sons, 2001.
Kramer, D. (ed.), Auditory Display, Sonification, Audification and Auditory Interfaces, Addison-Wesley, Reading, MA, 1994.
MacKenzie, I.S., "Fitts' law as a research and design tool in human computer interaction", Human -Computer Interaction, 7 (1992) 91-139.
MacKenzie, I.S., and Buxton, W., "Extending Fitts law to two-dimensional tasks", Conference on Human Factors and Computing Systems – CHI 92, Monterey, California, United States, ACM Press, New York, 1992, 219-226.
Martens, W.L., "Psychophysical calibration for controlling the range of a virtual sound source: Multidimensional complexity in spatial auditory display", Proceedings of the 2001 International Conference on Auditory Display, Espoo, Finland, 2001, 231-234.
Murray, J., "Wearable computers in battle: Recent advances in the Land Warrior System", Proc. of the Fourth International Symposium on Wearable Computers (ISWC'00), Atlanta, 2000.
Neuhoff, J.G., "Perceiving acoustic source orientation in three-dimensional space", Proceedings of the 2001 International Conference on Auditory Display, Espoo, Finland, 2001, 231-234.
Obrenovic, Z., Starcevic, D., and Jovanov, E., "Experimental evaluation of multimodal human computer interface for tactical audio applications", Proceedings of IEEE International Conference on Multimedia and Expo - ICME 2002, Lausanne, Switzerland, 2002, 29-32.
Oviatt, S.L., "Ten myths of multimodal interaction", Communication of the ACM, 42 (1999) 74-81.
Prates, R., De Souza, D., and Barbosa, S., "A method for evaluating the communicability of user interfaces", ACM Interactions, 7 (1) (2000) 31-38.
Satawa, R., "Future technologies for medical applications", in: M. Akay, A. Marsh (eds.), Information Technologies in Medicine, Volume I: Medical Simulation and Education, John Wiley and Sons, 2001.
Schär, S.G., and Krueger, H., "Using new learning technologies with multimedia", IEEE Multimedia, IEEE CS Press, 7 (3) (2000) 40-51.
Sowizral, H., Rushforth, K., and Deering, M., The Java 3D API Specification, Second Edition, Addison-Wesley Pub Co, 2000.
Wegner, K., and Karron, D., "Surgical navigation using audio feedback", in: K.S. Morgan et al (eds.), Medicine Meets Virtual Reality: Global Healthcare Grid, IOS Press, Washington, 1997, 450-458.
Downloads
Published
Issue
Section
License
Copyright (c) 2004 YUJOR
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
