Experimental evaluation of user performance in a pursuit tracking task with multimodal feedback
DOI:
https://doi.org/10.2298/YJOR0401099OKeywords:
multimodal user interfaces, sonification, experimental evaluation, pursuit tracking, human factorsAbstract
In this paper we describe the results of experimental evaluation of user performance in a pursuit-tracking task with multimodal feedback. Our experimental results indicate that audio can significantly improve the accuracy of pursuit tracking. Experiments with 19 participants have shown that addition of acoustic modalities reduces the error during pursuit tracking for up to 19%. Moreover, experiments indicated the existence of perceptual boundaries of multimodal HCI for different scene complexity and target speeds. We have also shown that the most appealing paradigms are not the most effective ones, which necessitates a careful quantitative analysis of proposed multimodal HCI paradigms.References
Akamatsu, M., MacKenzie, I.S., Hasbroucq, T. (1995) A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics, 38(4): 816-27
Arnheim, R. (1974) Art and visual perception: The psychology of creative eye. Berkeley, CA, itd: University of California Press
Barnard, P.J., May, J., ur. (1993) Computers, communication and usability: Design issues, research and methods for integrated services. Amsterdam: North Holland Series in Telecommunication
Begault, D.R. (1994) 3D sound for virtual reality and multimedia. New York-San Diego, itd: Academic Press
Blattner, M.M., Glinter, E.P. (1996) Multimodal integration. IEEE Multimedia, 3,(4), 14-24
Buxton, W. (1995) Touch, gesture & marking. u: Baecker R.M., J. Grudin W. Buxton, S. Greenberg [ur.] Readings in Human Computer Interaction: Toward the Year 2000, San Francisco, CA, itd: Morgan Kaufmann
Buxton, W. (1995) Speech, language & audition. u: Baecker R.M., J. Grudin, W. Buxton, S. Greenberg [ur.] Readings in Human Computer Interaction: Toward the Year 2000, San Francisco, CA, itd: Morgan Kaufmann
Cook, P.R. (2002) Virtual worlds, real sounds. IEEE Computer Graphics and Applications, 22, (4), 22
Deatherage, B.H. (1972) Auditory and other sensory forms of information presentation. u: Van Cott H.P., R. G. Kinkade [ur.] Human Engineering Guide to Equipment Design, Washington, DC: US Government Printing Office
di Filippo, D., Pai, D.K. (2000) The AHI: An audio and haptic interface for contact interactions. u: Symposium on User Interface Software and Technology, San Diego, California, United States, New York, NY: ACM Press, 149-159
Guiard, Y., Beaudouin-Lafon, M., Mottet, D. (1999) Navigation as multiscale pointing: Extending Fitts model to very high precision tasks. u: Conference on Human Factors and Computing Systems, Pittsburgh, Pennsylvania, United States, New York, NY: ACM Press, 450-457
International Organisation for Standardization (1998) ISO ISO/TC 159/SC4/WG3 N147: Ergonomic requirements for office work with visual display terminals VDTs - Part 9 - Requirements for non-keyboard input devices. Geneve, May 25
Ivry, R.B., Cohen, A. (1990) Dissociation of short- and long-range apparent motion in visual search. J Exp Psychol Hum Percept Perform, 16(2): 317-31
Jovanov, E., Starčević, D., Radivojević, V. (2001) Perceptualization of biomedical data. u: Akay M., A. Marsh [ur.] Information Technologies in Medicine: Medical Simulation and Education, New York, itd: Wiley, Volume I
Jovanov, E.S., Wagner, K., Radivojević, V., Starčević, D.B., Quinn, M., Karron, D. (1999) Tactical audio and acoustic rendering in biomedical applications. IEEE Transactions on Inf Technol Biomed, 3(2): 109-18
Kramer, D., ur. (1994) Auditory display, sonification, audification and auditory interfaces. Reading, MA, itd: Addison-Wesley
Mackenzie, I.S. (1992) Fitts' law as a research and design tool in human computer interaction. Human-Computer Interaction, 7, 91-139
Mackenzie, I.S., Buxton, W. (1992) Extending Fitts law to two-dimensional tasks. u: Conference on Human Factors and Computing Systems - CHI 92, Monterey, California, United States, New York, NY: ACM Press, 219-226
Martens, W.L. (2001) Psychophysical calibration for controlling the range of a virtual sound source: Multidimensional complexity in spatial auditory display. u: Proceedings of the International Conference on Auditory Display, Espoo, Finland, 231-234
Murray, J. (2000) Wearable computers in battle: Recent advances in the land warrior system. u: Proc. of the Fourth International Symposium on Wearable Computers (ISWC'00), Atlanta
Neuhoff, J.G. (2001) Perceiving acoustic source orientation in three-dimensional space. u: Proceedings of the International Conference on Auditory Display, Espoo, Finland, 231-234
Obrenović, Ž., Starčević, D., Jovanov, E. (2002) Experimental evaluation of multimodal human computer interface for tactical audio applications. u: Proceedings of IEEE International Conference on Multimedia and Expo - ICME Lausanne, Switzerland, 29-32
Oviatt, S.L. (1999) Ten myths of multimodal interaction. Communications of the ACM, vol. 42, No 11, Nov, str. 74-81
Prates, R., de Souza, D., Barbosa, S. (2000) A method for evaluating the communicability of user interfaces. ACM Interactions, 7,(1), 31-38
Satawa, R. (2001) Future technologies for medical applications. u: Akay M., A. Marsh [ur.] Information Technologies in Medicine: Medical Simulation and Education, New York, itd: Wiley, Volume I
Schar, S.G., Krueger, H. (2000) Using new learning technologies with multimedia. IEEE Multimedia, 7, (3), 40-51
Sowizral, H., Rushforth, K., Deering, M. (2000) The Java 3D API specification. Reading, MA, itd: Addison-Wesley
Wegner, K., Karron, D. (1997) Surgical navigation using audio feedback. u: Morgan K.S. i dr. [ur.] Medicine meets virtual reality: Global healthcare grid, Washington, DC: IOS Press, str. 450-458
Downloads
Published
Issue
Section
License
Copyright (c) YUJOR
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.