Objectives

Upon completion of this lesson, you will be able to:

  • list common input devices and their characteristics
  • list common output devices and methods
  • contrast the properties of input devices
  • appreciate the poosibility of novel and emerging interaction devices

Introduction

Interaction devices for input and output are fundamental components in the design of human-computer interfaces (HCI). Their purpose is not just to facilitate user interaction with the system, but also to shape the user’s experience and the overall usability of the system. The consideration of interaction devices goes far beyond their physical or technical characteristics, extending into the realms of cognitive psychology, user experience design, and accessibility.

Input devices are responsible for translating user actions into signals that a computer can understand. They are the conduit by which users express their intent to the system. This includes everything from traditional devices like keyboards and mice, to more specialized equipment such as touch screens, styluses, and microphones for voice input. The effectiveness of an input device depends on how accurately and conveniently it captures user intent.

In HCI, input devices are not seen just as physical entities but also as cognitive tools. The design and choice of input devices can affect the cognitive load on the user, user’s comfort, and the overall interaction experience. For example, a well-designed touch interface can feel more direct and natural than using a mouse, reducing cognitive load. On the other hand, using voice input in a noisy environment can increase cognitive load due to repeated failed attempts to get recognized by the system.

Output devices, on the other hand, are how the system communicates back to the user. They present processed information to the user in a way that is hopefully easy to understand and actionable. This can be through visual displays (e.g., monitors, VR headsets), auditory devices (e.g., speakers, headphones), haptic devices (vibration, force feedback), and even olfactory devices in some experimental setups.

The design and choice of output devices affect the user’s perception and interpretation of the system’s responses. The output should be tailored to the context of use, user’s expectations, and the nature of the information. For example, visual displays are good for presenting detailed and complex information, but auditory output can be better for alerts or when the user’s visual attention is occupied elsewhere.

Both input and output devices should be considered in the light of accessibility. Some users may have limitations that prevent them from using certain types of devices, so providing alternatives is crucial to making the system usable for a wide range of people. This can mean providing text-to-speech for visually impaired users, gesture-based inputs for users unable to use a keyboard or mouse, and so on.

Moreover, the design of HCI should also take into account the integration and interplay of multiple input and output devices, also known as multimodal interaction. This requires an understanding of how different devices can complement each other to provide a more effective and rich interaction. For instance, combining touch input with haptic feedback can greatly improve the usability of a virtual keyboard on a touchscreen device.

Lecture

The lecture below by Dr. Schedlbauer summarizes the characteristics of input and output devices for the design of interactions in computer-human interfaces.

Slide Deck: S-91-302 Interaction Devices

Summary

In summary, the purpose of interaction devices in HCI is to enable and enhance human-computer communication. They are key in making the system not just functional, but also intuitive, satisfying, and accessible to use. A good HCI designer should have a deep understanding of not just the technical aspects of these devices, but also their cognitive, experiential, and sociocultural implications.

Files & Resources

All Files for Lesson 91.302

References

Shneiderman, B., Plaisant, C. (2010). Designing the User Interface, 5th Edition. Addison-Wesley.

Schedlbauer, M. (2011). Input Devices. Technical Report, University of Massachusetts Lowell.

Errata

Let us know.

LS0tCnRpdGxlOiAiSW50ZXJhY3Rpb24gRGV2aWNlcyIKcGFyYW1zOgogIHR5cGU6IGxlc3NvbgogIGNhdGVnb3J5OiA5MQogIHN0YWNrczogIjAsMCIKICBudW1iZXI6IDMwMgogIHRpbWU6IDkwCiAgbGV2ZWw6IGJlZ2lubmVyCiAgdGFnczogSENJLHRvdWNoLGlucHV0LG91dHB1dCxkaXNwbGF5LGludGVyYWN0aW9uCiAgZGVzY3JpcHRpb246ICJMaXN0cyBpbnB1dCBhbmQgb3V0cHV0IGRldmljZXMgYW5kIHRoZWlyIGNoYXJhY3RlcmlzdGljcwogICAgICAgICAgICAgICAgZm9yIHRoZSBkZXNpZ24gb2YgY29tcHV0ZXItaHVtYW4gaW50ZXJhY3Rpb25zLiIKZGF0ZTogIjxzbWFsbD5gciBTeXMuRGF0ZSgpYDwvc21hbGw+IgphdXRob3I6ICI8c21hbGw+TWFydGluIFNjaGVkbGJhdWVyPC9zbWFsbD4iCmVtYWlsOiAibS5zY2hlZGxiYXVlckBuZXUuZWR1IgphZmZpbGl0YXRpb246ICJOb3J0aGVhc3Rlcm4gVW5pdmVyc2l0eSIKb3V0cHV0OiAKICBib29rZG93bjo6aHRtbF9kb2N1bWVudDI6CiAgICB0b2M6IHRydWUKICAgIHRvY19mbG9hdDogdHJ1ZQogICAgY29sbGFwc2VkOiBmYWxzZQogICAgbnVtYmVyX3NlY3Rpb25zOiBmYWxzZQogICAgY29kZV9kb3dubG9hZDogdHJ1ZQogICAgdGhlbWU6IHNwYWNlbGFiCiAgICBoaWdobGlnaHQ6IHRhbmdvCi0tLQoKLS0tCnRpdGxlOiAiPHNtYWxsPmByIHBhcmFtcyRjYXRlZ29yeWAuYHIgcGFyYW1zJG51bWJlcmA8L3NtYWxsPjxici8+PHNwYW4gc3R5bGU9J2NvbG9yOiAjMkU0MDUzOyBmb250LXNpemU6IDAuOWVtJz5gciBybWFya2Rvd246Om1ldGFkYXRhJHRpdGxlYDwvc3Bhbj4iCi0tLQoKYGBge3IgY29kZT14ZnVuOjpyZWFkX3V0ZjgocGFzdGUwKGhlcmU6OmhlcmUoKSwnL1IvX2luc2VydDJEQi5SJykpLCBpbmNsdWRlID0gRkFMU0V9CmBgYAoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgojIyBPYmplY3RpdmVzCgpVcG9uIGNvbXBsZXRpb24gb2YgdGhpcyBsZXNzb24sIHlvdSB3aWxsIGJlIGFibGUgdG86CgotICAgbGlzdCBjb21tb24gaW5wdXQgZGV2aWNlcyBhbmQgdGhlaXIgY2hhcmFjdGVyaXN0aWNzCi0gICBsaXN0IGNvbW1vbiBvdXRwdXQgZGV2aWNlcyBhbmQgbWV0aG9kcwotICAgY29udHJhc3QgdGhlIHByb3BlcnRpZXMgb2YgaW5wdXQgZGV2aWNlcwotICAgYXBwcmVjaWF0ZSB0aGUgcG9vc2liaWxpdHkgb2Ygbm92ZWwgYW5kIGVtZXJnaW5nIGludGVyYWN0aW9uIGRldmljZXMKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKIyMgSW50cm9kdWN0aW9uIHsjaW50cm99CgpJbnRlcmFjdGlvbiBkZXZpY2VzIGZvciBpbnB1dCBhbmQgb3V0cHV0IGFyZSBmdW5kYW1lbnRhbCBjb21wb25lbnRzIGluIHRoZSBkZXNpZ24gb2YgaHVtYW4tY29tcHV0ZXIgaW50ZXJmYWNlcyAoSENJKS4gVGhlaXIgcHVycG9zZSBpcyBub3QganVzdCB0byBmYWNpbGl0YXRlIHVzZXIgaW50ZXJhY3Rpb24gd2l0aCB0aGUgc3lzdGVtLCBidXQgYWxzbyB0byBzaGFwZSB0aGUgdXNlcidzIGV4cGVyaWVuY2UgYW5kIHRoZSBvdmVyYWxsIHVzYWJpbGl0eSBvZiB0aGUgc3lzdGVtLiBUaGUgY29uc2lkZXJhdGlvbiBvZiBpbnRlcmFjdGlvbiBkZXZpY2VzIGdvZXMgZmFyIGJleW9uZCB0aGVpciBwaHlzaWNhbCBvciB0ZWNobmljYWwgY2hhcmFjdGVyaXN0aWNzLCBleHRlbmRpbmcgaW50byB0aGUgcmVhbG1zIG9mIGNvZ25pdGl2ZSBwc3ljaG9sb2d5LCB1c2VyIGV4cGVyaWVuY2UgZGVzaWduLCBhbmQgYWNjZXNzaWJpbGl0eS4KCklucHV0IGRldmljZXMgYXJlIHJlc3BvbnNpYmxlIGZvciB0cmFuc2xhdGluZyB1c2VyIGFjdGlvbnMgaW50byBzaWduYWxzIHRoYXQgYSBjb21wdXRlciBjYW4gdW5kZXJzdGFuZC4gVGhleSBhcmUgdGhlIGNvbmR1aXQgYnkgd2hpY2ggdXNlcnMgZXhwcmVzcyB0aGVpciBpbnRlbnQgdG8gdGhlIHN5c3RlbS4gVGhpcyBpbmNsdWRlcyBldmVyeXRoaW5nIGZyb20gdHJhZGl0aW9uYWwgZGV2aWNlcyBsaWtlIGtleWJvYXJkcyBhbmQgbWljZSwgdG8gbW9yZSBzcGVjaWFsaXplZCBlcXVpcG1lbnQgc3VjaCBhcyB0b3VjaCBzY3JlZW5zLCBzdHlsdXNlcywgYW5kIG1pY3JvcGhvbmVzIGZvciB2b2ljZSBpbnB1dC4gVGhlIGVmZmVjdGl2ZW5lc3Mgb2YgYW4gaW5wdXQgZGV2aWNlIGRlcGVuZHMgb24gaG93IGFjY3VyYXRlbHkgYW5kIGNvbnZlbmllbnRseSBpdCBjYXB0dXJlcyB1c2VyIGludGVudC4KCkluIEhDSSwgaW5wdXQgZGV2aWNlcyBhcmUgbm90IHNlZW4ganVzdCBhcyBwaHlzaWNhbCBlbnRpdGllcyBidXQgYWxzbyBhcyBjb2duaXRpdmUgdG9vbHMuIFRoZSBkZXNpZ24gYW5kIGNob2ljZSBvZiBpbnB1dCBkZXZpY2VzIGNhbiBhZmZlY3QgdGhlIGNvZ25pdGl2ZSBsb2FkIG9uIHRoZSB1c2VyLCB1c2VyJ3MgY29tZm9ydCwgYW5kIHRoZSBvdmVyYWxsIGludGVyYWN0aW9uIGV4cGVyaWVuY2UuIEZvciBleGFtcGxlLCBhIHdlbGwtZGVzaWduZWQgdG91Y2ggaW50ZXJmYWNlIGNhbiBmZWVsIG1vcmUgZGlyZWN0IGFuZCBuYXR1cmFsIHRoYW4gdXNpbmcgYSBtb3VzZSwgcmVkdWNpbmcgY29nbml0aXZlIGxvYWQuIE9uIHRoZSBvdGhlciBoYW5kLCB1c2luZyB2b2ljZSBpbnB1dCBpbiBhIG5vaXN5IGVudmlyb25tZW50IGNhbiBpbmNyZWFzZSBjb2duaXRpdmUgbG9hZCBkdWUgdG8gcmVwZWF0ZWQgZmFpbGVkIGF0dGVtcHRzIHRvIGdldCByZWNvZ25pemVkIGJ5IHRoZSBzeXN0ZW0uCgpPdXRwdXQgZGV2aWNlcywgb24gdGhlIG90aGVyIGhhbmQsIGFyZSBob3cgdGhlIHN5c3RlbSBjb21tdW5pY2F0ZXMgYmFjayB0byB0aGUgdXNlci4gVGhleSBwcmVzZW50IHByb2Nlc3NlZCBpbmZvcm1hdGlvbiB0byB0aGUgdXNlciBpbiBhIHdheSB0aGF0IGlzIGhvcGVmdWxseSBlYXN5IHRvIHVuZGVyc3RhbmQgYW5kIGFjdGlvbmFibGUuIFRoaXMgY2FuIGJlIHRocm91Z2ggdmlzdWFsIGRpc3BsYXlzIChlLmcuLCBtb25pdG9ycywgVlIgaGVhZHNldHMpLCBhdWRpdG9yeSBkZXZpY2VzIChlLmcuLCBzcGVha2VycywgaGVhZHBob25lcyksIGhhcHRpYyBkZXZpY2VzICh2aWJyYXRpb24sIGZvcmNlIGZlZWRiYWNrKSwgYW5kIGV2ZW4gb2xmYWN0b3J5IGRldmljZXMgaW4gc29tZSBleHBlcmltZW50YWwgc2V0dXBzLgoKVGhlIGRlc2lnbiBhbmQgY2hvaWNlIG9mIG91dHB1dCBkZXZpY2VzIGFmZmVjdCB0aGUgdXNlcidzIHBlcmNlcHRpb24gYW5kIGludGVycHJldGF0aW9uIG9mIHRoZSBzeXN0ZW0ncyByZXNwb25zZXMuIFRoZSBvdXRwdXQgc2hvdWxkIGJlIHRhaWxvcmVkIHRvIHRoZSBjb250ZXh0IG9mIHVzZSwgdXNlcidzIGV4cGVjdGF0aW9ucywgYW5kIHRoZSBuYXR1cmUgb2YgdGhlIGluZm9ybWF0aW9uLiBGb3IgZXhhbXBsZSwgdmlzdWFsIGRpc3BsYXlzIGFyZSBnb29kIGZvciBwcmVzZW50aW5nIGRldGFpbGVkIGFuZCBjb21wbGV4IGluZm9ybWF0aW9uLCBidXQgYXVkaXRvcnkgb3V0cHV0IGNhbiBiZSBiZXR0ZXIgZm9yIGFsZXJ0cyBvciB3aGVuIHRoZSB1c2VyJ3MgdmlzdWFsIGF0dGVudGlvbiBpcyBvY2N1cGllZCBlbHNld2hlcmUuCgpCb3RoIGlucHV0IGFuZCBvdXRwdXQgZGV2aWNlcyBzaG91bGQgYmUgY29uc2lkZXJlZCBpbiB0aGUgbGlnaHQgb2YgYWNjZXNzaWJpbGl0eS4gU29tZSB1c2VycyBtYXkgaGF2ZSBsaW1pdGF0aW9ucyB0aGF0IHByZXZlbnQgdGhlbSBmcm9tIHVzaW5nIGNlcnRhaW4gdHlwZXMgb2YgZGV2aWNlcywgc28gcHJvdmlkaW5nIGFsdGVybmF0aXZlcyBpcyBjcnVjaWFsIHRvIG1ha2luZyB0aGUgc3lzdGVtIHVzYWJsZSBmb3IgYSB3aWRlIHJhbmdlIG9mIHBlb3BsZS4gVGhpcyBjYW4gbWVhbiBwcm92aWRpbmcgdGV4dC10by1zcGVlY2ggZm9yIHZpc3VhbGx5IGltcGFpcmVkIHVzZXJzLCBnZXN0dXJlLWJhc2VkIGlucHV0cyBmb3IgdXNlcnMgdW5hYmxlIHRvIHVzZSBhIGtleWJvYXJkIG9yIG1vdXNlLCBhbmQgc28gb24uCgpNb3Jlb3ZlciwgdGhlIGRlc2lnbiBvZiBIQ0kgc2hvdWxkIGFsc28gdGFrZSBpbnRvIGFjY291bnQgdGhlIGludGVncmF0aW9uIGFuZCBpbnRlcnBsYXkgb2YgbXVsdGlwbGUgaW5wdXQgYW5kIG91dHB1dCBkZXZpY2VzLCBhbHNvIGtub3duIGFzIG11bHRpbW9kYWwgaW50ZXJhY3Rpb24uIFRoaXMgcmVxdWlyZXMgYW4gdW5kZXJzdGFuZGluZyBvZiBob3cgZGlmZmVyZW50IGRldmljZXMgY2FuIGNvbXBsZW1lbnQgZWFjaCBvdGhlciB0byBwcm92aWRlIGEgbW9yZSBlZmZlY3RpdmUgYW5kIHJpY2ggaW50ZXJhY3Rpb24uIEZvciBpbnN0YW5jZSwgY29tYmluaW5nIHRvdWNoIGlucHV0IHdpdGggaGFwdGljIGZlZWRiYWNrIGNhbiBncmVhdGx5IGltcHJvdmUgdGhlIHVzYWJpbGl0eSBvZiBhIHZpcnR1YWwga2V5Ym9hcmQgb24gYSB0b3VjaHNjcmVlbiBkZXZpY2UuCgojIyBMZWN0dXJlCgpUaGUgbGVjdHVyZSBiZWxvdyBieSBEci4gU2NoZWRsYmF1ZXIgc3VtbWFyaXplcyB0aGUgY2hhcmFjdGVyaXN0aWNzIG9mIGlucHV0IGFuZCBvdXRwdXQgZGV2aWNlcyBmb3IgdGhlIGRlc2lnbiBvZiBpbnRlcmFjdGlvbnMgaW4gY29tcHV0ZXItaHVtYW4gaW50ZXJmYWNlcy4KCjxpZnJhbWUgc3JjPSJodHRwczovL3BsYXllci52aW1lby5jb20vdmlkZW8vODI5MTQ2MTY5P2g9MzFlZjBjZDQyOCZhbXA7dGl0bGU9MCZhbXA7YnlsaW5lPTAmYW1wO3BvcnRyYWl0PTAmYW1wO3NwZWVkPTAmYW1wO2JhZGdlPTAmYW1wO2F1dG9wYXVzZT0wJmFtcDtwbGF5ZXJfaWQ9MCZhbXA7YXBwX2lkPTU4NDc5IiB3aWR0aD0iNjQwIiBoZWlnaHQ9IjQ3OSIgZnJhbWVib3JkZXI9IjAiIGFsbG93PSJhdXRvcGxheTsgZnVsbHNjcmVlbjsgcGljdHVyZS1pbi1waWN0dXJlIiBhbGxvd2Z1bGxzY3JlZW4gdGl0bGU9IkludGVyYWN0aW9uIERldmljZXMgKGwtOTEtMzAyKSIgZGF0YS1leHRlcm5hbD0iMSI+Cgo8L2lmcmFtZT4KCioqU2xpZGUgRGVjayoqOiBbUy05MS0zMDIgSW50ZXJhY3Rpb24gRGV2aWNlc10ocy05MS0zMDItaW50ZXJhY3Rpb24tZGV2aWNlcy5wcHR4KQoKIyMgU3VtbWFyeSB7I3N1bW1hcnl9CgpJbiBzdW1tYXJ5LCB0aGUgcHVycG9zZSBvZiBpbnRlcmFjdGlvbiBkZXZpY2VzIGluIEhDSSBpcyB0byBlbmFibGUgYW5kIGVuaGFuY2UgaHVtYW4tY29tcHV0ZXIgY29tbXVuaWNhdGlvbi4gVGhleSBhcmUga2V5IGluIG1ha2luZyB0aGUgc3lzdGVtIG5vdCBqdXN0IGZ1bmN0aW9uYWwsIGJ1dCBhbHNvIGludHVpdGl2ZSwgc2F0aXNmeWluZywgYW5kIGFjY2Vzc2libGUgdG8gdXNlLiBBIGdvb2QgSENJIGRlc2lnbmVyIHNob3VsZCBoYXZlIGEgZGVlcCB1bmRlcnN0YW5kaW5nIG9mIG5vdCBqdXN0IHRoZSB0ZWNobmljYWwgYXNwZWN0cyBvZiB0aGVzZSBkZXZpY2VzLCBidXQgYWxzbyB0aGVpciBjb2duaXRpdmUsIGV4cGVyaWVudGlhbCwgYW5kIHNvY2lvY3VsdHVyYWwgaW1wbGljYXRpb25zLgoKLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgojIyBGaWxlcyAmIFJlc291cmNlcwoKYGBge3IgemlwRmlsZXMsIGVjaG89RkFMU0V9CnppcE5hbWUgPSBzcHJpbnRmKCJMZXNzb25GaWxlcy0lcy0lcy56aXAiLCAKICAgICAgICAgICAgICAgICBwYXJhbXMkY2F0ZWdvcnksCiAgICAgICAgICAgICAgICAgcGFyYW1zJG51bWJlcikKCnRleHRBTGluayA9IHBhc3RlMCgiQWxsIEZpbGVzIGZvciBMZXNzb24gIiwgCiAgICAgICAgICAgICAgIHBhcmFtcyRjYXRlZ29yeSwiLiIscGFyYW1zJG51bWJlcikKCiMgZG93bmxvYWRGaWxlc0xpbmsoKSBpcyBpbmNsdWRlZCBmcm9tIF9pbnNlcnQyREIuUgprbml0cjo6cmF3X2h0bWwoZG93bmxvYWRGaWxlc0xpbmsoIi4iLCB6aXBOYW1lLCB0ZXh0QUxpbmspKQpgYGAKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQoKIyMgUmVmZXJlbmNlcwoKU2huZWlkZXJtYW4sIEIuLCBQbGFpc2FudCwgQy4gKDIwMTApLiBEZXNpZ25pbmcgdGhlIFVzZXIgSW50ZXJmYWNlLCA1dGggRWRpdGlvbi4gQWRkaXNvbi1XZXNsZXkuCgpTY2hlZGxiYXVlciwgTS4gKDIwMTEpLiBJbnB1dCBEZXZpY2VzLiBUZWNobmljYWwgUmVwb3J0LCBVbml2ZXJzaXR5IG9mIE1hc3NhY2h1c2V0dHMgTG93ZWxsLgoKIyMgRXJyYXRhCgpbTGV0IHVzIGtub3ddKGh0dHBzOi8vZm9ybS5qb3Rmb3JtLmNvbS8yMTIxODcwNzI3ODQxNTcpe3RhcmdldD0iX2JsYW5rIn0uCg==