Multi-Device Applications Using the Multimodal Architecture
Nowadays, users have access to a multitude of devices at their homes, workplaces or that they can carry around. Each of these devices, given its features (e.g., interaction modalities, screen size), might be more suitable for particular users, tasks, and
- PDF / 479,604 Bytes
- 17 Pages / 439.37 x 666.142 pts Page_size
- 65 Downloads / 261 Views
Multi-Device Applications Using the Multimodal Architecture Nuno Almeida, Samuel Silva, Anto´nio Teixeira, and Diogo Vieira
Abstract Nowadays, users have access to a multitude of devices at their homes, workplaces or that they can carry around. Each of these devices, given its features (e.g., interaction modalities, screen size), might be more suitable for particular users, tasks, and contexts. While having one application installed in several devices might be common, they mostly work isolated, not exploring the possibilities of several devices working together to provide a more versatile and richer interaction scenario. Adopting a multimodal interaction (MMI) architecture based on the W3C recommendations, beyond the advantages to the design and development of MMI, provides, we argue, an elegant approach to tackle multi-device interaction scenarios. In this regard, this chapter conveys our views and research outcomes addressing this subject, presenting concrete application examples.
17.1
Introduction
Mobile devices, smart TVs, media centers, and game boxes are widespread and used on a daily basis by millions around the world. These devices are important means for providing users with applications and services that support many aspects of their personal and professional life. Multimodal interaction (MMI) is a common feature for many of them. Each of these devices presents a set of characteristics (e.g., mobile nature and available input and output modalities) that make them more suitable for particular contexts, and being able to seamlessly change from one device to another while performing a task, commuting among environments (e.g., from a smartphone on the street to a tablet at home), following the concept of migratory interfaces [1], would provide a desirable degree of flexibility and user adaptation. In addition, multiple devices, if used together, can provide new means for interacting with an application, whether providing complementary features to a
N. Almeida • S. Silva (*) • A. Teixeira • D. Vieira DETI—Department of Electronics, Telecommunications and Informatics, IEETA—Institute of Electronics and Informatics of Aveiro, University of Aveiro, Campus Universita´rio de Santiago, Aveiro, Portugal e-mail: [email protected] © Springer International Publishing Switzerland 2017 D.A. Dahl (ed.), Multimodal Interaction with W3C Standards, DOI 10.1007/978-3-319-42816-1_17
367
368
N. Almeida et al.
single user or supporting collaboration among users. The output modalities should also be able to provide feedback in multiple ways, adapting to the current device ecosystem, with the information made available in one device potentially adding to the contents provided by other accessible devices. Therefore, the coexistence of multiple devices and applications provides (and demands) new interaction possibilities, posing challenges regarding how different devices can be used simultaneously to access a specific application, taking the most out of each device features (e.g., screen size) and sharing input and output modalitie
Data Loading...
