Multimodal Technologies and Interaction (Journal)

  • Vassilis Charissis (Guest editor)

    Activity: Publication peer-review and editorial workEditorial activity


    In recent years, an explosion of health-related ubiquitous computing technologies has enabled the quantification of human behaviour, physiological conditions, condition management and lifestyle choices at an unprecedented scale. Consumer-grade electronics such as wearable fitness and bio-signal trackers, connected exercise and health indicator measurement equipment, provide inexpensive and aesthetically and socially acceptable ways of monitoring one’s health, generating vast quantities of data for the benefit of individuals and clinicians. At the same time, to allow the exploration and exploitation of these masses of data, software and services such as mobile and smartwatch apps, cater for the users’ curiosity and the practicalities of managing one’s health. Additionally, emerging technologies such as VR/AR are gradually employed to offer immersive interaction for health-related training and remote consultation applications that present succinctly complex and rich information. In this emerging landscape, which is currently fragmented across a variety of competing technologies, standards and interaction / information visualization paradigms, the average user can often get lost in the terminology, the sheer volume of data (compared to actionable knowledge), and technological barriers they may face when interacting with mobile health systems. Such barriers can have disproportionately significant negative impacts for those people most at need of these technologies. At the same time, for large parts of the population without easy access to medical services, mobile healthcare applications can provide a critical lifeline, but one that comes without the human touch, expertise, clinical judgement or even assurance of accountability and transparency that healthcare professionals can offer, and which is typically absent in ML-based systems. The purpose of this special issue is to bring to the fore new paradigms for interaction with smart mobile healthcare technology. We invite contributions in an effort to consolidate existing research in best interaction practice, as well as to provoke and set new boundaries for future research in this theme, along the following, non-limiting list of topics: Information visualization and presentation in mobile and wearable health applications, with emphasis on the intelligibility and contextually relevant actionability of prompts Attention, interruption, incentivization and reminders in mobile healthcare systems Multimodal interaction with ubiquitous healthcare systems, including whole-body, physical gesture, tactile, tangible, audio and speech interfaces Interacting with Augmented and Virtual Reality (AR/VR) applications in healthcare settings Human-robot and human-AI interaction for healthcare and wellbeing Managing trust and credibility of the information shared between users, systems and clinicians Methods and tools for requirement elicitation, UX and system co-design or multidisciplinary collaboration in the development of mobile healthcare applications Methodologies, protocols, tools and best practices in organising and conducting laboratory and field studies of mobile health applications Usability studies of mobile health systems with special population target groups Prof. Vassilis Charissis Guest Editor
    Period1 Jun 20189 Jan 2019
    Type of journalJournal


    • Human Computer Inteaction
    • Virtual Reality
    • Healthcare
    • Multimodal
    • Mobile Applications
    • Human Robot Interaction
    • Human AI Interaction
    • Artificial Intelligence
    • Augmented Reality