REA

According to the World Health Organization (WHO), there are currently more than 1 billion people worldwide (about one in seven) who have some form of disability. It is estimated that over 150 million adults worldwide face serious movement issues and are not functionally independent. Care and rehabilitation are important factors in maintaining and improving the quality of life of people with physical or mental injuries. At the same time, they have important short-term and long-term economic implications for both individuals and their families, as well as for the health system and society.

With the aim of upgrading the monitoring and support technologies currently used in clinical and non-clinical rehabilitation and patient care environments, the goal of the project is to develop an innovative interconnected virtual agent with enhanced interactive and knowledge skills through natural and multimodal human and technology interaction. Assisted living technologies combined with intelligent interfaces and advanced dialogue systems can provide supportive technologies in homes and clinics, significantly improving the quality of life of individuals. Indicative examples are the use of multimodal sensors to monitor biometric indications and behaviors (e.g. heart pressure and heartbeats), as well as user voice interaction with intelligent agents acting as personal assistants, reminding exercises, drug dosages, etc.

The main objective of the project is to provide innovative solutions and support services: a) In hospitals, rehabilitation centers and clinics, providing up-to-date and innovative real-time patient monitoring services through fusion and interconnection of information on integrated, valid and personalized decision-making provided care, b) In non-hospital settings, acting as a personal interactive assistant providing innovative voice-based information services on issues related to the daily life of patients (nutrition and medication), remote monitoring services, and initiating customized and personalized dialogues with a positive impact to their mental health and satisfaction.

PUBLICATIONS

  1. V.R. Xefteris, A. Tsanousa, T. Mavropoulos, G. Meditskos, S. Vrochidis, I. Kompatsiaris, Human activity recognition with IMU and vital signs feature fusion. In Proceedings of the 28th International Conference on Multimedia Modelling (MMM2022), Phu Quoc, Vietnam, June 6–10, 2022, Pages 287–298. DOI: https://doi.org/10.1007/978-3-030-98358-1_23.
  2. V. -R. Xefteris, A. Tsanousa, G. Meditskos, S. Vrochidis and I. Kompatsiaris, "Performance, challenges, and limitations in multimodal fall detection systems: a review," in IEEE Sensors Journal, DOI:10.1109/JSEN.2021.3090454. OPEN ACCESS
  3. P. Giannakeris, A. Tsanousa, A. Mavropoulos, G. Meditskos, S. Vrochidis, I. Kompatsiaris, "Fusion of Multimodal Sensor Data for Effective Human Action Recognition in the Service of a Medicine-Oriented Platform", Special Session on MULTIMED2021: Multimedia and Multimodal Analytics in the Medical Domain and Pervasive Environments, In Proceedings of the 27th International Conference on Multimedia Modelling (MMM2021), in Prague, Czech Republic, 22-24 June, 2021. DOI:10.1007/978-3-030-67832-6. OPEN ACCESS
  4. T. Mavropoulos, S. Symeonidis, A. Tsanousa, P. Giannakeris, M. Rousi, E. Kamateri, G. Meditskos, K. Ioannidis, S. Vrochidis, I. Kompatsiaris "Smart integration of sensors, computer vision and knowledge representation for intelligent monitoring and verbal human-computer interaction", Journal of Intelligent Information Systems, Springer, 2021, pages321–345.
  5. A. Tsanousa, G. Meditskos, S. Vrochidis, L. Angelis. "A novel feature selection method based on comparison of correlations for human activity recognition problems". Journal of Ambient Intelligence and Humanized Computing, 6 March 2020. OPEN ACCESS
  6. P. Giannakeris, G. Meditskos, K. Avgerinakis, S. Vrochidis, I. Kompatsiaris, "Real-time Recognition of Daily Actions based on 3D Joint Movements and Fisher Encoding", in International Conference on Multimedia Modeling (MMM2020), Daejeon, Korea, 5-8 January 2020. OPEN ACCESS
  7. A. Tsanousa, A. Chatzimichail, G. Meditskos, S. Vrochidis, I. Kompatsiaris, "Model-based and Class-based Fusion of Multisensor Data", in the Medical Domain and Pervasive Environments (MULTIMED2020), International Conference on Multimedia Modeling (MMM2020), Daejeon, Korea, 5-8 January 2020. OPEN ACCESS
  8. T. Mavropoulos, G. Meditskos, E. Kamateri, M. Rousi, S. Symeonidis, D. Tzimikas, L. Papageorgiou, C. Eleftheriadis, G. Adamopoulos, S. Vrochidis, I. Kompatsiaris. “A context-aware conversational agent in the rehabilitation domain”. Special Issue “Intelligent Innovations in Multimedia Data”, Future Internet 1 November 2019, 11(11), 231.
  9. E. Kamateri, G. Meditskos, S. Symeonidis, S. Vrochidis, I. Kompatsiaris, W. Minker, "Knowledge-based Intelligence and Strategy Learning for Personalised Virtual Assistance in the Healthcare Domain", Semantic Technologies for Healthcare and Accessibility Applications (SyMpATHY), special session in the 13th International Conference on Advances in Semantic Processing (SEMAPRO), 2019.
  10. A. Tsanousa, G. Meditskos, S. Vrochidis, I. Kompatsiaris, "A Weighted Late Fusion Framework for Recognizing Human Activity from Wearable Sensors", 10th International Conference on Information, Intelligence, Systems and Applications, 15-17 July 2019. OPEN ACCESS
  11. T. Mavropoulos, G. Meditskos, E. Kamateri, S. Symeonidis, D. Tzimikas, L. Papageorgiou, C. Eleftheriadis, G. Adamopoulos, S. Vrochidis, I. Kompatsiaris, "A Smart Dialogue-competent Monitoring Framework Supporting People in Rehabilitation", in Multimodal Signal Sensing and Analysis for Assistive Environments for Improving Quality-Of-Life (AGENT Workshop), 12th Pervasive Technologies Related to Assistive Environments Conference (PETRA’19). ACM, Rhodes, Greece, June 5-7, 2019. OPEN ACCESS
  12. T. Mavropoulos, G. Meditskos, E. Kamateri, S. Vrochidis and I. Kompatsiaris, "REA: A Healthcare-Oriented Virtual Agent with Dialogue Capabilities", 8th Panhellenic Conference on Biomedical Technology, Hellenic Society for Biomedical Technology (ELEVIT), 9-10 May, Athens, Greece, 2019. OPEN ACCESS
  13. G. Meditskos, E. Kontopoulos, S. Vrochidis, I. Kompatsiaris. “Converness: Ontology-driven Conversational Awareness and Context Understanding in Multimodal Dialogue Systems”. Expert Systems, Special Issue on e-Health and Staying Smarter, 1 February 2019. OPEN ACCESS