Multimodal analytics based on Artificial Intelligence

Artificial intelligence (AI) technologies, and in particular the deep learning paradigm, are advancing at an astounding pace and appear to have the potential to significantly enhance the capabilities in a wide range of applications. Multimodal analytics aim to uncover the structure underlying the multimodal information of interest and organise it in an effective and efficient manner thus allowing end users to gain insights and actionable intelligence. Our research activities include the development of AI-based methods for multimodal classification, clustering, social network analysis, event and trend detection, and predictive analytics based on deep learning and machine learning techniques, ranging from unsupervised to fully supervised.

PROJECTS

PUBLICATIONS

  1. R. Karlović, H. Nitsch, S. E. Fikenscher, D. Osterman, S. Menexis, T. Tsikrika, S. Vrochidis, I. Kompatsiaris,and A. Sahar (2022). "The Threat of Behavioral Radicalization Online: Conceptual Challenges and Technical Solutions Provided by the PROPHETS (Preventing Radicalization Online through the Proliferation of Harmonized ToolkitS) Project". In G. Markarian, R. Karlovic, H. Nitsch and K. Chandramouli (eds.) Security Technologies and Social Implications: A European Perspective. (accepted for publication).
  2. K. Pantelidou, D. Chatzakou, T. Tsikrika, S. Vrochidis, I. Kompatsiaris. "Selective Word Substitution for Contextualized Data Augmentation". In Proc. of the 27th International Conference on Natural Language & Information Systems (NLDB), Valencia, Spain, 15-17 June 2022, pp.508-516. OPEN ACCESS
  3. M. Sdraka, I. Papoutsis, B. Psomas, K. Vlachos, K. Ioannidis, K. Karantzalos, I. Gialampoukidis, S. Vrochidis, "Deep Learning for Remote Sensing Image Downscaling: Fusion and Super-Resolution", IEEE Geoscience and Remote Sensing Magazine, Pages: 2 - 55, 02 June 2022, DOI: 10.1109/MGRS.2022.3171836. OPEN ACCESS
  4. P. Kyriakidis, D. Chatzakou, T. Tsikrika, S. Vrochidis, I. Kompatsiaris, "Leveraging Transformer Self Attention Encoder for Crisis Event Detection in Short Texts", 44th European Conference on Information Retrieval (ECIR2022), Stavanger, Norway, April 10–14, 2022, Proceedings, Part II Apr 2022, pp. 163–171. DOI:https://doi.org/10.1007/978-3-030-99739-7_19. OPEN ACCESS
  5. P. Panagiotou, N. Mengidis, T. Tsikrika, S. Vrochidis, and I. Kompatsiaris. "Host-based Intrusion Detection Using Signature-based and AI-driven Anomaly Detection Methods." Information & Security: An International Journal 50, no. 1 (2021): 37-48. OPEN ACCESS
  6. P. Evangelatos, C. Iliou, T. Mavropoulos, K. Apostolou, T. Tsikrika, S. Vrochidis and I. Kompatsiaris,"Named Entity Recognition in Cyber Threat Intelligence Using Transformer-based Models", in the proceedings of the 2021 IEEE International Conference on Cyber Security and Resilience (IEEE CSR) – Workshops, Virtual Conference, July 26 (Mon) – 28 (Wed), 2021, pp. 348-353, DOI:10.1109/CSR51186.2021.9527981. OPEN ACCESS
  7. K. Ioannidis,G. Orfanidis, M. Krestenitis, S. Vrochidis, & I. Kompatsiaris, "Sensor Data Fusion and Autonomous Unmanned Vehicles for the Protection of Critical Infrastructures" , Terahertz (THz), Mid Infrared (MIR) and Near Infrared (NIR) Technologies for Protection of Critical Infrastructures Against Explosives and CBRN, Book Series: NATO Science for Peace and Security Series B: Physics and Biophysics, Springer Netherlands, 2021, 3-17. OPEN ACCESS
  8. B. Akhgar, M. Gercke, S. Vrochidis, H. Gibson (2021). Dark Web investigation. 288 Pages, Springer.
  9. Α. Tsanousa, V.R. Xefteris, D. Ntioudis, C. Chatzigeorgiou, G. Meditskos, S. Vrochidis, C. Patrikakis, I. Kompatsiris, "Localization module for missing child scenario in IoT safety domains", 39th International Conference on consumer Electronics (ICCE 2021), 10-12 January 2021. OPEN ACCESS
  10. A. Katmada, G. Kalpakis, T. Tsikrika, S. Vrochidis & Y. Kompatsiaris, "An extensible framework for interactive real-time visualizations of large-scale heterogeneous multimedia information from online sources", in Proceedings of the International Conference on Multimedia Modeling (MMM2020), Special Session on “Multimedia Analytics: Perspectives, Tools and Applications”, Daejeon, Korea, 5-8 January 2020.
  11. N. Mengidis, T. Tsikrika, S. Vrochidis, and I. Kompatsiaris. “Blockchain and AI for the Next Generation Energy Grids: Cybersecurity Challenges and Opportunities”. Information & Security: An International Journal 43, no. 1 (2019): 21-33, 15 January 2019. OPEN ACCESS
  12. G. Kalpakis, T. Tsikrika, S. Vrochidis, I. Kompatsiaris, "Identifying terrorism-related key actors in multidimensional social networks", in Proc. 25th Int. Conf. on Multimedia Modeling (MMM2019), Thessaloniki, Greece, Jan. 2019. OPEN ACCESS
  13. S. Vrochidis, A. Moumtzidou, I. Gialampoukidis, D. Liparas, G. Casamayor, L. Wanner, N. Heise, T. Wagner, A. Bilous, E. Jamin, B. Simeonov, V. Alexiev, R. Busch, I. Arapakis, I. Kompatsiaris. “A multimodal analytics platform for journalists analysing large-scale, heterogeneous multilingual and multimedia content”. Frontiers in Robotics and AI, 5, 123, 29 October 2018. OPEN ACCESS
  14. G. Kalpakis, T. Tsikrika, I. Gialampoukidis, S. Papadopoulos, S. Vrochidis, I. Kompatsiaris. "Analysis of Suspended Terrorism-Related Content on Social Media". In Community-Oriented Policing and Technological Innovations, Springer Briefs in Policing, Springer, 27 April 2018. OPEN ACCESS
  15. B. Akhgar, P. Bertrand, C. Chalanouli, T. Day, I. Fragkiadakis, H. Gibson, D. Kavallieros, E. Kermitsis, I. Kompatsiaris, E. Kyriakou, G. Leventakis, E. Lissaris, S. Mille, D. Myttas, T. Tsikrika, S. Vrochidis, U. Williamson. "TENSOR: Retrieval and Analysis of Heterogeneous Online Content for Terrorist Activity Recognition". Proceedings of the Estonian Academy of Se-curity Sciences: Secure Societies, 15 June 2017. OPEN ACCESS
  16. I. Gialampoukidis, G. Kalpakis, T. Tsikrika, S. Papadopoulos, S. Vrochidis, I. Kompatsiaris, "Detection of Terrorism-related Twitter Communities using Centrality Scores", in Proceedings of International Workshop on Multimedia Forensics and Security (MFSec 2017), Bucharest, Romania, June 06, 2017. OPEN ACCESS
  17. G. Kalpakis, T. Tsikrika, N. Cunningham, C. Iliou, S. Vrochidis, J. Middleton, I. Kompatsiaris. "OSINT and the Dark Web". In Open Source Intelligence Investigation - From Strategy to Implementation, B. Akhgar, P. S. Bayerl, F. Sampson (Eds.), Springer, 3 January 2017. OPEN ACCESS
  18. I. Gialampoukidis, D. Liparas, S. Vrochidis, I. Kompatsiaris, "Query-based Topic Detection Using Concepts and Named Entities", in 1st International Workshop on Multimodal Media Data Analytics (MMDA 2016), The Hague, Netherlands, August 30, 2016.
  19. S. Vrochidis, M. Melero, L. Wanner, J. Grivolla, Y. Esteve (Eds.). (2016). Proceedings of the 1st International Workshop on Multimodal Media Data Analytics co-located with the 22nd European Conference on Artificial Intelligence (ECAI 2016). The Hague, Netherlands, 30 August, 2016, CEUR, Vol 1801.
  20. S. Vrochidis, I. Kompatsiaris, G. Casamayor, I. Arapakis, R. Busch, V. Alexiev, E. Jamin, M. Jugov, N. Heise, T. Forrellat, D. Liparas, L. Wanner, I. Miliaraki, V. Aleksic, K. Simov, A. M. Soro, M. Eckhoff, T. Wagner, M. Puigbo,"MULTISENSOR: Development of Multimedia Content Integration Technologies for Journalism, Media Monitoring and International Exporting Decision Support", in 2015 IEEE International Conference on Multimedia and Expo (ICME 2015), Turin, Italy, June 29 - July 3, 2015.