V4Design

Visual and textual content re-purposing FOR(4) architecture, Design and video virtual reality games

V4Design promotes the re-use of visual and textual content, such as documentaries, paintings and their critiques so as to be repurposed and be used for the inspiration of architecture and video game (VR) designing. Visual content analysis is performed through 3D reconstruction and modelling, localization of objects in visual data, automated extraction of aesthetics/style information and language understanding from visual and textual data. 3D objects are also enhanced with semantics and explanatory text descriptions.

V4Design will develop a platform that provides architects, video game creators and designers of any expertise with innovative tools necessary to enhance and simplify the creative phase of the designing process. The main idea behind V4Design is to reuse (i) visual: movies, documentaries paintings and images from other artwork and (ii) textual content: from textual documentations in films, critics, catalogues, museum guides, and re-purpose it in order in a way that will be useful for architecture and video game designers.

MKLab as a department of the Centre for Research and Technology Hellas (CERTH), Greece, coordinates the project with universities and companies from eight different countries.

PUBLICATIONS

  1. Batziou, E., Ioannidis, K., Patras, I., Vrochidis, S., & Kompatsiaris, I. (2023). Artistic neural style transfer using CycleGAN and FABEMD by adaptive information selection. Pattern Recognition Letters, 165, 55-62. DOI:https://doi.org/10.1016/j.patrec.2022.11.026.
  2. S. Symeonidis, G. Meditskos, S. Vrochidis, K. Avgerinakis, J. Derdaele, M. Vergauwen, M. Bassier, A. Moghnieh, L. Fraguada, V. Vogler, Y. Shekhawat, L. Wanner, M. Marimon, K. Valsamidou, P. Koulali, A. Tellios, J. Wuyts, E. Lopez, "V4Design: Intelligent analysis and integration of multimedia content for Creative Industries", in IEEE Systems Journal, 2022, DOI:10.1109/JSYST.2022.3217655
  3. J. Lokoč, P. Veselý, F. Mejzlík, G. Kovalčík, T. Souček, K. Schoeffmann, W. Bailer, C. Gurrin, L. Sauter, J. Song, S. Vrochidis, J. Wu, B. Þór Jónsson. “Is the Reign of Interactive Search Eternal?Findings from the Video Browser Showdown 2020”. Transactions on Multimedia Computing Communications and Applications, Volume 17, Issue 3, August 2021, Article No.: 91pp 1–26. DOI:https://doi.org/10.1145/3445031.
  4. S. Andreadis, A. Moumtzidou, K. Gkountakos, N. Pantelidis, K. Apostolidis, D. Galanopoulos, I. Gialampoukidis, S. Vrochidis, V. Mezaris, I. Kompatsiaris, "VERGE in VBS 2021", Proc. 27th Int. Conf. on Multimedia Modeling (MMM2021), Prague, CZ, Springer LNCS vol. 12573, pp. 398–404, 22-24 June 2021. DOI:10.1007/978-3-030-67835-7_35 OPEN ACCESS
  5. M. Rousi, G. Meditskos, S. Vrochidis, I. Kompatsiaris,“Supporting the Discovery and Reuse of Digital Content in Creative Industries using Linked Data”, 15th IEEE International Conference on Semantic Computing, (ICSC 2021), 27-29 January, 2021. http://dx.doi.org/10.1109/ICSC50631.2021.00025
  6. E. Batziou, P. Alvanitopoulos, K. Ioannidis, I. Patras, S. Vrochidis, I. Kompatsiaris, ''Cycle-Consistent Adversarial Networks and Fast Adaptive Bi-dimensional Empirical Mode Decomposition for Style Transfer'', in 25th International Conference on Pattern Recognition (ICPR2020), 10 & 15 January 2021, Milan, Italy.
  7. S. Mille, S. Symeonidis, M. Rousi, M. Marimon Felipe, K. Stavrothanasopoulos, P. Alvanitopoulos, R. Carlini Salguero, J. Grivolla, G. Meditskos, S. Vrochidis and L. Wanner, "A Case Study of NLG from Multimedia Data Sources: Generating Architectural Landmark Descriptions", in WebNLG+: 3rd Workshop on Natural Language Generation from the Semantic Web, (INLG 2020), 15-18 December 2020. OPEN ACCESS
  8. K. Gkountakos, K. Ioannidis, S. Vrochidis, I. Kompatsiaris, "ITI-CERTH participation in TRECVID 2019", Proc. TRECVID 2019 Workshop, Gaithersburg, MD, USA, Nov. 2019. OPEN ACCESS
  9. P. Giannakeris, G. Meditskos, K. Avgerinakis, S. Vrochidis, I. Kompatsiaris, "Real-time Recognition of Daily Actions based on 3D Joint Movements and Fisher Encoding", in International Conference on Multimedia Modeling (MMM2020), Daejeon, Korea, 5-8 January 2020. OPEN ACCESS
  10. A. Tsanousa, A. Chatzimichail, G. Meditskos, S. Vrochidis, I. Kompatsiaris, "Model-based and Class-based Fusion of Multisensor Data", in the Medical Domain and Pervasive Environments (MULTIMED2020), International Conference on Multimedia Modeling (MMM2020), Daejeon, Korea, 5-8 January 2020. OPEN ACCESS
  11. A. Katmada, G. Kalpakis, T. Tsikrika, S. Vrochidis & Y. Kompatsiaris, "An extensible framework for interactive real-time visualizations of large-scale heterogeneous multimedia information from online sources", in Proceedings of the International Conference on Multimedia Modeling (MMM2020), Special Session on “Multimedia Analytics: Perspectives, Tools and Applications”, Daejeon, Korea, 5-8 January 2020.
  12. S. Andreadis, A. Moumtzidou, K. Apostolidis, K. Gkountakos, D. Galanopoulos, E. Michail, I. Gialampoukidis, S. Vrochidis, V. Mezaris, I. Kompatsiaris, "VERGE in VBS 2020", Proc. 26th Int. Conf. on Multimedia Modeling (MMM2020), 5-8 January 2020, Daejeon Convention Center (DCC), Korea OPEN ACCESS
  13. G. Meditskos, S. Vrochidis, I. Kompatsiaris, "V4Ann: Representation and Interlinking of Atom-based Annotations", In: Acosta M., Cudre-Mauroux P., Maleshkova M., Pellegrini T., Sack H., Sure-Vetter Y. (eds) Semantic Systems. The Power of AI and Knowledge Graphs. SEMANTiCS 2019. Lecture Notes in Computer Science, vol 11702, pp 124-139, 2019. Springer, Cham. https://doi.org/10.1007/978-3-030-33220-4_10
  14. J. Lokoc, G. Kovalcik, B. Munzer, K. Schoffmann, W. Bailer, R. Gasser, S. Vrochidis, P. Anh Nguyen, S. Rujikietgumjorn, K. Uwe Barthel. “Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018”. ACM Transactions on Multimedia Computing, Communications, and Applications 1 February 2019. OPEN ACCESS
  15. S. Andreadis, A. Moumtzidou, D. Galanopoulos, F. Markatopoulou, K. Apostolidis, T. Mavropoulos, I. Gialampoukidis, S. Vrochidis, V. Mezaris, I. Kompatsiaris, I. Patras, "VERGE in VBS 2019", Proc. 25th Int. Conf. on Multimedia Modeling (MMM2019), Thessaloniki, Greece, Springer LNCS vol. 11296, pp. 602-608, Jan. 2019. OPEN ACCESS
  16. K. Avgerinakis, A. Moumtzidou, D. Galanopoulos, G. Orfanidis, S. Andreadis, F. Markatopoulou, E. Batziou, K. Ioannidis, S. Vrochidis, V. Mezaris, I. Kompatsiaris, "ITI-CERTH participation in TRECVID 2018", in Proc. TRECVID 2018 Workshop, Gaithersburg, MD, USA, Nov. 2018. OPEN ACCESS
  17. E. Batziou, E. Michail, K. Avgerinakis, S. Vrochidis, I. Patras, and I. Kompatsiaris, "Visual and Audio Analysis of Movies Video for Emotion Detection@ Emotional Impact of Movies Task MediaEval 2018", in MediaEval. 2018. OPEN ACCESS
  18. S. Vrochidis, A. Moumtzidou, I. Gialampoukidis, D. Liparas, G. Casamayor, L. Wanner, N. Heise, T. Wagner, A. Bilous, E. Jamin, B. Simeonov, V. Alexiev, R. Busch, I. Arapakis, I. Kompatsiaris. “A multimodal analytics platform for journalists analysing large-scale, heterogeneous multilingual and multimedia content”. Frontiers in Robotics and AI, 5, 123, 29 October 2018. OPEN ACCESS
  19. P. Giannakeris, K. Avgerinakis, S. Vrochidis, I. Kompatsiaris, "Activity Recognition from Wearable Cameras", 2018 International Conference on Content-Based Multimedia Indexing (CBMI), 4-6 Sept. 2018. OPEN ACCESS
  20. I. Gialampoukidis, A. Moumtzidou, S. Vrochidis and Y. Kompatsiaris, "Fusion of Compound Queries with Multiple Modalities for Known Item Video Search", in 13th Workshop on IEEE Image, Video, and Multidimensional Signal Processing (IVMSP 2018), 10-12 June 2018, Zagori, Greece. OPEN ACCESS
  21. A. Moumtzidou, S. Andreadis, F. Markatopoulou, D. Galanopoulos, I. Gialampoukidis, S. Vrochidis, V. Mezaris, I. Kompatsiaris, I. Patras, "VERGE IN VBS 2018", in International Conference on Multimedia Modeling 2018. OPEN ACCESS