CALLISTO

Copernicus Artificial Intelligence Services and data fusion with other distributed data sources and processing at the edge to support DIAS and HPC infrastructures

Artificial Intelligence (AI) is already part of our lives and is extensively entering the space sector to offer value-added Earth Observation (EO) products and services. CALLISTO project integrates Copernicus data, already indexed in DIAS platforms such as ONDA-DIAS, utilising High Performance Computing infrastructures for enhanced scalability when needed. Complementary distributed data sources involve Galileo positioning data, visual content from UAVs, Web and social media data linking them with open geospatial data, in-situ sensor data. On top of these data sources, AI methods are applied to extract meaningful knowledge such as concepts, changes, activities, events, 3D-models, videos and animations of the user community. AI methods are also executed at the edge, offering enhanced scalability and timely services. The analysis of the extracted knowledge is performed in a semantic way and the associated analytics are delivered to the end users in non-traditional interfaces, including Augmented Reality, Virtual Reality and Mixed Reality in general. Data fusion among several types of data sources is provided on-demand, based on the end user requirements. The AI methods are trained to offer new virtual and augmented reality applications to water utility operators, journalists for the media sector, EU agriculture and CAP policymakers, and security agencies.

 

CERTH is responsible for the management of scientific and technical aspects of the CALLISTO project and leads a WP for data fusion, information retrieval, 3D-model reconstruction, and optimisation of HPC infrastructures. In addition, CERTH leads the tasks for social media data collection, change detection in land border based on satellite and UAV visual content, and named-entity recognition from text for geo-referencing and linking with open geodata.

PUBLICATIONS

  1. M. Pegia, F. A. López, A. Moumtzidou, A. Gutierrez-Torre, B. Þór Jónsson, J. Lluís Berral-García, I. Gialampoukidis, S. Vrochidis, I. Kompatsiaris, "Time-Quality Tradeoff of MuseHash Query Processing Performance", in Proceedings of the 30th International Conference on Multimedia Modeling (MMM 2024), Amsterdam, The Netherlands, January 29 - February 2, 2024. OPEN ACCESS
  2. M. Pegia, B. Þ. Jónsson, A. Moumtzidou, I. Gialampoukidis, S. Vrochidis, and I. Kompatsiaris, ”MuseHash: Super- vised Bayesian Hashing for Multimodal Image Representation” in ACM ICMR ’23: ACM International Conference on Multimedia Retrieval, June 10– 15, 2023, Thessaloniki, Greece. Proceedings of the 2023 ACM International Conference on Multimedia Retrieval, pp. 434–442, https://doi.org/10.1145/3591106.3592228. OPEN ACCESS
  3. Stelios Andreadis, Ilias Gialampoukidis, Andrea Manconi, David Cordeiro, Vasco Conde, Manuela Sagona, Fabrice Brito, Nick Pantelidis, Thanassis Mavropoulos, Nuno Grosso, Stefanos Vrochidis, Ioannis Kompatsiaris (2022). Earthquakes: From Twitter detection to EO data processing. IEEE Geoscience and Remote Sensing Letters, 19, 1-5. OPEN ACCESS
  4. A. Oikonomidis, M. Pegia, A. Moumtzidou, I. Gialampoukidis, S. Vrochidis, I. Kompatsiaris, "Fusion of multiple classifiers using self supervised learning for satellite image change detection" 2023, In Proceedings of the 29th International Conference on Multimedia Modeling (MMM 2023), 9 - 12 January 2023, Bergen, Norway (accepted for poster presentation)
  5. N. Pantelidis, S. Andreadis, M. Pegia, A. Moumtzidou, D. Galanopoulos, K. Apostolidis, D. Touska, K. Gkountakos, I. Gialampoukidis, S. Vrochidis, V. Mezaris, and I. Kompatsiaris, “VERGE in VBS 2023” in MultiMedia Modeling: 29th International Conference. MMM 2023, Bergen, Norway, January 9–12, 2023, Proceedings, Part I. Springer-Verlag, Berlin, Heidelberg, 2023, pp. 658–664. https://doi.org/10.1007/978-3-031-27077-2_55. OPEN ACCESS
  6. M. Pegia, A. Moumtzidou, I.Gialampoukidis, B. T. Johnsson, S. Vrochidis, and I. Kompatsiaris “BiasUNet: Learning Change Detection over Sentinel-2 Image Pairs” in proceedings of the 19th International Conference on Content-based Multimedia Indexing (CBMI 2022), 14-16 September 2022, Graz, Austria. OPEN ACCESS
  7. S. Andreadis, M. Elias, T. Mavropoulos, C. Papadopoulos, N. Pantelidis, I. Gialampoukidis, S. Vrochidis, and I. Kompatsiaris, "SPARQL querying for validating the usage of automatically georeferenced social media data as human sensors for air quality". In Proceedings of the 2022 IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP 2022), 26-29 June 2022, Nafplio, Greece. DOI: 10.1109/IVMSP54334.2022.9816191
  8. M. Pegia, A. Moumtzidou, I.Gialampoukidis, B. T. Johnsson, S. Vrochidis, and I. Kompatsiaris "BiasHash: A Bayesian Hashing Framework for Image Retrieval", In the proceedings of the 2022 IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP 2022), 26-29 June 2022, Nafplio, Greece. DOI: 10.1109/IVMSP54334.2022.9816233
  9. I. Gialampoukidis, S. Andreadis, N. Pantelidis, S. Hayat, L. Zhong, M. Bakratsas, D. Hoppe, S. Vrochidis, and I. Kompatsiaris, "Parallel DBSCAN-Martingale estimation of the number of concepts for automatic satellite image clustering", In Proceedings of the 28th International Conference on Multimedia Modelling (MMM2022), Phu Quoc, Vietnam, 6-10 June, 2022. OPEN ACCESS
  10. M. Sdraka, I. Papoutsis, B. Psomas, K. Vlachos, K. Ioannidis, K. Karantzalos, I. Gialampoukidis, S. Vrochidis, "Deep Learning for Remote Sensing Image Downscaling: Fusion and Super-Resolution", IEEE Geoscience and Remote Sensing Magazine, Pages: 2 - 55, 02 June 2022, DOI: 10.1109/MGRS.2022.3171836. OPEN ACCESS
  11. T. Papadimos, S. Andreadis, V. Sitokonstantinou, A. Koukos, G. Choumos, I. Gialampoukidis, S. Vrochidis, C. Kontoes and I. Kompatsiaris, "Filling Cloud Gaps on Optical Time-Series through Optical and SAR Data Fusion for Cropland Monitoring". In Proceedings of the 2022 Living Planet Symposium, 23-27 May 2022, Bonn, Germany. OPEN ACCESS
  12. T. Papadimos, N. Pantelidis, S. Andreadis, A. Bozas, I. Gialampoukidis, S. Vrochidis, and I. Kompatsiaris, "Real-time Alert Framework for Fire Incidents Using Multimodal Event Detection on Social Media Streams". In Proceedings of the 19th International Conference on Information Systems for Crisis Response and Management, 22-25 May 2022, Tarbes, France. OPEN ACCESS © © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
  13. S. Andreadis, I. Gialampoukidis, A. Manconi, D. Cordeiro, V. Conde, M. Sagona, F. Brito, N. Pantelidis, T. Mavropoulos, N. Grosso, S. Vrochidis and I. Kompatsiaris, "Earthquakes: from Twitter detection to EO data processing", In the proceedings of the 5th International Conference on Dynamics of Disasters (DOD 2021), Virtual, 15-18 July 2021.
  14. I. Gialampoukidis, S. Andreadis, S. Vrochidis, and I. Kompatsiaris, "Multimodal data fusion of social media and satellite images for emergency response and decision-making", 2021 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2021), 11 July 2021, Online, pp. 228-231, IEEE. OPEN ACCESS
  15. S. Andreadis, I. Gialampoukidis, V. Sitokonstantinou, B. Coloru, H. Vervaeren, E. López, V. Kalogirou, P. Syropoulou, E. B. Kosmatopoulos, S. Vrochidis, E. Li Santi, G. Vingione, I. Kompatsiaris, "CALLISTO: Copernicus Artificial Intelligence Services and data fusion with other distributed data sources and processing at the edge to support DIAS and HPC infrastructures",In Proceedings of the Big Data from Space 2021,Virtual, 18-20 May 2021. OPEN ACCESS