Knowledge Representation and Reasoning – Multimodal Data Fusion and Analytics Group

HARMONICA

HARMONICA HUMAN-MACHINE KNOWLEDGE, SKILLS, AND DEXTERITY HYBRID AUGMENTATION IN ADVANCED RECYCLING MANUFACTURING Workers in advanced recycling manufacturing face a variety of risks. These include exposure to hazardous chemicals, dust, and biological agents, in addition to physical hazards associated with heavy machinery and repetitive movements. These risks can lead to respiratory problems, skin irritation, physical injuries, and chronic health issues. HARMONICA’s unique vision is to transform current cognitive and physical augmentation technologies into more supportive tools for operators within the contexts of hazardous environments such as advanced recycling manufacturing. To do this, HARMONICA starts from a human centric perspective, enabled by digital twin modelling. This will enhance the safety and efficiency of human operators in dynamics and hazardous environments through a Psy-PhyTwin, which embeds cognitive and physical submodels of workers into…

BIOSMATER

BIOSMATER Re-designing the construction sector: Sustainable and functional bio-based construction products and building elements The BIOS MATER aims to develop and demonstrate advanced bio-based construction products and building elements with tailored functional properties such as durability, fire resistance, water barriers, acoustic and thermal insulation, lightweight structure, mechanical strength, and antimicrobial features, ensuring safety and sustainability. At the core of the concept are the four Production routes which are built around four pillars. Specifically: Production route A will focus on the development of bio-based core products and sandwich structure for flooring applications, Production route B will focus on the development of bio-based wall panels and flooring tiles, Production route C will focus on the development of fiber reinforced bio-resin composite panels applied as exterior façade cladding panels and Production route D…

IDEATION

IDEATION InlanD watErs in the digitAl Twin OceaN IDEATION (InlanD watErs in the digitAl Twin OceaN) aims to develop a digital twin of inland waters (rivers, lakes, reservoirs, wetlands, snow, and ice). The project focuses on activities to ensure this digital twin is integrated and interoperable with the Digital Twin Ocean (DTO), creating a unified digital twin of the ocean and waters, thereby addressing the hydrosphere as a whole. IDEATION will rely on cross-border cooperation and the involvement and commitment of stakeholders at the European level by following the Water-oriented Living Labs (WoLLs) approach. Stakeholders will be engaged via Multi-Stakeholder Forums (MSF) using various engagement methodologies, such as focus groups, workshops, interviews, and questionnaires, tailored to the goals of the engagement and the context specificities. A comprehensive review will be…

TeamUP

TeamUP Holistic Capability and Technology Evaluation and Co-creation Framework for Upskilled First Responders and Enhanced CBRN-E Response Countries worldwide, amid threats and incidents targeting civilians, invest in reinforcing their CBRN-E related capabilities. In Europe and in most cases, the teams responding first are not trained specifically, nor equipped sufficiently to face the kind of hazards, to provide assistance to victims and to follow the decontamination processes that a CBRN-E incident implies. At the same time, resources are limited, exercises and trainings are siloed per organization, lacking of proven procedures, and digital tools. A step-by-step approach needs to include (1) detection of the CBRN-E threat, (2) triage of casualties and (3) on-site decontamination before the provision of medical aid. TeamUP addresses these challenges by developing an innovative toolkit for the detection,…

CVDLINK

CVDLINK A federated paradigm of real-world data sources utilization for the empowerment of diagnosis, prognosis and risk assessment of cardiovascular conditions The CVDLINK project is dedicated to addressing the significant challenge of cardiovascular disease (CVD) within the EU, where over 6 million new cases and 1.8 million deaths are reported annually. Recognizing the urgent need for effective prevention strategies, CVDLINK employs a scientific approach aimed at transforming the management, treatment and research of cardiovascular disease through data-driven innovation. The project aims to tackle challenges related to data availability and management by implementing a privacy-by-design European-wide federated platform-as-a-service (PaaS). The goal is to deliver effective data-driven human-centric interventions and the advancement of research and management in the CVD domain. An essential part of the project is the development and implementation of…

SINCERE

SINCERE The second life of modern period architecture: Resilient and adaptive renovation towards net-zero carbon heritage buildings Today, 19th and 20th c. modern period buildings are the trademark of numerous European cities, forming a great part of EU Built Heritage, reflecting and shaping the identity of our local, national and multinational societies. Considering that historic buildings are ineffective in terms of energy consumption for heating and cooling, among the biggest restoration and renovation challenges is to enhance the energy performance of historic buildings. SINCERE aims to elucidate the values of Built Heritage and provide the tools for optimizing the carbon footprint and energy performance of historic buildings, towards the requirements of net-zero-carbon-buildings, by utilizing innovative, sustainable, and cost-effective restoration materials and practices, energy harvesting technologies, ICT tools and socially innovative…

ICARIA

ICARIA Improving ClimAte Resilience of crItical Assets The frequency of natural disasters has steadily increased over the past two decades. It is far from irrational to assume that this trend could be significantly worsened in a short and long-time period according to reported climate change projections. With the help of a multidisciplinary team and a firm foundation, ICARIA aims to advance the use of asset-level modeling to better understand the direct and indirect effects of climate change caused by complex, cascading and compound disasters as well as the related risk reduction provided by suitable, sustainable, and affordable adaptation solutions. ICARIA focuses on both critical assets and infrastructures taking into account potential climate changes that can increase unexpected outages and failures, including but not limited to housing, natural, and land areas.…

RAISE

RAISE Research Analysis Identifier SystEm The EU-funded RAISE project aims to address the challenge of an open, fair and reliable Research Community, where every researcher will be accredited for its work and all research data will be equally accessible for processing without violating data protection regulations. RAISE vision is to provide the infrastructure for a distributed crowdsourced data processing system, moving from open data to open access data for processing. RAISE will produce the mechanism for sending the algorithm to the dataset instead of sending the data to the algorithm. The success of such an application will provide to users a transparent way of processing and sharing data, enabling the research community to publish their outcomes with evidence-based authenticity of the data-analysis performed, ensuring at the same time the accreditation…

SECANT

SECANT SECurity And privacy protectioN in Internet of Things devices SECANT aims to contribute decisively towards improving the readiness and resilience of organisations against the crippling modern cyber-threats, by increasing the privacy, data protection, and accountability across the entire interconnected ICT ecosystem, and by reducing the costs for security training in the European market. To this end, the SECANT platform will enhance the capabilities of organisations’ stakeholders, by implementing (a) collaborative threat intelligence collection, analysis, and sharing; (b) innovative risk analysis specifically designed for interconnected nodes of an industrial ecosystem; (c) cutting-edge trust and accountability mechanisms for data protection, and (d) security awareness training for more informed security choices. The effectiveness and versatility of the proposed solution will be validated in four realistic pilot use case scenarios applied in the…

Nightingale

Nightingale Novel InteGrated toolkit for enhanced pre-Hospital life support and Triage IN challenGing And Large Emergencies Major emergencies, crisis and disasters have become more frequent the last decades. However, nowadays, emergency medical services and non-medical civil protection practitioners in a mass casualty incident scene are often striving to save lives but they are relying on complicated or outdated procedures and technology of the past. Additionally, disasters might differ in nature, geographic extent and other parameters, leading, in such a way, in a multitude of challenges. Therefore, it is uppermost affected people to feel safe and to get top-level healthcare that modern technology and current civil protection systems can offer. Nightingale is aimed at upgrading pre-hospital life support and Triage by delivering enhanced Operational Capacity to respond to mass casualty incidents…

VITALISE

VITALISE VIrtual healTh And weLlbeing Living Lab InftraStructurE The EU-funded VITALISE aims to establish new Living Labs in order to support the research community in the Health and Wellbeing domain. It also invests in learning about methodologies of user engagement and co-creation, such as design thinking, focus groups and ideation. VITALISE will design and develop ICT tools for shared access of similar devices and applications used across Living Labs, as well as for collecting, storing and sharing datasets. It will enhance closer interaction between multidisciplinary researchers among and beyond the consortium partners through the Joint Research Activities, Transnational Physical and Virtual Access. Physical access refers to access in the infrastructure by physical presence (17 Living Lab research infrastructures across Europe) while Virtual refers to remote access using digital tools. VITALISE…

ALAMEDA

ALAMEDA Bridging the Early Diagnosis and Treatment Gab of Brain Diseases via Smart, Connected, Proactive and Evidence-based Technological Interventions The EU-funded ALAMEDA project aims to provide new opportunities for improved personalized healthcare and prevention that have been enabled by the recent advances in the design and development of Innovative health risk prediction and intervention tools. ALAMEDA’s vision is to research and prototype the next generation of personalized AI healthcare support systems for people with brain diseases and disorders, specifically focusing on the needs of patients with Parkinson’s, Multiple Sclerosis and Stroke (PMSS). The project’s innovations will take advantage of new machine learning models, built upon lifestyle retrospective data as well as new streams of patient data that involve the monitoring of everyday activities, such as sleep behaviour and emotional status.…

PrismArch

PrismArch Virtual reality aided design blending cross-disciplinary aspects of architecture in a multi-simulation environment The recent past of the AEC industry is characterized by digital breakthroughs that have dramatically shaped the design process. The powerful programs that are currently available offer unlimited possibilities, allowing complex and creative designs to be modelled accurately with ease while enabling collaboration and Building Information Modeling. The realization of structurally complex constructions is an inter-disciplinary process that passes through the close collaboration of architects and engineers. By employing advanced VR applications, designers can immersively perceive and interact with the current status of their creations and realize the consequences of their decisions. Unfortunately, these solutions focus on the aesthetic aspect of architecture while ignoring the driving cause hidden behind each architectural creation, functionality, that can only…

CHROMATA

CHROMATA Dances, Songs, Myths and Customs for the Development of Technologies for Intangible Cultural Heritage The preservation of the intangible cultural heritage (e.g., traditional dances, songs, stories, techniques etc.) is a challenging task, since it is more difficult than maintaining tangible objects. The main purpose of the national project CHROMATA is to design and implement an interactive virtual reality platform that will gather elements of the intangible cultural heritage from available sources in areas of cultural interest and will constitute the starting point for the creation of indoor and outdoor environments of virtual and augmented reality that can (a) revive and represent the elements (e.g., traditional dances, stories, etc.) of the intangible heritage and b) create new spatial and virtual transcripts, thus promoting new uses for it. For the implementation…

xR4DRAMA

xR4DRAMA Extended Reality For DisasteR management And Media plAnning The EU-funded xR4DRAMA project aims to create a solution that will improve the situational awareness of those user groups who are responsible for handling disasters, man-made crises or public events. The groups range from first responders, local authorities and security forces to media companies and event planners. Situational awareness is crucial for them to execute tasks efficiently, plan things and take the appropriate decisions. The proof of concept of this project will focus on first responders and media companies before extending the use cases to other domains. xR4DRAMA's methodology is based on X Reality (XR) technologies, and the tool can be used remotely and on site for an augmented and shared perception of a given situation. In particular, innovative technologies will…

CALLISTO

CALLISTO Copernicus Artificial Intelligence Services and data fusion with other distributed data sources and processing at the edge to support DIAS and HPC infrastructures Artificial Intelligence (AI) is already part of our lives and is extensively entering the space sector to offer value-added Earth Observation (EO) products and services. CALLISTO project integrates Copernicus data, already indexed in DIAS platforms such as ONDA-DIAS, utilising High Performance Computing infrastructures for enhanced scalability when needed. Complementary distributed data sources involve Galileo positioning data, visual content from UAVs, Web and social media data linking them with open geospatial data, in-situ sensor data. On top of these data sources, AI methods are applied to extract meaningful knowledge such as concepts, changes, activities, events, 3D-models, videos and animations of the user community. AI methods are also…

GATEKEEPER

GATEKEEPER Smart Living Homes - Whole Interventions Demonstrator for People at Health and Social Risks The main objective of the project is to create a GATEKEEPER, that connects healthcare providers, businesses, entrepreneurs, elderly citizens and the communities they live in, in order to originate an open, trust-based arena for matching ideas, technologies, user needs and processes, aimed at ensuring healthier independent lives for the ageing populations. By 2022, GATEKEEPER will be embodied in an open source, European, standard-based, interoperable and secure framework available to all developers, for creating combined digital solutions for personalised early detection and interventions that (i) harness the next generation of healthcare and wellness innovations; (ii) cover the whole care continuum for elderly citizens, including primary, secondary and tertiary prevention, chronic diseases and co-morbidities; (iii) straightforwardly fit…

SAFERS

SAFERS Enhancing our society's resilience against wildfires Forest fires are exacerbated by extreme weather conditions, which are increasing both in frequency and in magnitude due to climate change effects. This points to the need for improving the effectiveness of emergency management solutions aimed to help society in becoming more resilient to emergencies arising before, during and after forest fire events. Therefore, it is proposed to realize a comprehensive Emergency Management System (EMS) that we name SAFERS: Structured Approaches for Forest fire Emergencies in Resilient Societies. SAFERS will act along the key phases of the emergency management cycle, coupling information from EO data and services offered by Copernicus and GEOSS, crowdsourced data from social media and from specific applications that can be used by both citizens as well as from in-field…

KRISTINA

KRISTINA A Knowledge-Based Information Agent with Social Competence and Human Interaction Capabilities KRISTINA’s overall objective is to research and develop technologies for a human-like socially competent and communicative agent that is run on mobile communication devices and that serves for migrants with language and cultural barriers in the host country as a trusted information provision party and mediator in questions related to basic care and healthcare. To develop such an agent, KRISTINA will advance the state of the art in dialogue management, multimodal (vocal, facial and gestural) communication analysis and multimodal communication. The technologies will be validated in two use cases, in which prolonged trials will be carried out for each prototype that marks the termination of a SW development cycle, with a representative number of migrants recruited as users…

V4Design

V4Design Visual and textual content re-purposing FOR(4) architecture, Design and video virtual reality games V4Design promotes the re-use of visual and textual content, such as documentaries, paintings and their critiques so as to be repurposed and be used for the inspiration of architecture and video game (VR) designing. Visual content analysis is performed through 3D reconstruction and modelling, localization of objects in visual data, automated extraction of aesthetics/style information and language understanding from visual and textual data. 3D objects are also enhanced with semantics and explanatory text descriptions. V4Design will develop a platform that provides architects, video game creators and designers of any expertise with innovative tools necessary to enhance and simplify the creative phase of the designing process. The main idea behind V4Design is to reuse (i) visual: movies,…

TENSOR

TENSOR reTriEval and aNalysis of heterogeneouS online content for TerrOrist activity Recognition Law Enforcement Agencies (LEAs) across Europe face today important challenges in how they identify, gather and interpret terrorist generated content online. The Dark Web presents additional challenges due to its inaccessibility and the fact that undetected material can contribute to the advancement of terrorist violence and radicalisation. LEAs also face the challenge of extracting and summarising meaningful and relevant content hidden in huge amounts of online data to inform their resource deployment and investigations. In this context, the main objective of the TENSOR project is to provide a powerful terrorism intelligence platform offering LEAs fast and reliable planning and prevention functionalities for the early detection of terrorist organised activities, radicalisation and recruitment. The platform integrates a set of…

ROBORDER

ROBORDER Autonomous swarm of heterogenous robots for border surveillance Border authorities and Law Enforcement Agencies (LEAs) across Europe face important challenges in how they patrol and protect the borders. Their work becomes more problematic considering the heterogeneity of threats, the wideness of the surveyed area, the adverse weather conditions and the wide range of terrains. Towards delivering a solution including all such factors, the main goal of ROBORDER is to develop and demonstrate a fully-functional autonomous border surveillance system with unmanned mobile robots including aerial, water surface, underwater and ground vehicles which will incorporate multimodal sensors as part of an interoperable network. Our intention is to implement a heterogenous robot system and enhance it with detection capabilities for early identification of criminal activities at border and coastal areas along with…

EOPEN

EOPEN Open interoperable platform for unified access and analysis of Earth Observation data Earth Observation (EO) data access through the Copernicus data distributor systems has paved the way to monitor changes on Earth, using Sentinel data. One of the main objectives of EOPEN is to fuse Sentinel data with multiple, heterogeneous and big data sources, to improve the monitoring capabilities of the future EO downstream sector. Additionally, the involvement of mature ICT solutions in the Earth Observation sector shall address major challenges in effectively handling and disseminating Copernicus-related information to the wider user community, beyond the EU borders. EOPEN will fuse Copernicus big data content with observations from non-EO data, such as weather, environmental and social media information, aiming at interactive, real-time and user-friendly visualisations and decisions from early warning…

REA

REA According to the World Health Organization (WHO), there are currently more than 1 billion people worldwide (about one in seven) who have some form of disability. It is estimated that over 150 million adults worldwide face serious movement issues and are not functionally independent. Care and rehabilitation are important factors in maintaining and improving the quality of life of people with physical or mental injuries. At the same time, they have important short-term and long-term economic implications for both individuals and their families, as well as for the health system and society. With the aim of upgrading the monitoring and support technologies currently used in clinical and non-clinical rehabilitation and patient care environments, the goal of the project is to develop an innovative interconnected virtual agent with enhanced interactive…

CONNEXIONs

CONNEXIONs InterCONnected NEXt-Generation Immersive IoT Platform of Crime and Terrorism DetectiON, PredictiON, InvestigatiON, and PreventiON Services CONNEXIONs aims to develop and demonstrate next-generation detection, prediction, prevention, and investigation services. These services will be based on multidimensional integration and correlation of heterogeneous multimodal data, and delivery of pertinent information to various stakeholders in an interactive manner tailored to their needs, through augmented and virtual reality environments. The CONNEXIONs solution encompasses the entire lifecycle of law enforcement operations including: pre-occurrence crime prediction and prevention during-occurrence LEA operations post-occurrence investigation, and crime-scene simulation and 3D reconstruction. CONNEXIONs will meaningfully enhance operational and (near) real-time situational awareness, through automated identification, interpretation, fusion and correlation of multiple heterogeneous big data sources, as well as their delivery via immersive solutions. Such multimodal data include Surface/Deep/Dark Web…

MULTISENSOR

MULTISENSOR Mining and Understanding of multilinguaL contenT for Intelligent Sentiment Enriched coNtext and Social Oriented inteRpretation The consumption of large amounts of multilingual and multimedia content regardless of its reliability and cross-validation can have important consequences on the society. An indicative example is the current crisis of the financial markets in Europe, which has created an extremely unstable ground for economic transactions and caused insecurity in the population. The fact that the national mass media provide exaggerated and contradictory information and the inaptness to understand local contexts from different countries has a considerable share in the aggravation of the crisis. To break this spiral, we need multilingual technologies with sentiment, social and spatiotemporal competence that are able to interpret, relate and summarise economic information and news created from various local…

beAWARE

beAWARE Enhancing decision support and management services in extreme weather climate events In every disaster and crisis, incident time is the enemy, and getting accurate information about the scope, extent, and impact of the disaster is critical to creating and orchestrating an effective disaster response and recovery effort. The main goal of beAWARE is to provide support in all the phases of an emergency incident. More specifically, we propose an integrated solution to support forecasting, early warnings, transmission and routing of the emergency data, aggregated analysis of multimodal data and management the coordination between the first responders and the authorities. Our intention is to rely on platforms, theories and methodologies that are already used for disaster forecasting and management and add the elements that are necessary to make them working…

SODALITE

SODALITE SOftware Defined AppLication Infrastructures managemenT and Engineering SODALITE (SOftware Defined AppLication Infrastructures managemenT and Engineering) is aimed at tackling the complexity of deploying and operating modern applications onto heterogeneous HPC and cloud-based software-defined infrastructures, under arbitrary operational conditions and requirements. This challenge is addressed through (a) the abstraction of the application and software-defined infrastructures, (b) the automation of maintaining a dynamic balance between the application and the infrastructure, and (c) the design and runtime analysis of software-defined infrastructures. The novelty of the SODALITE’s approach lies in developing and using an application, infrastructure, and performance abstraction library to enable dynamically optimized multi-target application execution via an optimal mixture of Cloud, HPC, GPUs, FPGAs, etc., based on the requirements of the application itself and the dynamic state of the infrastructure. Further…

MIICT

MIICT ICT Enabled Services for Migration MIICT (ICT Enabled Services for Migration) was conceived with the goal of designing, developing and deploying tools that address the challenge of migrant integration through the co-creation of improved ICT-enabled services with migrants, refugees, public sector services, NGOs (Non-Governmental-Organisations) and other interest groups. By involving research-users at the centre of our approach we address the need to improve and customise the interfaces used to access key public services so that they better address the requirements of migrants and refugees. In service of this goal, MIICT proposes the development of “IMMERSE” (Integration of Migrants MatchER SErvice), a database system that captures the specific socio-cultural, economic and legal contexts of migrants that is shared with public authorities. In order to promote inclusion and reduce the potential…

DESMOS

DESMOS Smart Interconnected Infrastructures for Security and Protection The goal of DESMOS project is to combine technology and human resources to provide a protection and security environment for citizens, emphasizing on tourists, by creating the appropriate infrastructure to address a set of ‘urgent’ situations. Given that the use of mobile and portable devices is now widespread, the project intends to use existing technology and customization for the benefit of citizens. Emergencies that may arise may be of a medical nature (allergies, medical conditions), dangerous incidents (e.g. thefts, vandalism) or situations encountered in crowded places (e.g. child disappearance). Within the framework of the project, a platform for participatory cooperation between people and infrastructures will be created and through the reporting of incidents and emergencies using ICT, assistance will be provided by…

MindSpaces

MindSpaces Art-driven adaptive outdoors and indoors design MindSpaces aims to create a novel approach to urban and architectural design by generating 3D-VR immersive and emotion-adaptive ‘neuro-environments’ that will help in designing emotionally-relevant urban spaces. The emotional aspects of an environment will be captured through the use of mobile EEG (Elecroencephalography) headsets, wearable bracelets/watches, and other physiological sensors that will be embedded with a VR-headset, so as to allow capturing the neuro-feedback of a VR-experience. The neuro-feedback will allow the virtual space to be adapted accordingly, resulting in an emotion-adaptive space. The ‘neuro-environments’ will be used at two levels of granularity. At the first level, artists and creatives will experience the ‘neuro-environments’ with the intention to improve the emotional-relevance of the urban space through the neuro-feedback of individuals, that have very-well…

aqua3S

aqua3S Enhancing Standardisation strategies to integrate innovative technologies for Safety and Security in existing water networks Exposure of citizens to potential disasters has led to vulnerable societies that require risk reduction measures. Drinking water is one of the main risk sources when its safety and security are not ensured. aqua3S combines novel technologies in water safety and security, aiming to standardize existing sensor technologies complemented by state-of-the-art detection mechanisms. Hence, it could propose innovative solutions to water facilities and responsible authorities in order to detect and tackle water-related crises in a timely manner. On the one hand, sensor networks are deployed in water supply networks and sources, supported by complex sensors for enhanced detection; on the other hand, sensor measurements are supported by videos from Unmanned Aerial Vehicles (UAVs), satellite…

INGENIOUS

INGENIOUS The First Responder (FR) of the Future: a Next Generation Integrated Toolkit (NGIT) for Collaborative Response, increasing protection and augmenting operational capacity Today’s First Responders (FR) are using technology of the past. During their primary mission of saving lives and preserving society’s safety and security, FRs face a multitude of challenges. In both small scale emergencies and large scale disasters, they often deal with life-threatening situations, hazardous environments, uncharted surroundings and limited awareness. Threats and hazards evolve rapidly, crossing municipalities, regions and nations with speed and ease. Armouring public safety services with all the tools that modern technology has to offer is critical. Such tools holistically enhance their protection and augment their operational capacities, assisting them in saving lives as well as ensuring their safe return from the disaster…

WELCOME

WELCOME Multiple Intelligent Conversation Agent Services for Reception, Management and Integration of Third Country Nationals in the EU The objective of WELCOME is to research and develop intelligent technologies for support of the reception and integration of migrants in Europe. Unlike the majority of the projects that address the problem of migrant integration by frontends with “one-for-all” interfaces for information acquisition and services, WELCOME will offer a personalized and psychologically and socially competent solution for both migrants and public administrations. It will develop immersive and intelligent services, in which embodied intelligent multilingual agents will act as dedicated personalized assistants of migrants in contexts of registration, orientation, language teaching, civic education, and social and societal inclusion. The agents will be personalized in the sense that they will dynamically adapt their interaction…