European – Page 2 – Multimodal Data Fusion and Analytics Group

7SHIELD

7SHIELD Prevention, detection, response and mitigation of combined physical and cyber threats to critical infrastructure in Europe The 7SHIELD project addresses the security and the resilience of EU Ground Segments of Space Systems, meeting the crosscutting and the sectorial criteria of the EU critical infrastructures (2008/14). The Copernicus era has created a new market with the massive amounts of satellite data that the ground segments of space systems receive serve to the market and governmental bodies. A physical/cyber-attack to their installations or communication networks, respectively, would cause debilitating impact on public safety and security of EU citizens and public authorities. A physical attack on a space ground segment makes the distribution of satellite data problematic and, on the other hand, a cyber-attack in its data storage, access and exchange affects…

SAFERS

SAFERS Enhancing our society's resilience against wildfires Forest fires are exacerbated by extreme weather conditions, which are increasing both in frequency and in magnitude due to climate change effects. This points to the need for improving the effectiveness of emergency management solutions aimed to help society in becoming more resilient to emergencies arising before, during and after forest fire events. Therefore, it is proposed to realize a comprehensive Emergency Management System (EMS) that we name SAFERS: Structured Approaches for Forest fire Emergencies in Resilient Societies. SAFERS will act along the key phases of the emergency management cycle, coupling information from EO data and services offered by Copernicus and GEOSS, crowdsourced data from social media and from specific applications that can be used by both citizens as well as from in-field…

AIDA

AIDA Artificial Intelligence and advanced Data Analytics for Law Enforcement Agencies The goal of AIDA is to provide Law Enforcement Agencies (LEAs) in the EU Member States (MS) with innovative, dedicated and sustainable digital technologies to facilitate the entire Big Data analytics cycle as part of their investigative and proactive prevention capabilities focused on cybercrime and counterterrorism. More specifically, AIDA will provide law enforcement across the EU with a modular capacity to acquire, (pre-)process, enrich, analyse and visualise multi-source Big Data in near real-time. The latter will shift the capacity of EU Member States to fight cybercrime and terrorism, while implementing governance procedures to maintain full compliance with fundamental rights and applicable legislation, including privacy and protection of personal data and ensure chain of custody. The AIDA framework will adapt…

PathoCERT

PathoCERT Pathogen Contamination Emergency Response Technologies Pathogens are a determining factor in emergency response due to their life-threatening nature, both for the public as well as for the safety of first responders. In many cases, pathogen contaminations are difficult to detect, and require specialized technologies, tools and procedures to handle them. Waterborne pathogen contamination events can occur anywhere, and may be caused by various natural events or they can be the result of human activity, either accidental or malicious. During these emergencies, first responders may need to operate within a certain pre-defined incident area, and are likely to be exposed to contaminated water originating from various sources, such as surface water, wastewater or drinking water. This can pose a significant risk of illness, disease or even death, through skin contact,…

KRISTINA

KRISTINA A Knowledge-Based Information Agent with Social Competence and Human Interaction Capabilities KRISTINA’s overall objective is to research and develop technologies for a human-like socially competent and communicative agent that is run on mobile communication devices and that serves for migrants with language and cultural barriers in the host country as a trusted information provision party and mediator in questions related to basic care and healthcare. To develop such an agent, KRISTINA will advance the state of the art in dialogue management, multimodal (vocal, facial and gestural) communication analysis and multimodal communication. The technologies will be validated in two use cases, in which prolonged trials will be carried out for each prototype that marks the termination of a SW development cycle, with a representative number of migrants recruited as users…

V4Design

V4Design Visual and textual content re-purposing FOR(4) architecture, Design and video virtual reality games V4Design promotes the re-use of visual and textual content, such as documentaries, paintings and their critiques so as to be repurposed and be used for the inspiration of architecture and video game (VR) designing. Visual content analysis is performed through 3D reconstruction and modelling, localization of objects in visual data, automated extraction of aesthetics/style information and language understanding from visual and textual data. 3D objects are also enhanced with semantics and explanatory text descriptions. V4Design will develop a platform that provides architects, video game creators and designers of any expertise with innovative tools necessary to enhance and simplify the creative phase of the designing process. The main idea behind V4Design is to reuse (i) visual: movies,…

iV&L Net

iV&L Net The European Network on Integrating Vision and Language Combining Computer Vision and Language Processing For Advanced Search, Retrieval, Annotation and Description of Visual Data, COST Action IC1307, is designed to bring together two previously unconnected research communities, Computer Vision (CV) and Natural Language Processing (NLP). It is set up to allow researchers to meet, exchange ideas, expertise and technology, and form new partnerships. Building on the successful EPSRC Network on Vision and Language (V&L Net), the aim of the COST Action is to create a lasting interdisciplinary research community situated at the nexus between language processing and computer vision. This is hugely important because of the explosive growth of visual and textual data (both on the World Wide Web and held in private repositories by diverse institutions and…

TENSOR

TENSOR reTriEval and aNalysis of heterogeneouS online content for TerrOrist activity Recognition Law Enforcement Agencies (LEAs) across Europe face today important challenges in how they identify, gather and interpret terrorist generated content online. The Dark Web presents additional challenges due to its inaccessibility and the fact that undetected material can contribute to the advancement of terrorist violence and radicalisation. LEAs also face the challenge of extracting and summarising meaningful and relevant content hidden in huge amounts of online data to inform their resource deployment and investigations. In this context, the main objective of the TENSOR project is to provide a powerful terrorism intelligence platform offering LEAs fast and reliable planning and prevention functionalities for the early detection of terrorist organised activities, radicalisation and recruitment. The platform integrates a set of…

ROBORDER

ROBORDER Autonomous swarm of heterogenous robots for border surveillance Border authorities and Law Enforcement Agencies (LEAs) across Europe face important challenges in how they patrol and protect the borders. Their work becomes more problematic considering the heterogeneity of threats, the wideness of the surveyed area, the adverse weather conditions and the wide range of terrains. Towards delivering a solution including all such factors, the main goal of ROBORDER is to develop and demonstrate a fully-functional autonomous border surveillance system with unmanned mobile robots including aerial, water surface, underwater and ground vehicles which will incorporate multimodal sensors as part of an interoperable network. Our intention is to implement a heterogenous robot system and enhance it with detection capabilities for early identification of criminal activities at border and coastal areas along with…

EOPEN

EOPEN Open interoperable platform for unified access and analysis of Earth Observation data Earth Observation (EO) data access through the Copernicus data distributor systems has paved the way to monitor changes on Earth, using Sentinel data. One of the main objectives of EOPEN is to fuse Sentinel data with multiple, heterogeneous and big data sources, to improve the monitoring capabilities of the future EO downstream sector. Additionally, the involvement of mature ICT solutions in the Earth Observation sector shall address major challenges in effectively handling and disseminating Copernicus-related information to the wider user community, beyond the EU borders. EOPEN will fuse Copernicus big data content with observations from non-EO data, such as weather, environmental and social media information, aiming at interactive, real-time and user-friendly visualisations and decisions from early warning…

CONNEXIONs

CONNEXIONs InterCONnected NEXt-Generation Immersive IoT Platform of Crime and Terrorism DetectiON, PredictiON, InvestigatiON, and PreventiON Services CONNEXIONs aims to develop and demonstrate next-generation detection, prediction, prevention, and investigation services. These services will be based on multidimensional integration and correlation of heterogeneous multimodal data, and delivery of pertinent information to various stakeholders in an interactive manner tailored to their needs, through augmented and virtual reality environments. The CONNEXIONs solution encompasses the entire lifecycle of law enforcement operations including: pre-occurrence crime prediction and prevention during-occurrence LEA operations post-occurrence investigation, and crime-scene simulation and 3D reconstruction. CONNEXIONs will meaningfully enhance operational and (near) real-time situational awareness, through automated identification, interpretation, fusion and correlation of multiple heterogeneous big data sources, as well as their delivery via immersive solutions. Such multimodal data include Surface/Deep/Dark Web…

MULTISENSOR

MULTISENSOR Mining and Understanding of multilinguaL contenT for Intelligent Sentiment Enriched coNtext and Social Oriented inteRpretation The consumption of large amounts of multilingual and multimedia content regardless of its reliability and cross-validation can have important consequences on the society. An indicative example is the current crisis of the financial markets in Europe, which has created an extremely unstable ground for economic transactions and caused insecurity in the population. The fact that the national mass media provide exaggerated and contradictory information and the inaptness to understand local contexts from different countries has a considerable share in the aggravation of the crisis. To break this spiral, we need multilingual technologies with sentiment, social and spatiotemporal competence that are able to interpret, relate and summarise economic information and news created from various local…

beAWARE

beAWARE Enhancing decision support and management services in extreme weather climate events In every disaster and crisis, incident time is the enemy, and getting accurate information about the scope, extent, and impact of the disaster is critical to creating and orchestrating an effective disaster response and recovery effort. The main goal of beAWARE is to provide support in all the phases of an emergency incident. More specifically, we propose an integrated solution to support forecasting, early warnings, transmission and routing of the emergency data, aggregated analysis of multimodal data and management the coordination between the first responders and the authorities. Our intention is to rely on platforms, theories and methodologies that are already used for disaster forecasting and management and add the elements that are necessary to make them working…

MULTIFORESEE

MULTIFORESEE MULTI-modal Imaging of FOREnsic SciEnce Evidence The main objective of the COST Action CA16101, entitled MULTI-modal Imaging of FOREnsic SciEnce Evidence (MULTI-FORESEE)- tools for Forensic Science, is to promote innovative, multi-informative, operationally deployable and commercially exploitable imaging solutions/technology to analyse forensic evidence. Forensic evidence includes, but not limited to, fingermarks, hair, paint, biofluids, digital evidence, fibers, documents and living individuals. Imaging technologies include optical, mass spectrometric, spectroscopic, chemical, physical and digital forensic techniques complemented by expertise in IT solutions and computational modelling. Imaging technologies enable multiple physical and chemical information to be captured in one analysis, from one specimen, with information being more easily conveyed and understood for a more rapid exploitation. The enhanced value of the evidence gathered will be conducive to much more informed investigations and judicial…

SODALITE

SODALITE SOftware Defined AppLication Infrastructures managemenT and Engineering SODALITE (SOftware Defined AppLication Infrastructures managemenT and Engineering) is aimed at tackling the complexity of deploying and operating modern applications onto heterogeneous HPC and cloud-based software-defined infrastructures, under arbitrary operational conditions and requirements. This challenge is addressed through (a) the abstraction of the application and software-defined infrastructures, (b) the automation of maintaining a dynamic balance between the application and the infrastructure, and (c) the design and runtime analysis of software-defined infrastructures. The novelty of the SODALITE’s approach lies in developing and using an application, infrastructure, and performance abstraction library to enable dynamically optimized multi-target application execution via an optimal mixture of Cloud, HPC, GPUs, FPGAs, etc., based on the requirements of the application itself and the dynamic state of the infrastructure. Further…

MIICT

MIICT ICT Enabled Services for Migration MIICT (ICT Enabled Services for Migration) was conceived with the goal of designing, developing and deploying tools that address the challenge of migrant integration through the co-creation of improved ICT-enabled services with migrants, refugees, public sector services, NGOs (Non-Governmental-Organisations) and other interest groups. By involving research-users at the centre of our approach we address the need to improve and customise the interfaces used to access key public services so that they better address the requirements of migrants and refugees. In service of this goal, MIICT proposes the development of “IMMERSE” (Integration of Migrants MatchER SErvice), a database system that captures the specific socio-cultural, economic and legal contexts of migrants that is shared with public authorities. In order to promote inclusion and reduce the potential…

MindSpaces

MindSpaces Art-driven adaptive outdoors and indoors design MindSpaces aims to create a novel approach to urban and architectural design by generating 3D-VR immersive and emotion-adaptive ‘neuro-environments’ that will help in designing emotionally-relevant urban spaces. The emotional aspects of an environment will be captured through the use of mobile EEG (Elecroencephalography) headsets, wearable bracelets/watches, and other physiological sensors that will be embedded with a VR-headset, so as to allow capturing the neuro-feedback of a VR-experience. The neuro-feedback will allow the virtual space to be adapted accordingly, resulting in an emotion-adaptive space. The ‘neuro-environments’ will be used at two levels of granularity. At the first level, artists and creatives will experience the ‘neuro-environments’ with the intention to improve the emotional-relevance of the urban space through the neuro-feedback of individuals, that have very-well…

DIH^2

DIH^2 A Pan-European Network of Robotics DIHs for Agile Production DIH^2 is a network of 26 DIHs, with a target to reach over 170 DIHs. The sole aim of the network is to spark incremental (cut 50% cost of advance robotics solutions, double the growth of robotics market) and disruptive (maximum productivity & optimum agility) innovations in over 300,000 Manufacturing SMEs and Mid-Caps. It will support SMEs in their Agile Production challenge (50% increase in productivity) and unleash their digitalization potential by enabling robot solutions that are more cost effective at lower lot sizes. DIH^2 relies on: A Common Open Platform Reference Architecture for Agile Production (COPRA-AP) -based on Industrial Data Space Reference Architecture Model and FIWARE technologies- to serve the needs of SMEs by means of a continuously growing…

ARESIBO

ARESIBO Augmented Reality Enriched Situation Awareness for Border Security ARESIBO aims at improving the efficiency of the border surveillance systems by providing the operational teams and the tactical command and control level with an accurate and comprehensive information. The pillars of research in ARESIBO are three-fold: (i). Set-up a complete configuration at tactical and execution level to optimize the collaboration between human and sensors (fixed and mobile), (ii) Improve situation awareness by enhancing the understanding of the situation through adapted processing of sensor data, correlation between heterogeneous data and information and creation of knowledge through deep learning techniques and (iii) Create a situation awareness capability at C2 level that will combine reports on previous missions, real time situation understanding and threat analysis for future actions. This capability will be used…

ECHO

ECHO European network of Cybersecurity centres and competence Hub for innovation and Operations ECHO delivers an organized and coordinated approach to improve proactive cyber defence of the European Union, through effective and efficient multi-sector collaboration. The Partners will execute on a 48-month work plan to develop, model and demonstrate a network of cyber research and competence centres, with a central competence at the hub. The Central Competence Hub serves as the focal point for the ECHO Multi-sector Assessment Framework enabling multi-sector dependencies management, provision of an ECHO Early Warning System, an ECHO Federation of Cyber Ranges and management of an expanding collection of Partner Engagements. The ECHO Multi-sector Assessment Framework refers to the analysis of challenges and opportunities derived from sector specific use cases, transversal cybersecurity needs analysis and development…

aqua3S

aqua3S Enhancing Standardisation strategies to integrate innovative technologies for Safety and Security in existing water networks Exposure of citizens to potential disasters has led to vulnerable societies that require risk reduction measures. Drinking water is one of the main risk sources when its safety and security are not ensured. aqua3S combines novel technologies in water safety and security, aiming to standardize existing sensor technologies complemented by state-of-the-art detection mechanisms. Hence, it could propose innovative solutions to water facilities and responsible authorities in order to detect and tackle water-related crises in a timely manner. On the one hand, sensor networks are deployed in water supply networks and sources, supported by complex sensors for enhanced detection; on the other hand, sensor measurements are supported by videos from Unmanned Aerial Vehicles (UAVs), satellite…

INGENIOUS

INGENIOUS The First Responder (FR) of the Future: a Next Generation Integrated Toolkit (NGIT) for Collaborative Response, increasing protection and augmenting operational capacity Today’s First Responders (FR) are using technology of the past. During their primary mission of saving lives and preserving society’s safety and security, FRs face a multitude of challenges. In both small scale emergencies and large scale disasters, they often deal with life-threatening situations, hazardous environments, uncharted surroundings and limited awareness. Threats and hazards evolve rapidly, crossing municipalities, regions and nations with speed and ease. Armouring public safety services with all the tools that modern technology has to offer is critical. Such tools holistically enhance their protection and augment their operational capacities, assisting them in saving lives as well as ensuring their safe return from the disaster…

CREST

CREST Fighting Crime and TerroRism with an IoT-enabled Autonomous Platform based on an Ecosystem of Advanced IntelligEnce, Operations, and InveStigation Technologies CREST aims to equip LEAs with an advanced prediction, prevention, operation, and investigation platform by leveraging the IoT ecosystem, autonomous systems, and targeted technologies and building upon the concept of multidimensional integration and correlation of heterogeneous multimodal data streams (ranging from online content to IoT-enabled sensors) for a) threat detection and assessment, b) dynamic mission planning and adaptive navigation for improved surveillance based on autonomous systems, c) distributed command and control of law enforcement missions, d) sharing of information and exchange of digital evidence based on blockchain, and e) delivery of pertinent information to different stakeholders in an interactive manner tailored to their needs. CREST will also provide chain-of-custody,…

WELCOME

WELCOME Multiple Intelligent Conversation Agent Services for Reception, Management and Integration of Third Country Nationals in the EU The objective of WELCOME is to research and develop intelligent technologies for support of the reception and integration of migrants in Europe. Unlike the majority of the projects that address the problem of migrant integration by frontends with “one-for-all” interfaces for information acquisition and services, WELCOME will offer a personalized and psychologically and socially competent solution for both migrants and public administrations. It will develop immersive and intelligent services, in which embodied intelligent multilingual agents will act as dedicated personalized assistants of migrants in contexts of registration, orientation, language teaching, civic education, and social and societal inclusion. The agents will be personalized in the sense that they will dynamically adapt their interaction…

INFINITY

INFINITY IMMERSE. INTERACT. INVESTIGATE Infinity’s ambition is to become a flagship project against society’s most pressing cybercriminal, terrorist and hybrid threats. Synthesising the latest innovations in virtual and augmented reality, artificial intelligence and machine learning with big data and visual analytics, Infinity will deliver an integrated solution that aims to revolutionise data driven investigations. Bringing together a strong representation from national and supranational agencies with an end user-driven design, it will directly address the core needs of contemporary law enforcement. Specifically, it will equip investigators and analysts with cutting-edge tools to acquire, process, visualise and act upon the enormous quantities of data they are faced with every day. Bolstered by cognitive research, automated systems and instinctive interfaces and controls, Infinity will be designed and developed to maximise the potential of…