European – Page 2 – Multimodal Data Fusion and Analytics Group

ROBORDER

ROBORDER Autonomous swarm of heterogenous robots for border surveillance Border authorities and Law Enforcement Agencies (LEAs) across Europe face important challenges in how they patrol and protect the borders. Their work becomes more problematic considering the heterogeneity of threats, the wideness of the surveyed area, the adverse weather conditions and the wide range of terrains. Towards delivering a solution including all such factors, the main goal of ROBORDER is to develop and demonstrate a fully-functional autonomous border surveillance system with unmanned mobile robots including aerial, water surface, underwater and ground vehicles which will incorporate multimodal sensors as part of an interoperable network. Our intention is to implement a heterogenous robot system and enhance it with detection capabilities for early identification of criminal activities at border and coastal areas along with…

EOPEN

EOPEN Open interoperable platform for unified access and analysis of Earth Observation data Earth Observation (EO) data access through the Copernicus data distributor systems has paved the way to monitor changes on Earth, using Sentinel data. One of the main objectives of EOPEN is to fuse Sentinel data with multiple, heterogeneous and big data sources, to improve the monitoring capabilities of the future EO downstream sector. Additionally, the involvement of mature ICT solutions in the Earth Observation sector shall address major challenges in effectively handling and disseminating Copernicus-related information to the wider user community, beyond the EU borders. EOPEN will fuse Copernicus big data content with observations from non-EO data, such as weather, environmental and social media information, aiming at interactive, real-time and user-friendly visualisations and decisions from early warning…

CONNEXIONs

CONNEXIONs InterCONnected NEXt-Generation Immersive IoT Platform of Crime and Terrorism DetectiON, PredictiON, InvestigatiON, and PreventiON Services CONNEXIONs aims to develop and demonstrate next-generation detection, prediction, prevention, and investigation services. These services will be based on multidimensional integration and correlation of heterogeneous multimodal data, and delivery of pertinent information to various stakeholders in an interactive manner tailored to their needs, through augmented and virtual reality environments. The CONNEXIONs solution encompasses the entire lifecycle of law enforcement operations including: pre-occurrence crime prediction and prevention during-occurrence LEA operations post-occurrence investigation, and crime-scene simulation and 3D reconstruction. CONNEXIONs will meaningfully enhance operational and (near) real-time situational awareness, through automated identification, interpretation, fusion and correlation of multiple heterogeneous big data sources, as well as their delivery via immersive solutions. Such multimodal data include Surface/Deep/Dark Web…

MULTISENSOR

MULTISENSOR Mining and Understanding of multilinguaL contenT for Intelligent Sentiment Enriched coNtext and Social Oriented inteRpretation The consumption of large amounts of multilingual and multimedia content regardless of its reliability and cross-validation can have important consequences on the society. An indicative example is the current crisis of the financial markets in Europe, which has created an extremely unstable ground for economic transactions and caused insecurity in the population. The fact that the national mass media provide exaggerated and contradictory information and the inaptness to understand local contexts from different countries has a considerable share in the aggravation of the crisis. To break this spiral, we need multilingual technologies with sentiment, social and spatiotemporal competence that are able to interpret, relate and summarise economic information and news created from various local…

beAWARE

beAWARE Enhancing decision support and management services in extreme weather climate events In every disaster and crisis, incident time is the enemy, and getting accurate information about the scope, extent, and impact of the disaster is critical to creating and orchestrating an effective disaster response and recovery effort. The main goal of beAWARE is to provide support in all the phases of an emergency incident. More specifically, we propose an integrated solution to support forecasting, early warnings, transmission and routing of the emergency data, aggregated analysis of multimodal data and management the coordination between the first responders and the authorities. Our intention is to rely on platforms, theories and methodologies that are already used for disaster forecasting and management and add the elements that are necessary to make them working…

MULTIFORESEE

MULTIFORESEE MULTI-modal Imaging of FOREnsic SciEnce Evidence The main objective of the COST Action CA16101, entitled MULTI-modal Imaging of FOREnsic SciEnce Evidence (MULTI-FORESEE)- tools for Forensic Science, is to promote innovative, multi-informative, operationally deployable and commercially exploitable imaging solutions/technology to analyse forensic evidence. Forensic evidence includes, but not limited to, fingermarks, hair, paint, biofluids, digital evidence, fibers, documents and living individuals. Imaging technologies include optical, mass spectrometric, spectroscopic, chemical, physical and digital forensic techniques complemented by expertise in IT solutions and computational modelling. Imaging technologies enable multiple physical and chemical information to be captured in one analysis, from one specimen, with information being more easily conveyed and understood for a more rapid exploitation. The enhanced value of the evidence gathered will be conducive to much more informed investigations and judicial…

SODALITE

SODALITE SOftware Defined AppLication Infrastructures managemenT and Engineering SODALITE (SOftware Defined AppLication Infrastructures managemenT and Engineering) is aimed at tackling the complexity of deploying and operating modern applications onto heterogeneous HPC and cloud-based software-defined infrastructures, under arbitrary operational conditions and requirements. This challenge is addressed through (a) the abstraction of the application and software-defined infrastructures, (b) the automation of maintaining a dynamic balance between the application and the infrastructure, and (c) the design and runtime analysis of software-defined infrastructures. The novelty of the SODALITE’s approach lies in developing and using an application, infrastructure, and performance abstraction library to enable dynamically optimized multi-target application execution via an optimal mixture of Cloud, HPC, GPUs, FPGAs, etc., based on the requirements of the application itself and the dynamic state of the infrastructure. Further…

MIICT

MIICT ICT Enabled Services for Migration MIICT (ICT Enabled Services for Migration) was conceived with the goal of designing, developing and deploying tools that address the challenge of migrant integration through the co-creation of improved ICT-enabled services with migrants, refugees, public sector services, NGOs (Non-Governmental-Organisations) and other interest groups. By involving research-users at the centre of our approach we address the need to improve and customise the interfaces used to access key public services so that they better address the requirements of migrants and refugees. In service of this goal, MIICT proposes the development of “IMMERSE” (Integration of Migrants MatchER SErvice), a database system that captures the specific socio-cultural, economic and legal contexts of migrants that is shared with public authorities. In order to promote inclusion and reduce the potential…

MindSpaces

MindSpaces Art-driven adaptive outdoors and indoors design MindSpaces aims to create a novel approach to urban and architectural design by generating 3D-VR immersive and emotion-adaptive ‘neuro-environments’ that will help in designing emotionally-relevant urban spaces. The emotional aspects of an environment will be captured through the use of mobile EEG (Elecroencephalography) headsets, wearable bracelets/watches, and other physiological sensors that will be embedded with a VR-headset, so as to allow capturing the neuro-feedback of a VR-experience. The neuro-feedback will allow the virtual space to be adapted accordingly, resulting in an emotion-adaptive space. The ‘neuro-environments’ will be used at two levels of granularity. At the first level, artists and creatives will experience the ‘neuro-environments’ with the intention to improve the emotional-relevance of the urban space through the neuro-feedback of individuals, that have very-well…

DIH^2

DIH^2 A Pan-European Network of Robotics DIHs for Agile Production DIH^2 is a network of 26 DIHs, with a target to reach over 170 DIHs. The sole aim of the network is to spark incremental (cut 50% cost of advance robotics solutions, double the growth of robotics market) and disruptive (maximum productivity & optimum agility) innovations in over 300,000 Manufacturing SMEs and Mid-Caps. It will support SMEs in their Agile Production challenge (50% increase in productivity) and unleash their digitalization potential by enabling robot solutions that are more cost effective at lower lot sizes. DIH^2 relies on: A Common Open Platform Reference Architecture for Agile Production (COPRA-AP) -based on Industrial Data Space Reference Architecture Model and FIWARE technologies- to serve the needs of SMEs by means of a continuously growing…

ARESIBO

ARESIBO Augmented Reality Enriched Situation Awareness for Border Security ARESIBO aims at improving the efficiency of the border surveillance systems by providing the operational teams and the tactical command and control level with an accurate and comprehensive information. The pillars of research in ARESIBO are three-fold: (i). Set-up a complete configuration at tactical and execution level to optimize the collaboration between human and sensors (fixed and mobile), (ii) Improve situation awareness by enhancing the understanding of the situation through adapted processing of sensor data, correlation between heterogeneous data and information and creation of knowledge through deep learning techniques and (iii) Create a situation awareness capability at C2 level that will combine reports on previous missions, real time situation understanding and threat analysis for future actions. This capability will be used…

ECHO

ECHO European network of Cybersecurity centres and competence Hub for innovation and Operations ECHO delivers an organized and coordinated approach to improve proactive cyber defence of the European Union, through effective and efficient multi-sector collaboration. The Partners will execute on a 48-month work plan to develop, model and demonstrate a network of cyber research and competence centres, with a central competence at the hub. The Central Competence Hub serves as the focal point for the ECHO Multi-sector Assessment Framework enabling multi-sector dependencies management, provision of an ECHO Early Warning System, an ECHO Federation of Cyber Ranges and management of an expanding collection of Partner Engagements. The ECHO Multi-sector Assessment Framework refers to the analysis of challenges and opportunities derived from sector specific use cases, transversal cybersecurity needs analysis and development…

aqua3S

aqua3S Enhancing Standardisation strategies to integrate innovative technologies for Safety and Security in existing water networks Exposure of citizens to potential disasters has led to vulnerable societies that require risk reduction measures. Drinking water is one of the main risk sources when its safety and security are not ensured. aqua3S combines novel technologies in water safety and security, aiming to standardize existing sensor technologies complemented by state-of-the-art detection mechanisms. Hence, it could propose innovative solutions to water facilities and responsible authorities in order to detect and tackle water-related crises in a timely manner. On the one hand, sensor networks are deployed in water supply networks and sources, supported by complex sensors for enhanced detection; on the other hand, sensor measurements are supported by videos from Unmanned Aerial Vehicles (UAVs), satellite…

INGENIOUS

INGENIOUS The First Responder (FR) of the Future: a Next Generation Integrated Toolkit (NGIT) for Collaborative Response, increasing protection and augmenting operational capacity Today’s First Responders (FR) are using technology of the past. During their primary mission of saving lives and preserving society’s safety and security, FRs face a multitude of challenges. In both small scale emergencies and large scale disasters, they often deal with life-threatening situations, hazardous environments, uncharted surroundings and limited awareness. Threats and hazards evolve rapidly, crossing municipalities, regions and nations with speed and ease. Armouring public safety services with all the tools that modern technology has to offer is critical. Such tools holistically enhance their protection and augment their operational capacities, assisting them in saving lives as well as ensuring their safe return from the disaster…

CREST

CREST Fighting Crime and TerroRism with an IoT-enabled Autonomous Platform based on an Ecosystem of Advanced IntelligEnce, Operations, and InveStigation Technologies CREST aims to equip LEAs with an advanced prediction, prevention, operation, and investigation platform by leveraging the IoT ecosystem, autonomous systems, and targeted technologies and building upon the concept of multidimensional integration and correlation of heterogeneous multimodal data streams (ranging from online content to IoT-enabled sensors) for a) threat detection and assessment, b) dynamic mission planning and adaptive navigation for improved surveillance based on autonomous systems, c) distributed command and control of law enforcement missions, d) sharing of information and exchange of digital evidence based on blockchain, and e) delivery of pertinent information to different stakeholders in an interactive manner tailored to their needs. CREST will also provide chain-of-custody,…

WELCOME

WELCOME Multiple Intelligent Conversation Agent Services for Reception, Management and Integration of Third Country Nationals in the EU The objective of WELCOME is to research and develop intelligent technologies for support of the reception and integration of migrants in Europe. Unlike the majority of the projects that address the problem of migrant integration by frontends with “one-for-all” interfaces for information acquisition and services, WELCOME will offer a personalized and psychologically and socially competent solution for both migrants and public administrations. It will develop immersive and intelligent services, in which embodied intelligent multilingual agents will act as dedicated personalized assistants of migrants in contexts of registration, orientation, language teaching, civic education, and social and societal inclusion. The agents will be personalized in the sense that they will dynamically adapt their interaction…

INFINITY

INFINITY IMMERSE. INTERACT. INVESTIGATE Infinity’s ambition is to become a flagship project against society’s most pressing cybercriminal, terrorist and hybrid threats. Synthesising the latest innovations in virtual and augmented reality, artificial intelligence and machine learning with big data and visual analytics, Infinity will deliver an integrated solution that aims to revolutionise data driven investigations. Bringing together a strong representation from national and supranational agencies with an end user-driven design, it will directly address the core needs of contemporary law enforcement. Specifically, it will equip investigators and analysts with cutting-edge tools to acquire, process, visualise and act upon the enormous quantities of data they are faced with every day. Bolstered by cognitive research, automated systems and instinctive interfaces and controls, Infinity will be designed and developed to maximise the potential of…