SENSE

Project organized by the National University of Science and Technology Politehnica Bucharest in partnership with the State University of Moldova.

Learn more

Sensory Engagement Network for Shared Experiences

Project Details

Program: Complex Bilateral projects with Republic of Moldova

Domain: Culture, creativity and inclusive society (ASC)

Sub-domain: Inclusive development and reduction of vulnerabilities

Project code: PN-IV-PCB-RO-MD-2024-0392

Project Title: Sensory Engagement Network for Shared Experiences (SENSE)

Contract Number: 31PCBROMD ⁄ 2025

Project Director: Ana Nicolae (Neacșu)

What is SENSE?

SENSE is a research project focused on developing a technology capable of translating music and speech into real-time multisensory feedback.

Using advanced AI modules (source separation, speech recognition, and feature extraction), the platform will enable both hearing and hearing-impaired individuals to perceive sound through other senses.

The project is built on the scientific collaboration between the National University of Science and Technology Politehnica of Romania and the State University of Moldova, leveraging their combined expertise in audio processing, optimization, and artificial intelligence.

Latest Updates

SENSE State of the Art Report: Foundations for Multisensory Audio Experiences

This State-of-the-Art report provides a comprehensive review of the scientific and technological landscape underpinning the SENSE project. It examines recent advances in audio source separation, music information retrieval, speech recognition, multimodal and foundation models, as well as emerging approaches to haptic and tactile feedback. The document establishes the conceptual and technical baseline for transforming audio into coherent multisensory experiences, and outlines key challenges and research directions that guide the development of the SENSE platform.

Read SOTA report