Skip to Main Content (Press Enter)

Logo UNIMI
  • ×
  • Home
  • People
  • Projects
  • Fields
  • Units
  • Outputs
  • Third Mission

Expertise & Skills
Logo UNIMI

|

Expertise & Skills

unimi.it
  • ×
  • Home
  • People
  • Projects
  • Fields
  • Units
  • Outputs
  • Third Mission
  1. Projects

Transforming auditory-based social interaction and communication in AR/VR (SONICOM)

Project
Immersive audio is our everyday experience of being able to hear and interact with sounds around us. Simulating
spatially located sounds in virtual or augmented reality (VR/AR) must be done in a unique way for each individual
and currently requires expensive and time-consuming individual measurements, making it commercially unfeasible.
Furthermore, the impact of immersive audio beyond perceptual metrics such as presence and localisation is still an
unexplored area of research, specifically when related with social interaction, entering the behavioural and cognitive
realms. SONICOM will revolutionise the way we interact socially within AR/VR environments and applications by
leveraging methods from Artificial Intelligence (AI) to design a new generation of immersive audio technologies
and techniques, specifically looking at personalisation and customisation of the audio rendering. Using a data-driven
approach, it will explore, map and model how the physical characteristics of spatialised auditory stimuli can influence
observable behavioural, physiological, kinematic, and psychophysical reactions of listeners within social interaction
scenarios. The developed techniques and models will be evaluated in an ecologically valid manner, exploiting AR/
VR simulations as well as real-life scenarios, and developing appropriate hardware and software proofs-of-concept.
Finally, in order to reinforce the idea of reproducible research and promoting future development and innovation in the
area of auditory-based social interaction, the SONICOM Ecosystem will be created, which will include auditory data
closely linked with model implementations and immersive audio rendering components.
  • Overview
  • Research Areas
  • Publications

Overview

Contributors

AVANZINI FEDERICO   Scientific Manager  

Departments involved

Dipartimento di Informatica Giovanni Degli Antoni   Principale  

Type

H20_RIA - Horizon 2020_Research & Innovation Action/Innovation Action

Funder

EUROPEAN COMMISSION
External Organization Funding Organization

Date/time interval

January 1, 2021 - June 30, 2026

Project duration

66 months

Research Areas

Concepts


Settore INF/01 - Informatica

Publications

Outputs (9)

A Low-Dimensional Projection of Sound Absorption Coefficients for a Scattering Delay Network Reverberator 
AES
AUDIO ENGINEERING SOCIETY
2026
Academic Article
Open Access
Altmetric is disabled. Enable it on "Use of Cookies"
A Survey on Machine Learning Techniques for Head-Related Transfer Function Individualization 
IEEE OPEN JOURNAL OF SIGNAL PROCESSING
IEEE OPEN JOURNAL
2025
Academic Article
Open Access
Altmetric is disabled. Enable it on "Use of Cookies"
Co-immersion in Audio Augmented Virtuality: the Case Study of a Static and Approximated Late Reverberation Algorithm 
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS
INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS (IEEE)
2023
Academic Article
Open Access
Altmetric is disabled. Enable it on "Use of Cookies"
MoTT: A Speech Dataset for Modular Composition of Turn-Taking Conversations 
IEEE
2025
Conference Paper
Reserved Access
Altmetric is disabled. Enable it on "Use of Cookies"
A Highly Parametrized Scattering Delay Network Implementation for Interactive Room Auralization 
PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON DIGITAL AUDIO EFFECTS
UNIVERSITY OF SURREY
2024
Conference Paper
Open Access
PAN-AR: A Multimodal Dataset of Higher-Order Ambisonics Room Impulse Responses, Ambient Noise and Spherical Pictures 
2024
Conference Paper
Open Access
Altmetric is disabled. Enable it on "Use of Cookies"
Toward a Novel Set of Pinna Anthropometric Features for Individualizing Head-Related Transfer Functions 
2024
Conference Paper
Open Access
Altmetric is disabled. Enable it on "Use of Cookies"
Automatic Parameters Tuning of Late Reverberation Algorithms for Audio Augmented Reality 
2022
Conference Paper
Open Access
Altmetric is disabled. Enable it on "Use of Cookies"
HRTF Individualization Based on Anthropometric Measurements Extracted from 3D Head Meshes 
IEEE
2021
Conference Paper
Open Access
Altmetric is disabled. Enable it on "Use of Cookies"
  • Guide
  • Help
  • Accessibility
  • Privacy
  • Use of cookies
  • Legal notices

Powered by VIVO | Designed by Cineca | 26.6.0.0