In this paper, we describe our intuitions about how language tech- nologies can contribute to create new ways to enhance the accessi- bility of exhibits in cultural contexts by exploiting the knowledge about the history of our senses and the link between perception and language. We evaluate the performance of fve multi-class classifcation models for the task of sensory recognition and introduce the DEEP Sensorium (Deep Engaging Experiences and Practices - Sensorium), a multidimensional dataset that combines cognitive and afective features to inform systematic methodologies for augmenting ex- hibits with multi-sensory stimuli. For each model, using diferent feature sets, we show that the features expressing the afective dimension of words combined with sub-lexical features perform better than uni-dimensional training sets.

The DEEP Sensorium: a multidimensional approach to sensory domain labelling

Corciulo, Simona
;
Bioglio, Livio;Basile, Valerio;Patti, Viviana;Damiano, Rossana
2023-01-01

Abstract

In this paper, we describe our intuitions about how language tech- nologies can contribute to create new ways to enhance the accessi- bility of exhibits in cultural contexts by exploiting the knowledge about the history of our senses and the link between perception and language. We evaluate the performance of fve multi-class classifcation models for the task of sensory recognition and introduce the DEEP Sensorium (Deep Engaging Experiences and Practices - Sensorium), a multidimensional dataset that combines cognitive and afective features to inform systematic methodologies for augmenting ex- hibits with multi-sensory stimuli. For each model, using diferent feature sets, we show that the features expressing the afective dimension of words combined with sub-lexical features perform better than uni-dimensional training sets.
2023
2nd International Workshop on Multisensory Data and Knowledge (MDK)
University of Texas at Austin
01/05/2023
WWW '23 Companion: Companion Proceedings of the ACM Web Conference 2023
ACM Digital Library
661
668
9781450394192
https://dl.acm.org/doi/10.1145/3543873.3587631
multidimensional lexicon, accessibility, afect, machine learning, multi-sensory design, museums
Corciulo, Simona; Bioglio, Livio; Basile, Valerio; Patti, Viviana; Damiano, Rossana
File in questo prodotto:
File Dimensione Formato  
3543873.3587631.pdf

Accesso aperto

Tipo di file: PDF EDITORIALE
Dimensione 595.54 kB
Formato Adobe PDF
595.54 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1906081
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact