Mathematical expressions are complex hierarchical structures of symbols that are usually accessed by visual inspection. These expressions are seldom rendered with natural language since users are not usually required to read them aloud. People with a visual impairment generally use LATEX with screen readers to acquire mathematical expressions. However, LATEX can be verbose, slow to listen, and difficult to learn. This work proposes a way to make mathematical expressions easier to be accessed by people with disabilities by exploiting their hierarchical structures. We describe and evaluate a dialogue system to vocally navigate mathematical expressions in English. In contrast with standard screen readers, the vocal interaction allows people to query the system about sub-parts of the expressions.

Building a Spoken Dialogue System for Supporting Blind People in Accessing Mathematical Expressions

Pier Felice Balestrucci;Luca Anselma;Cristian Bernareggi;Alessandro Mazzei
2023-01-01

Abstract

Mathematical expressions are complex hierarchical structures of symbols that are usually accessed by visual inspection. These expressions are seldom rendered with natural language since users are not usually required to read them aloud. People with a visual impairment generally use LATEX with screen readers to acquire mathematical expressions. However, LATEX can be verbose, slow to listen, and difficult to learn. This work proposes a way to make mathematical expressions easier to be accessed by people with disabilities by exploiting their hierarchical structures. We describe and evaluate a dialogue system to vocally navigate mathematical expressions in English. In contrast with standard screen readers, the vocal interaction allows people to query the system about sub-parts of the expressions.
2023
Italian Conference on Computational Linguistics
Venice, Italy
November 30 - December 2, 2023
Proceedings of the 9th Italian Conference on Computational Linguistics (CLiC-it 2023)
CEUR-WS
3596
1
8
https://ceur-ws.org/Vol-3596/paper8.pdf
dialogue system, natural language processing, visually impaired people
Pier Felice Balestrucci, Luca Anselma, Cristian Bernareggi, Alessandro Mazzei
File in questo prodotto:
File Dimensione Formato  
paper8.pdf

Accesso aperto

Dimensione 1.19 MB
Formato Adobe PDF
1.19 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1950755
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact