This paper aims to investigate the feasibility of utilising Large Language Models (LLMs) and Latent Diffusion Models (LDMs) for automatically categorising word basicness and concreteness, i.e. two well-known aspects of language having significant relevance on tasks such as text simplification. To achieve this, we propose two distinct approaches: i) a generative Transformer-based LLM, and ii) a image+text multi-modal pipeline, referred to as stableKnowledge, which utilises a LDM to map terms to the image level. The evaluation results indicate that while the LLM approach is particularly well-suited for recognising word basicness, stableKnowledge outperforms the former when the task shifts to measuring concreteness.

How Shall a Machine Call a Thing?

Torrielli F.
First
;
Rapp A.;Di Caro L.
2023-01-01

Abstract

This paper aims to investigate the feasibility of utilising Large Language Models (LLMs) and Latent Diffusion Models (LDMs) for automatically categorising word basicness and concreteness, i.e. two well-known aspects of language having significant relevance on tasks such as text simplification. To achieve this, we propose two distinct approaches: i) a generative Transformer-based LLM, and ii) a image+text multi-modal pipeline, referred to as stableKnowledge, which utilises a LDM to map terms to the image level. The evaluation results indicate that while the LLM approach is particularly well-suited for recognising word basicness, stableKnowledge outperforms the former when the task shifts to measuring concreteness.
2023
International Conference on Applications of Natural Language to Information Systems, NLDB 2023
Derby, UK
21/23 June 2023
NLDB 2023: Natural Language Processing and Information Systems
Elisabeth Métais, Farid Meziane, Vijayan Sugumaran, Warren Manning, Stephan Reiff-Marganiec
13913 LNCS
546
557
978-3-031-35319-2
978-3-031-35320-8
https://www.springer.com/series/558
Large Language Models, Latent Diffusion Models, Language Basicness, Language Concreteness, Text Simplification
Torrielli F.; Rapp A.; Di Caro L.
File in questo prodotto:
File Dimensione Formato  
How_shall_a_machine_call_a_thing___Camera_Ready_.pdf

Open Access dal 14/06/2024

Tipo di file: POSTPRINT (VERSIONE FINALE DELL’AUTORE)
Dimensione 379.48 kB
Formato Adobe PDF
379.48 kB Adobe PDF Visualizza/Apri
2023-NLDB.pdf

Accesso riservato

Tipo di file: PDF EDITORIALE
Dimensione 366.68 kB
Formato Adobe PDF
366.68 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/1938595
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact