This paper explores the dynamics of trust and manipulation in generative AI systems, proposing digital humanism as a critical framework to re-evaluate our relationship with such technologies. We conceptualise trust as an evaluative act – a normative judgement about the trustworthiness of a system in a given context – and argue that trust in generative AI is structurally misguided. This is not because such systems lack moral agency, but because the trust placed in them has been uncritically extended from deterministic technologies, whereas generative models are probabilistic and non-linear. These systems should be approached not as ‘truth-tellers’, but as ‘storytellers.’ We further argue that deceptive features – such as their anthropomorphic linguistic style and confident rhetorical tone – exacerbate this misalignment, making users more vulnerable. Digital humanism offers a fruitful perspective for understanding these dynamics, encouraging us to engage with AI not as neutral tools, but as cultural artefacts that shape our values, behaviour, and epistemic practices.

Trust and Manipulation in Generative AI: A Digital Humanist Perspective

Francesco Striano;Maria Zanzotto
2025-01-01

Abstract

This paper explores the dynamics of trust and manipulation in generative AI systems, proposing digital humanism as a critical framework to re-evaluate our relationship with such technologies. We conceptualise trust as an evaluative act – a normative judgement about the trustworthiness of a system in a given context – and argue that trust in generative AI is structurally misguided. This is not because such systems lack moral agency, but because the trust placed in them has been uncritically extended from deterministic technologies, whereas generative models are probabilistic and non-linear. These systems should be approached not as ‘truth-tellers’, but as ‘storytellers.’ We further argue that deceptive features – such as their anthropomorphic linguistic style and confident rhetorical tone – exacerbate this misalignment, making users more vulnerable. Digital humanism offers a fruitful perspective for understanding these dynamics, encouraging us to engage with AI not as neutral tools, but as cultural artefacts that shape our values, behaviour, and epistemic practices.
2025
23rd STS Conference Graz 2025
Graz
05/05/2025 - 07/05/2025
Conference Proceedings of the 23rd STS Conference Graz 2025
Verlag der TU Graz
121
136
978-3-99161-062-5
https://openlib.tugraz.at/conference-proceedings-of-the-23rd-sts-conference-graz-2025-2026
Francesco Striano; Maria Zanzotto
File in questo prodotto:
File Dimensione Formato  
[PDF_Ed] Striano-Zanzotto - Trust and Manipulation in Generative AI.pdf

Accesso aperto

Descrizione: Striano-Zanzotto - Trust and Manipulation in Generative AI
Tipo di file: PDF EDITORIALE
Dimensione 901.61 kB
Formato Adobe PDF
901.61 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/2111130
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact