This paper examines the potential of Synthetic Users (SyU) as a possible alternative or supplement to conventional human surveys in the area of innovative product or service development. Generative Artificial Intelligence (GenAI) can be an invaluable technology for companies and creative businesses during the “Eureka phase” and in testing, economic analysis, development, and manufacturing. GenAI can rapidly answer hundreds of questions without causing fatigue, creating rapid feedback and making it a cost-effective alternative to human testing (Aher et al., 2023). The deployment of SyU promises a more efficient business world, offering benefits such as predictive and cultural insights, and faster iteration, contributing to a deeper understanding of the emotional drivers behind user behaviours. SyU could be an innovative approach that blurs the boundaries between qualitative and quantitative investigation by allowing researchers to gain rich insights and leverage large-scale data, lowering biases in human interactions, observer-expectancy effects, emphasizing the importance of diverse data, objective questioning, and regular evaluation (Santurkar, S. et al., 2023). Finally, while conducting a survey again under identical conditions in the real world is not always feasible, in the synthetic realm it is possible to improve the LLMs approach through a recent technique known as "self refinement" (selfrefine.info), based on an iterative algorithm, punctuated by two moments, feedback and refinement, that result in higher quality output and a more structured process. (Maadan et al., 2023) After reviewing the current state of the art, the article explores the potential of Large Language models (LLMs) to simulate human-like interactions and judgments through a real case. One company, Syntheticusers.com, based on GPT-4, has been selected to test the comparison between human participants and SyU in evaluating an immersive museum experience within a 5G-focused project led by the University of Turin. Our results suggest that scientists study the right mix of humans and artificial intelligence, rather than focusing on whether artificial intelligence will replace humans.

Business Amplification: Managing Innovation through Synthetic Users

Paola Pisano;Dario Malerba;Teresa Bettini;Manlio Del Giudice
2024-01-01

Abstract

This paper examines the potential of Synthetic Users (SyU) as a possible alternative or supplement to conventional human surveys in the area of innovative product or service development. Generative Artificial Intelligence (GenAI) can be an invaluable technology for companies and creative businesses during the “Eureka phase” and in testing, economic analysis, development, and manufacturing. GenAI can rapidly answer hundreds of questions without causing fatigue, creating rapid feedback and making it a cost-effective alternative to human testing (Aher et al., 2023). The deployment of SyU promises a more efficient business world, offering benefits such as predictive and cultural insights, and faster iteration, contributing to a deeper understanding of the emotional drivers behind user behaviours. SyU could be an innovative approach that blurs the boundaries between qualitative and quantitative investigation by allowing researchers to gain rich insights and leverage large-scale data, lowering biases in human interactions, observer-expectancy effects, emphasizing the importance of diverse data, objective questioning, and regular evaluation (Santurkar, S. et al., 2023). Finally, while conducting a survey again under identical conditions in the real world is not always feasible, in the synthetic realm it is possible to improve the LLMs approach through a recent technique known as "self refinement" (selfrefine.info), based on an iterative algorithm, punctuated by two moments, feedback and refinement, that result in higher quality output and a more structured process. (Maadan et al., 2023) After reviewing the current state of the art, the article explores the potential of Large Language models (LLMs) to simulate human-like interactions and judgments through a real case. One company, Syntheticusers.com, based on GPT-4, has been selected to test the comparison between human participants and SyU in evaluating an immersive museum experience within a 5G-focused project led by the University of Turin. Our results suggest that scientists study the right mix of humans and artificial intelligence, rather than focusing on whether artificial intelligence will replace humans.
2024
19th International Forum on Knowledge Asset Dynamics - Translating Knowledge into Innovation Dynamics
Madrid, Spain
12-14 June 2024
Proceedings IFKAD 2024 - Translating Knowledge into Innovation Dynamics
IFKAD
536
564
978-88-96687-17-8
Artificial Intelligence, Large Language Models, Synthetic User, Immersive Reality, Innovation Management
Paola Pisano, Dario Malerba, Teresa Bettini, Manlio Del Giudice
File in questo prodotto:
File Dimensione Formato  
Business Amplification Managing Innovation through _IFKAD2024_PROCEEDINGS_eBOOK -537-565.pdf

Accesso aperto

Dimensione 925.95 kB
Formato Adobe PDF
925.95 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/2318/2030315
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact