Framing Generative AI: Chatbot conceit or intelligent interaction?
In the early 2020s, Large Language Models (LLMs), such as Bert, found their way into many Natural Language Processing applications. LLMs also captured the attention of the media, especially OpenAI’s GPT 2 and 3 series. And yet, the perceived real worldwide breakthrough came only in November 2022, with the release of ChatGPT. Soon traditional tests of machine intelligence, such as the Turing Test, were called into question (Biever, 2023).
By framing interactions with LLMs, that is language generators, as dialogue, it seemed that genuine conversational partners or speakers had been created. This was however not the first time that framing interaction as dialogue convinced people of the intelligence of a machine. In the 1960s, ELIZA, a simple rule-based chatbot, was able to convince some users that it was a real psychotherapist (Weizenbaum, 1966). Later research has suggested that people have a natural tendency to treat new media as real people (Reeves & Nass, 1996). This raises the question whether the framing of LLMs as conversational partners is a conceit - the chatbot conceit (Piwek, 2024) - or a genuine step towards intelligent interaction.
The project will systematically examine to what extent framing interactions with LLMs as dialogue affects people’s perceptions of the LLMs. The aim is for project’s findings to shed light on the impact of the chatbot conceit and the broader implications for the field of AI and human-computer interaction.
Skills required
A good undergraduate degree (2.1 or above) in Computing (or equivalent), with experience in artificial intelligence, computational linguistics, natural language processing or human-computer interaction.
Background Reading
Biever, Celeste (2023). ChatGPT broke the Turing test — the race is on for new ways to assess AI. Nature, 619:686–689.
Piwek, Paul (2024). Are conversational large language models speakers? In: SemDial 2024: The 28th Workshop on the Semantics and Pragmatics of Dialogue (Bernardi, Raffaella; Breitholtz, Ellen and Riccardi, Guiseppe eds.), 11-12 Sep 2024, Rovereto, Italy.
Reeves, Byron and Nass, Clifford (1996). The Media Equation: How People Treat Computers, Television, and New Media like Real People and Places. Cambridge University Press.
Weizenbaum, Joseph (1966). Eliza: A computer program for the study of natural language communication between man and machine. Commun. ACM, 9(1):36– 45.