Humor is a complex aspect of human communication that has yet to be fully understood and replicated by artificial agents. Despite this, large language models (LLMs) such as OpenAI's ChatGPT have gained attention for their ability to capture implicit and contextual information, leading some to wonder if they can also tell jokes on a human level. To test this hypothesis, researchers conducted a series of exploratory experiments around joke generation, explanation, and detection. In the joke generation task, ChatGPT was tasked with generating valid jokes. However, this alone does not necessarily reflect the system's ability to understand humor from a human perspective. The results showed that while ChatGPT accurately explained valid jokes, it also came up with fictional explanations for invalid ones. To examine how closely ChatGPT's understanding of humor is connected to certain characteristics commonly found in jokes, researchers manually modified the top 25 jokes to eliminate one or multiple criteria: structure, topic, and wordplay. The results revealed that these criteria were central characteristics for ChatGPT's conception of humor but could also mislead it in classifying jokes. Overall, while ChatGPT has not yet solved computational humor entirely, it represents a significant step towards creating "funny" machines. However, more research is needed to fully understand how artificial agents comprehend and generate humor compared to humans.
Humor is something that people use to make each other laugh, but it's hard for computers to understand. Some scientists made a computer program called ChatGPT that can understand some jokes, but not all of them. They did experiments to see how well ChatGPT could make jokes and explain them. ChatGPT was good at explaining real jokes, but sometimes made up silly explanations for fake ones. It also focused on certain things in jokes like how they're structured or the words used, but this could sometimes make it confused.
Definitions
- Humor: Something that makes people laugh or feel amused.
- Artificial agents: Computer programs or robots designed to do tasks without human help.
- Language models: Computer programs that can understand and generate language.
- Hypothesis: An idea or explanation that needs to be tested.
- Conception: The way someone thinks about or understands something.
Exploring the Potential of Artificial Agents to Understand and Generate Humor
Humor is a complex aspect of human communication that has yet to be fully understood and replicated by artificial agents. Despite this, large language models (LLMs) such as OpenAI's ChatGPT have gained attention for their ability to capture implicit and contextual information, leading some to wonder if they can also tell jokes on a human level. To answer this question, researchers conducted a series of exploratory experiments around joke generation, explanation, and detection.
Joke Generation Task
In the joke generation task, ChatGPT was tasked with generating valid jokes. However, this alone does not necessarily reflect the system's ability to understand humor from a human perspective. The results showed that while ChatGPT accurately explained valid jokes, it also came up with fictional explanations for invalid ones.
Examining Characteristics Found in Jokes
To examine how closely ChatGPT's understanding of humor is connected to certain characteristics commonly found in jokes, researchers manually modified the top 25 jokes to eliminate one or multiple criteria: structure, topic, and wordplay. The results revealed that these criteria were central characteristics for ChatGPT's conception of humor but could also mislead it in classifying jokes.
Conclusion
Overall, while ChatGPT has not yet solved computational humor entirely, it represents a significant step towards creating "funny" machines. However, more research is needed to fully understand how artificial agents comprehend and generate humor compared to humans.
Humor is a central aspect of human communication that has not been solved for artificial agents so far. Large language models (LLMs) are increasingly able to capture implicit and contextual information. Especially, OpenAI's ChatGPT recently gained immense public attention. The GPT3-based model almost seems to communicate on a human level and can even tell jokes. Humor is an essential component of human communication. But is ChatGPT really funny? We put ChatGPT's sense of humor to the test. In a series of exploratory experiments around jokes, i.e., generation, explanation, and detection, we seek to understand ChatGPT's capability to grasp and reproduce human humor. Since the model itself is not accessible, we applied prompt-based experiments. Our empirical evidence indicates that jokes are not hard-coded but mostly also not newly generated by the model. Over 90% of 1008 generated jokes were the same 25 Jokes. The system accurately explains valid jokes but also comes up with fictional explanations for invalid jokes. Joke-typical characteristics can mislead ChatGPT in the classification of jokes. ChatGPT has not solved computational humor yet but it can be a big leap toward "funny" machines.
