Abstract
ChatGPT is a large-scale language model developed by OpenAI. Its purpose is to start a conversation with people and provide them with information ranging from simple facts to more complex topics. Trained on a large amount of text data, ChatGPT has shown us that it can understand human language and respond in a meaningful way. In this paper, we show a way to judge whether ChatGPT can accurately understand the various meanings of words and use them based on the answers output by ChatGPT. The five dimensions, each scored up to 5 points, are word explanation, etymology, synonyms and antonyms, sentence construction and explanation of words in sentences. Results of testing are Word Explanation, Etymology, Sentence Structure and Interpretation all scored 4 or above. Then, the tests show lower score for synonyms and antonyms with an average score of 1.86. The average overall score is 20.44 in 25. Although ChatGPT is slightly inferior in synonyms and antonyms, the results show that ChatGPT understands the meaning of words well.
College
College of Science & Engineering
Department
Computer Science
Campus
Winona
First Advisor/Mentor
Mingrui Zhang
Second Advisor/Mentor
Sudharsan Iyengar
Start Date
4-19-2023 10:00 AM
End Date
4-19-2023 11:00 AM
Presentation Type
Poster Session
Format of Presentation or Performance
In-Person
Session
1b=10am-11am
Poster Number
45
Included in
Investigating the Comprehension of GPT's Interpretation of Word Meanings
ChatGPT is a large-scale language model developed by OpenAI. Its purpose is to start a conversation with people and provide them with information ranging from simple facts to more complex topics. Trained on a large amount of text data, ChatGPT has shown us that it can understand human language and respond in a meaningful way. In this paper, we show a way to judge whether ChatGPT can accurately understand the various meanings of words and use them based on the answers output by ChatGPT. The five dimensions, each scored up to 5 points, are word explanation, etymology, synonyms and antonyms, sentence construction and explanation of words in sentences. Results of testing are Word Explanation, Etymology, Sentence Structure and Interpretation all scored 4 or above. Then, the tests show lower score for synonyms and antonyms with an average score of 1.86. The average overall score is 20.44 in 25. Although ChatGPT is slightly inferior in synonyms and antonyms, the results show that ChatGPT understands the meaning of words well.
