AI and ChatGPT are and will remain on everyone’s lips. New fields of application for the AI of OpenAI are found almost every day. Their latest achievement: ChatGPT passes the Minnesota Law University exam – albeit just barely.
Because while ChatGPT was able to get through the exam with well-formulated texts, bad math results in particular ensured that in the end it was only enough for a mediocre result.
ChatGPT has a math weakness
Jonathan Choi, a professor at the University of Minnesota Law School, came up with the idea for the experiment. target of project was to find out how good ChatGPT could be as a learning tool for aspiring lawyers.
To do this, he gave the AI language model the same test that the students had to pass. This was broken down into 95 multiple-choice questions and twelve word problems. The test was then mixed with the other students’ test results and handed over to the correctors.
more on the subject
What is ChatGPT? This is how the powerful AI tool works
The bot received an overall grade of C+ for its exam, which corresponds to a school grade of 2.7 in Europey. The result was enough to pass the exam. However, ChatGPT ranks among the worse students. Above all, multiple-choice questions from the field of mathematics seemed to cause great difficulties for the AI.
But even with the text tasks, the bot could not consistently shine. The essays ChatGPT wrote were well articulated and structured. But the AI struggled to answer open questions, identify problems, and often wandered off topic.
A trait of OpenAI’s language model is the habit of explaining things at length without being asked. ChatGPT often delivered the correct answer first in the exam, only to then completely miss the task with the next paragraphs.
The way the bot phrased sentences, often repeating itself, was so striking that two of the three proofreaders questioned the artificial nature of the Students
recognized.
link to Twitter content
For Jonathan Choi, ChatGPT did not prove to be a particularly good law student in the test. However, he can imagine that such language models with more human input could become a useful learning tool for law students.
The bot can also be used as a tool for everyday use. We show you 14 ways how to use ChatGPT creatively:
Make your life easier with these 14 ways to use ChatGPT in everyday life
Our question to the students in our community: Have you ever used the bot as a learning tool for school or university? Did it help you or did you have to follow up and check so many times that it ended up being more work? Tell us in the comments!
