Why did ChatGPT get dumber in basic math?

A survey released reveals a huge challenge for AI development: ChatGPT has become worse at performing some basic math operations.

Researchers at Stanford University and the University of California, Berkeley they said that deterioration is an example of a phenomenon known to AI developers as drift.

chatgpt featured

What happens;

Attempts to improve one part of highly complex AI models make other parts of the models perform worse.

So far, researchers have tested two versions of ChatGPT: version 3.5, which is available for free online, and subscription version 4.0. The results are not promising.

They gave the chatbot a basic task: recognize whether a certain number is a prime number.

Is 17.077 a prime number? Is 17.947 first? If you're not an insider, you can't work it out in your head, but it's very easy for computers to evaluate.

To track performance, the researchers fed ChatGPT 1.000 different numbers. In March, the premium GPT-4 correctly identified whether 84% of the numbers were prime or not, a fairly modest performance for a computer.

By June his success rate had dropped to 51%. In eight different tasks, GPT-4 performed worse in six of them.

GPT-3.5 improved a bit, but remains worse than its smart brother in most cases.

iGuRu.gr The Best Technology Site in Greecefgns

Subscribe to Blog via

Subscribe to this blog and receive notifications of new posts by email.

Chat GPT

Written by giorgos

George still wonders what he's doing here ...

Leave a reply

Your email address is not published. Required fields are mentioned with *

Your message will not be published if:
1. Contains insulting, defamatory, racist, offensive or inappropriate comments.
2. Causes harm to minors.
3. It interferes with the privacy and individual and social rights of other users.
4. Advertises products or services or websites.
5. Contains personal information (address, phone, etc.).