| Thread Tools |
11th August 2023, 10:41 | #1 |
[M] Reviewer Join Date: May 2010 Location: Romania
Posts: 148,843
| ChatGPT is failing at basic maths Getting old New research has found that AI software ChatGPT is becoming worse at performing certain basic math operations. Boffins at Stanford University and the University of California, Berkeley said the deterioration is an example of a phenomenon known to AI developers as drift, where attempts to improve one part of the enormously complex AI models make other parts perform worse. They have tested two versions of ChatGPT: version 3.5 and version 4.0, available and the results are grim. The boffins gave the chatbot a basic task: identify whether a particular number is prime. This is the sort of math problem that is complicated for people but simple for computers. If a number is a prime should be easy for computers to evaluate by dividing by two, three, five, etc., and see if anything works. To track performance, the researchers fed ChatGPT 1,000 different numbers. In March, the premium GPT-4, correctly identified whether 84 per cent of the numbers were prime. By June, its success rate had dropped to 51 per cent. Across eight different tasks, GPT-4 became worse at six of them. GPT-3.5 improved on six measures but remained worse than its advanced sibling at most tasks. https://fudzilla.com/news/ai/57394-c...at-basic-maths |
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Threads failing too | Stefan Mileschin | WebNews | 0 | 1st August 2023 06:54 |
Deep Mind improves matrices maths | Stefan Mileschin | WebNews | 0 | 10th October 2022 07:24 |
Older Rambus crypto keys were broken by 379 year-old maths | Stefan Mileschin | WebNews | 0 | 16th March 2022 04:37 |
Computer programming is not a language nor maths | Stefan Mileschin | WebNews | 0 | 5th January 2021 05:01 |
The 2020 Volkswagen Passat is a basic car with basic tech | Stefan Mileschin | WebNews | 0 | 27th November 2019 07:26 |
Bitcoin is failing as a currency | Stefan Mileschin | WebNews | 0 | 17th December 2017 15:30 |
Samsung 7 recall failing | Stefan Mileschin | WebNews | 0 | 19th September 2016 06:27 |
The TSA is failing spectacularly at cybersecurity | Stefan Mileschin | WebNews | 0 | 23rd May 2016 06:18 |
ATI fanbois pursue Nvidia's maths | jmke | WebNews | 1 | 10th February 2006 19:08 |
Folding station failing | cR00zIFI><3r | Site & Forum Feedback - Folding@Home | 11 | 4th December 2002 19:46 |
Thread Tools | |
| |