Chipzilla caught cheating on benchmarks

Stefan Mileschin · 21st February 2024, 06:38

SPEC throws Poe and says, "Nevermore"

The Standard Performance Evaluation Corporation (SPEC), which keeps fair and honest benchmarks for computing chips, has chucked out more than 2,600 results for Chipzilla Xeon chips.

The non-profit group said it would stop publishing SPEC CPU 2017 results for Chipzilla PCs running a dodgy version of the Chipzilla compiler.

The decision comes from worries over what the group calls a sneaky optimisation for a specific workload. In other words, SPEC accuses Chipzilla of fiddling with its products for better benchmark results.

SPEC CPU 2017 is a popular benchmark for top-of-the-range servers, data centres and workstations, testing performance across 43 benchmarks. The row is about the Chipzilla oneAPI DPC++/C++ Compiler, which has been allegedly tweaked for the 523.xalancbmk_r / 623.xalancbmk_s benchmarks.

https://fudzilla.com/news/58479-chip...-on-benchmarks

21st February 2024, 06:38	#1
Stefan Mileschin [M] Reviewer Join Date: May 2010 Location: Romania Posts: 148,618	Chipzilla caught cheating on benchmarks SPEC throws Poe and says, "Nevermore" The Standard Performance Evaluation Corporation (SPEC), which keeps fair and honest benchmarks for computing chips, has chucked out more than 2,600 results for Chipzilla Xeon chips. The non-profit group said it would stop publishing SPEC CPU 2017 results for Chipzilla PCs running a dodgy version of the Chipzilla compiler. The decision comes from worries over what the group calls a sneaky optimisation for a specific workload. In other words, SPEC accuses Chipzilla of fiddling with its products for better benchmark results. SPEC CPU 2017 is a popular benchmark for top-of-the-range servers, data centres and workstations, testing performance across 43 benchmarks. The row is about the Chipzilla oneAPI DPC++/C++ Compiler, which has been allegedly tweaked for the 523.xalancbmk_r / 623.xalancbmk_s benchmarks. https://fudzilla.com/news/58479-chip...-on-benchmarks

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
AMD is catching up with Chipzilla	Stefan Mileschin	WebNews	0	14th November 2023 07:03
Samsung caught cheating on TV reviews	Stefan Mileschin	WebNews	0	20th June 2022 07:03
AMD is beating Chipzilla	Stefan Mileschin	WebNews	0	28th April 2020 07:47
AnandTech alleges MediaTek cheating on benchmarks	Stefan Mileschin	WebNews	0	10th April 2020 07:39
Intel caught pushing "dodgy" benchmarks	Stefan Mileschin	WebNews	0	8th November 2019 08:12
Chipzilla has not given up on 5G	Stefan Mileschin	WebNews	0	17th October 2019 12:44
Chipzilla looking a bit weak	Stefan Mileschin	WebNews	0	25th January 2019 10:58
Chipzilla has a new patch out	Stefan Mileschin	WebNews	0	26th February 2018 18:06
OnePlus 3T caught cheating on benchmarks	Stefan Mileschin	WebNews	0	3rd February 2017 04:34
They're (Almost) All Dirty: The State of Cheating in Android Benchmarks	Stefan Mileschin	WebNews	0	3rd October 2013 11:40