Benchmarking tool for reviewers / diehard overclockers

RichBa5tard · 22nd May 2003, 23:59

I'm currently starting with a project and i'll need some [M]ad input.

I'm going to write a program that will make it much more pleasent for us to do some extensive benchmarking. Anyone who has written a review of motherboard/cpu/vidcard comparison knows that 80% of your time is consumed by running a benchmark program, writting down the results, importing them to an excell sheet and turning it into a good looking graph. This is a very timeconsuming and repetetive task, which can be automised.

My goal is to write a little app, that will allow you to select a few popular benchmarking tools (eg. UT2003 bench, Superpi, 3Dmark, ...), starts the first automaticly, extracts the results when done, closes it and starts with the next one. When all selected benches are finished, all the data is put into a snapshot-ready graph & into a text file (with delimiters, ready to be imported by excell). Saved results can be compared to other results, to make comparisons between different mobo's/vidcards/... easy.

In a nutshell:
- select the benchmarks you want to run
- select options (eg. 3D in low res to test CPU/Mobo)
- start. The app will run the selected benchmarks in sequence and extract the results.
- join the results in a premade graph (for quick screenshot) or output to a excell compatible .txt file for import.

That's it. It would be opensource java.

What i need from you guys?
* would you use (it if it ran perfectly)?
* which benchmark progs should be included? Remember the results have to be extracted somehow, this will not be easy in some cases. Also, there should be a way to start it immediatly (and not wait for user input).
* what kind of output other than specified do you want?
* other comments

Current version: MadMark alpha v0.01
-------------------------------------------------------
- initial release
- no export, only pifast and 3Dmark01

Planned bugfixes for next release:
--------------------------------------------------
- app doesn't respond after pifast fixed 11/06
- automatic copy of needed 3Dmark files fixed 11/06
- correct dir check fixed 11/06

Next release will be published asap, i'm just going to test it a few more times.

jmke · 23rd May 2003, 00:28

* Hell yeah I would use it!
* Serious Sam / Q3A (qbench springs to mind) / UT2003 / 3Dmark2k1 / SuperPi / Sisoft Sandra / Aquamark v2 (3 upcoming) / WinAce .. and more

RichBa5tard · 23rd May 2003, 00:55

Serious Sam => difficult to extract the results, are the average fps saved in a seperate file?
Q3A (qbench springs to mind) => same as SS
UT2003 => no prob
3Dmark2k1 => need to look into that
SuperPi => no prob
Sisoft Sandra => hmmm... dunno yet
Aquamark v2 (3 upcoming) => same as SS
WinAce => no prob

jmke · 23rd May 2003, 09:03

Qbench gives .txt in the end

23rd May 2003, 18:05

sounds like a great idea !

but hey, 3Dmark2003 is missing on the list...

and er, how do think to implent the options of 3Dmark like AA-> on/off in that program? (just thinking of the practical realisation)

RichBa5tard · 23rd May 2003, 18:20

Quote:

Originally posted by Dial_Up
sounds like a great idea !

but hey, 3Dmark2003 is missing on the list...

and er, how do think to implent the options of 3Dmark like AA-> on/off in that program? (just thinking of the practical realisation)

True, that will be the hardest to implement. For starters, i don't know if you can start 3Dmark without having to click "benchmark".

I'll start with the easy programs first (those who can be started with one simple command and have their results set in a .txt file, eg. pifast), and move on to the harder benchmarkprogs later on.

RichBa5tard · 23rd May 2003, 18:26

alright, i've read the helpfile and it seems like 3D mark 2001 / 2003 will be no problem.

piotke · 23rd May 2003, 19:18

are you that good in programming ?

in what language are you going to write it ? C ?

RichBa5tard · 23rd May 2003, 19:20

Quote:

Originally posted by RichBa5tard
That's it. It would be opensource java.

24th May 2003, 03:33

So basically you would have to shut down all programs which may affect the bencmarks just like you do whrn, running 3DMark2003/2001SE, Serious Sam, Code Creatures, etc. Hor example adjusting disply options to diable vsync, and 1024x768, and just lert it run thorugh all the programs? But what if say you wanted to run Return to Castle " in 1200x1600 as well? Would you be able to program the sotware to make those display adjustments? I'm not asking for everything, I'm just curious how far you were going to take it? Man you could sell the program to review sites? Or will it be freeware? If so thank you, either way thank you. I think it'll be very useful, although as benchmarks become unpopular, will the program be capable of having it's parametters changed in that respect?

22nd May 2003, 23:59	#1
RichBa5tard [M] Reviewer/HWBot ***** Join Date: May 2002 Posts: 3,344	Benchmarking tool for reviewers / diehard overclockers I'm currently starting with a project and i'll need some [M]ad input. I'm going to write a program that will make it much more pleasent for us to do some extensive benchmarking. Anyone who has written a review of motherboard/cpu/vidcard comparison knows that 80% of your time is consumed by running a benchmark program, writting down the results, importing them to an excell sheet and turning it into a good looking graph. This is a very timeconsuming and repetetive task, which can be automised. My goal is to write a little app, that will allow you to select a few popular benchmarking tools (eg. UT2003 bench, Superpi, 3Dmark, ...), starts the first automaticly, extracts the results when done, closes it and starts with the next one. When all selected benches are finished, all the data is put into a snapshot-ready graph & into a text file (with delimiters, ready to be imported by excell). Saved results can be compared to other results, to make comparisons between different mobo's/vidcards/... easy. In a nutshell: - select the benchmarks you want to run - select options (eg. 3D in low res to test CPU/Mobo) - start. The app will run the selected benchmarks in sequence and extract the results. - join the results in a premade graph (for quick screenshot) or output to a excell compatible .txt file for import. That's it. It would be opensource java. What i need from you guys? * would you use (it if it ran perfectly)? * which benchmark progs should be included? Remember the results have to be extracted somehow, this will not be easy in some cases. Also, there should be a way to start it immediatly (and not wait for user input). * what kind of output other than specified do you want? * other comments Current version: MadMark alpha v0.01 ------------------------------------------------------- - initial release - no export, only pifast and 3Dmark01 Planned bugfixes for next release: -------------------------------------------------- - app doesn't respond after pifast fixed 11/06 - automatic copy of needed 3Dmark files fixed 11/06 - correct dir check fixed 11/06 Next release will be published asap, i'm just going to test it a few more times. __________________ HTPC (mac osx): Mac Mini \| Core Duo 1.6Ghz \| 2GB DDR2 \| 26\" TFT Development (mac osx): Macbook \| Core 2 2.0Ghz \| 4GB DDR2 \| 250GB HD Games (win xp): E2160 @ 2.4Ghz \| HD3850 OC \| Asrock 4coredual-vsta \| 2GB DDR2

23rd May 2003, 00:28	#2
jmke Madshrimp Join Date: May 2002 Location: 7090/Belgium Posts: 79,024	* Hell yeah I would use it! * Serious Sam / Q3A (qbench springs to mind) / UT2003 / 3Dmark2k1 / SuperPi / Sisoft Sandra / Aquamark v2 (3 upcoming) / WinAce .. and more __________________

23rd May 2003, 00:55	#3
RichBa5tard [M] Reviewer/HWBot ***** Join Date: May 2002 Posts: 3,344	Serious Sam => difficult to extract the results, are the average fps saved in a seperate file? Q3A (qbench springs to mind) => same as SS UT2003 => no prob 3Dmark2k1 => need to look into that SuperPi => no prob Sisoft Sandra => hmmm... dunno yet Aquamark v2 (3 upcoming) => same as SS WinAce => no prob __________________ HTPC (mac osx): Mac Mini \| Core Duo 1.6Ghz \| 2GB DDR2 \| 26\" TFT Development (mac osx): Macbook \| Core 2 2.0Ghz \| 4GB DDR2 \| 250GB HD Games (win xp): E2160 @ 2.4Ghz \| HD3850 OC \| Asrock 4coredual-vsta \| 2GB DDR2

23rd May 2003, 09:03	#4
jmke Madshrimp Join Date: May 2002 Location: 7090/Belgium Posts: 79,024	Qbench gives .txt in the end __________________

23rd May 2003, 18:26	#7
RichBa5tard [M] Reviewer/HWBot ***** Join Date: May 2002 Posts: 3,344	alright, i've read the helpfile and it seems like 3D mark 2001 / 2003 will be no problem. __________________ HTPC (mac osx): Mac Mini \| Core Duo 1.6Ghz \| 2GB DDR2 \| 26\" TFT Development (mac osx): Macbook \| Core 2 2.0Ghz \| 4GB DDR2 \| 250GB HD Games (win xp): E2160 @ 2.4Ghz \| HD3850 OC \| Asrock 4coredual-vsta \| 2GB DDR2

23rd May 2003, 18:05	#5
Dial_Up Posts: n/a	sounds like a great idea ! but hey, 3Dmark2003 is missing on the list... and er, how do think to implent the options of 3Dmark like AA-> on/off in that program? (just thinking of the practical realisation)

23rd May 2003, 19:18	#8
piotke [M] Reviewer Join Date: Jun 2002 Posts: 5,003	are you that good in programming ? in what language are you going to write it ? C ? __________________ .

24th May 2003, 03:33	#10
Liquid3D Posts: n/a	So basically you would have to shut down all programs which may affect the bencmarks just like you do whrn, running 3DMark2003/2001SE, Serious Sam, Code Creatures, etc. Hor example adjusting disply options to diable vsync, and 1024x768, and just lert it run thorugh all the programs? But what if say you wanted to run Return to Castle " in 1200x1600 as well? Would you be able to program the sotware to make those display adjustments? I'm not asking for everything, I'm just curious how far you were going to take it? Man you could sell the program to review sites? Or will it be freeware? If so thank you, either way thank you. I think it'll be very useful, although as benchmarks become unpopular, will the program be capable of having it's parametters changed in that respect?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
ZOMG Screenshot (SS Tool for Overclockers)	jmke	WebNews	0	24th November 2008 23:15
OpenGL Benchmarking On Linux Reaches New Heights	jmke	WebNews	0	4th August 2008 10:54
AMD GPU Clock Tool 0.9.8 with Radeon HD 4800 series support	jmke	WebNews	0	7th July 2008 16:54
Futuremark Announces 3D Content Creation Tool Chain for OpenGL ES 2.0	jmke	WebNews	0	8th August 2007 16:54
New Microsoft WGA Tool tries to call home	jmke	WebNews	0	7th March 2007 16:10
ATI Tool vs. CCC	Volt	Hardware Overclocking and Case Modding	1	28th September 2006 11:49
Intel Digital Home Capabilities Assessment Tool	jmke	WebNews	0	20th December 2005 17:34
ATI produce tool to increase Doom3 scores 'up to 35%' with AA enabled	jmke	WebNews	0	15th October 2005 02:44
registry monitoring tool	kristos	General Madness - System Building Advice	2	19th February 2005 00:59