+- +-
Say hello if visiting :) by Gecko
11 Jan 2023, 07:43:05 pm

Seti is down again by Mike
09 Aug 2017, 10:02:44 am

Some considerations regarding OpenCL MultiBeam app tuning from algorithm view by Raistmer
11 Dec 2016, 06:30:56 am

Loading APU to the limit: performance considerations by Mike
05 Nov 2016, 06:49:26 am

Better sleep on Windows - new round by Raistmer
26 Aug 2016, 02:02:31 pm

Author Topic: Collection of stock app test results recived on different hosts.  (Read 9497 times)

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
What I propose to do:
to create some collection of  results for our test tasks recived from stock app executing different paths.
stock app has dynamic execution path selection so will run different code on different hosts (different SSE capability or different memory bus/CPU speed ratio).

That way we can check stock app for self-validness (i.e. to check if all possible execution paths give consistent results).

How to accomplish this:
to post message with attached res files from stock app run + (and it's required part)  text log file from wich clearly seen what execution paths stock app chose to get attached result.

EDITED: here attached all tested tasks:

« Last Edit: 28 Oct 2012, 08:06:15 am by Raistmer »

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Collection of stock app test results recived on different hosts.
« Reply #1 on: 26 Oct 2012, 04:51:02 pm »
Here my first results for stock V6.98 from Athlon XP 2600+ (Barton).
SSE-only
« Last Edit: 28 Oct 2012, 06:36:08 am by Raistmer »

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Collection of stock app test results recived on different hosts.
« Reply #2 on: 27 Oct 2012, 03:07:32 am »
Results for Q9450, SSE 4.1 capable
« Last Edit: 28 Oct 2012, 08:03:53 am by Raistmer »

Offline Josef W. Segur

  • Janitor o' the Board
  • Knight who says 'Ni!'
  • *****
  • Posts: 3112
Re: Collection of stock app test results recived on different hosts.
« Reply #3 on: 27 Oct 2012, 01:30:43 pm »
The stock app does accuracy checks on each function and won't use anything which fails those. But they're brief tests which can't catch all possible deviations, so I think this effort is a good idea.

The run on my Pentium-M has two sets of PGxxxx_v7 results from the stock app. The ref results used a -def argument (abbreviation for the " -default_functions  use the safe unoptimized default functions"), and those have been slightly renamed to start ref-def- so they can be distinguished from runs where function choosing was active.

The run on Coppermine P3 is just a single set of PGxxxx_v7 results. Checking those against the ref-def- set gives this:

Code: [Select]
rescmpv5
 ref-setiathome_6.98_windows_intelx86.exe-PG0009_v7.wu.res
 ref-def-setiathome_6.98_windows_intelx86.exe-PG0009_v7.wu.res
Result      : Strongly similar,  Q= 99.53%

rescmpv5
 ref-setiathome_6.98_windows_intelx86.exe-PG0395_v7.wu.res
 ref-def-setiathome_6.98_windows_intelx86.exe-PG0395_v7.wu.res
Result      : Strongly similar,  Q= 99.88%

rescmpv5
 ref-setiathome_6.98_windows_intelx86.exe-PG0444_v7.wu.res
 ref-def-setiathome_6.98_windows_intelx86.exe-PG0444_v7.wu.res
Result      : Strongly similar,  Q= 99.78%

rescmpv5
 ref-setiathome_6.98_windows_intelx86.exe-PG1327_v7.wu.res
 ref-def-setiathome_6.98_windows_intelx86.exe-PG1327_v7.wu.res
Result      : Strongly similar,  Q= 99.29%

                                                        Joe

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Collection of stock app test results recived on different hosts.
« Reply #4 on: 28 Oct 2012, 06:33:23 am »
And here results for SSE2-only host, Athlon 64 3200+ (Winchester)
« Last Edit: 28 Oct 2012, 07:39:22 am by Raistmer »

Offline Urs Echternacht

  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 4121
  • ++
Re: Collection of stock app test results recived on different hosts.
« Reply #5 on: 29 Oct 2012, 09:59:31 am »
Here are results from SSE-only Pentium III-S 1.4GHz (Tualatin)
_\|/_
U r s

 

Welcome, Guest.
Please login or register.
 
 
 
Forgot your password?
Members
Total Members: 97
Latest: ToeBee
New This Month: 0
New This Week: 0
New Today: 0
Stats
Total Posts: 59559
Total Topics: 1672
Most Online Today: 52
Most Online Ever: 983
(20 Jan 2020, 03:17:55 pm)
Users Online
Members: 0
Guests: 47
Total: 47
Powered by EzPortal