+- +-
Say hello if visiting :) by Gecko
11 Jan 2023, 07:43:05 pm

Seti is down again by Mike
09 Aug 2017, 10:02:44 am

Some considerations regarding OpenCL MultiBeam app tuning from algorithm view by Raistmer
11 Dec 2016, 06:30:56 am

Loading APU to the limit: performance considerations by Mike
05 Nov 2016, 06:49:26 am

Better sleep on Windows - new round by Raistmer
26 Aug 2016, 02:02:31 pm

Author Topic: Report on new optimized Astropulse apps for Windows  (Read 70629 times)

Offline Jason G

  • Construction Fraggle
  • Knight who says 'Ni!'
  • *****
  • Posts: 8980
Re: Report on new optimized Astropulse apps for Windows
« Reply #60 on: 24 Nov 2008, 01:29:03 am »
Yep, noticed the nice integer division followed by typecast to double.  Always did find 32 bit long & normal signed ints funny (or the contexts I've seen them used in anyway), changing the values to unsigned would probably be enough to fix it.  (but obviously still wouldn't be percent)


Offline Richard Haselgrove

  • Messenger Pigeon
  • Knight who says 'Ni!'
  • *****
  • Posts: 2819
Re: Report on new optimized Astropulse apps for Windows
« Reply #61 on: 24 Nov 2008, 09:13:40 am »
Get the popcorn ready - got another chunky indices.txt file to watch through - 1344 sample points..

ap_04no08ac_B4_P1_00145_20081123_17576 (1067934018)

Finished at full runtime - 7 single pulses and 30 repetitive pulses. Result file attached - full WU datapak available if you want it uploading.

[attachment deleted by admin]

Offline Jason G

  • Construction Fraggle
  • Knight who says 'Ni!'
  • *****
  • Posts: 8980
Re: Report on new optimized Astropulse apps for Windows
« Reply #62 on: 24 Nov 2008, 09:46:23 am »
Might as well wack it up,  Speed's back up now  ;D

Offline Richard Haselgrove

  • Messenger Pigeon
  • Knight who says 'Ni!'
  • *****
  • Posts: 2819
Re: Report on new optimized Astropulse apps for Windows
« Reply #63 on: 24 Nov 2008, 09:54:08 am »
What's the next description beyond 'jewel'?

 ap_04no08ae_B5_P0_00273_20081124_23735 (1068934402)

has 3548 blanking indices, 448 of them with signal strength over 100. Highest signal strength is 213.925781

Would anyone like to estimate the likely scientific value of the next 15 hours work?

[attachment deleted by admin]

Offline Richard Haselgrove

  • Messenger Pigeon
  • Knight who says 'Ni!'
  • *****
  • Posts: 2819
Re: Report on new optimized Astropulse apps for Windows
« Reply #64 on: 24 Nov 2008, 09:54:56 am »
Might as well wack it up,  Speed's back up now  ;D

Will do, give us a mo.

Wow, that's better. >283Kbps sustained. Zip contains v5 result, indices, std_err.

What's the best way to get a v4 result offline to compare?
« Last Edit: 24 Nov 2008, 10:06:10 am by Haselgrove »

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Report on new optimized Astropulse apps for Windows
« Reply #65 on: 24 Nov 2008, 09:55:01 am »
Get the popcorn ready - got another chunky indices.txt file to watch through - 1344 sample points..

ap_04no08ac_B4_P1_00145_20081123_17576 (1067934018)

Finished at full runtime - 7 single pulses and 30 repetitive pulses. Result file attached - full WU datapak available if you want it uploading.
Try to do the same WU with 4.x version, then send both result files along with indices.txt, stderr.txt and WU itself to FTP, please.

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Report on new optimized Astropulse apps for Windows
« Reply #66 on: 24 Nov 2008, 10:24:33 am »

What's the best way to get a v4 result offline to compare?
Think opt app will be fine. No need to use 4.x stock one.

Leaps-from-Shadows

  • Guest
Re: Report on new optimized Astropulse apps for Windows
« Reply #67 on: 24 Nov 2008, 11:21:15 am »
Got some more completed work units on Cruiser:

Main:368768645 (Pending), 368768653 (Validated)
Beta:  1563494 (Validated)

Cruiser's compiled results so far:

Main:
368768645 (Pending) - 0.008021076 credits per CPU second
368768653 (Validated) - 0.008183099 credits per CPU second
368496971 (Pending) - 0.008235288 credits per CPU second

368418713 (v4.37, Pending) - 0.006726898 credits per CPU second

Beta:
1563494 (Validated) - 0.009484371 credits per CPU second
1565756 (Validated) - 0.009705443 credits per CPU second
1564992 (Validated) - 0.009227865 credits per CPU second

Fairly consistent on both Main and Beta...

For comparison:
Shorty Multibeam (16.84 credits):  0.007037046 credits per CPU second
Average Multibeam (44.12 credits):  0.008375063 credits per CPU second
Long Multibeam (63.86 credits):  0.010619245 credits per CPU second

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Report on new optimized Astropulse apps for Windows
« Reply #68 on: 24 Nov 2008, 01:58:13 pm »
Again, rep pulses overflow....
single pulses: 8
repetitive pulses: 30

single pulses: 12
repetitive pulses: 30

    single pulses: 7
repetitive pulses: 30

All main ended with rep overflow but no such effect on beta. It seems tape w/o radar used on beta .
« Last Edit: 24 Nov 2008, 02:01:48 pm by Raistmer »

Offline Josef W. Segur

  • Janitor o' the Board
  • Knight who says 'Ni!'
  • *****
  • Posts: 3112
Re: Report on new optimized Astropulse apps for Windows
« Reply #69 on: 24 Nov 2008, 05:50:30 pm »
...main ended with rep overflow but no such effect on beta. It seems tape w/o radar used on beta .

About a week ago I went through Richard's Beta reports from opt 5.00. There were 26 of them, 1 was a 30+30 overflow, 3 more had 30 repetitive pulses, 4 had no reportable pulses of either type. In total, there were 108 single pulses reported and 179 repetitive pulses. That's a very small sample, but at least indicates the "tape" covers a wide range of conditions.

The "radar removal" is looking for a DC level from the length 1024 FFTs it uses, which I think is an effect of getting a strong enough input to saturate the receiver channel, or at least cause compression. Assuming those incidents are caused by radar signals bouncing back from an airplane, the strongest ones are going to be when the bounce arrives on one of the side-lobe peaks and/or when the aircraft is oriented to produce the strongest reflection. It's a hugely complicated set of interactions.
                                                                      Joe

Leaps-from-Shadows

  • Guest
Re: Report on new optimized Astropulse apps for Windows
« Reply #70 on: 24 Nov 2008, 11:20:58 pm »
Quote
Got some more completed work units on Cruiser:

Main:  368768645 (Pending), 368768653 (Validated)
Beta:  1563494 (Validated)

Cruiser's compiled results so far:

Main:
368768645 (Pending) - 0.008021076 credits per CPU second
368768653 (Validated) - 0.008183099 credits per CPU second
368496971 (Pending) - 0.008235288 credits per CPU second

368418713 (v4.37, Pending) - 0.006726898 credits per CPU second

Beta:
1563494 (Validated) - 0.009484371 credits per CPU second
1565756 (Validated) - 0.009705443 credits per CPU second
1564992 (Validated) - 0.009227865 credits per CPU second

Fairly consistent on both Main and Beta...

For comparison:
Shorty Multibeam (16.84 credits):  0.007037046 credits per CPU second
Average Multibeam (44.12 credits):  0.008375063 credits per CPU second
Long Multibeam (63.86 credits):  0.010619245 credits per CPU second
Add another one to the Main list:
368768654 (Validated, canonical result) - 0.008136883 credits per CPU second

Still, it has this:
    single pulses: 4
repetitive pulses: 30

Offline Josef W. Segur

  • Janitor o' the Board
  • Knight who says 'Ni!'
  • *****
  • Posts: 3112
Re: Report on new optimized Astropulse apps for Windows
« Reply #71 on: 25 Nov 2008, 12:08:34 am »
What's the next description beyond 'jewel'?

 ap_04no08ae_B5_P0_00273_20081124_23735 (1068934402)

has 3548 blanking indices, 448 of them with signal strength over 100. Highest signal strength is 213.925781

Would anyone like to estimate the likely scientific value of the next 15 hours work?

That's a 90% blanker. There's one place with slightly over 2.7 M unblanked samples, another with over 400 K, and two more very short ones.

With considerable refinement, the app could just process the unblanked portions using only the appropriate tests. The short FFA would be appropriate if shifted to work within that 2.7 M section, the long FFA makes no sense, single pulse searches work on only 32 K samples and could be tried on all the unblanked data. Processing time that way should be less than 10% of the full run, and scientific value would be maximized. That assumes it's possible to have actual clean data in short sections surrounded by noise, we're not on a path to discover that yet.

As it stands, scientific value is going to lie in the realm of illustrating flaws in the implementation; sometimes that's the most important part of the scientific method.
                                                                          Joe

Offline Richard Haselgrove

  • Messenger Pigeon
  • Knight who says 'Ni!'
  • *****
  • Posts: 2819
Re: Report on new optimized Astropulse apps for Windows
« Reply #72 on: 25 Nov 2008, 07:48:55 am »

That's a 90% blanker. There's one place with slightly over 2.7 M unblanked samples, another with over 400 K, and two more very short ones.

With considerable refinement, the app could just process the unblanked portions using only the appropriate tests. The short FFA would be appropriate if shifted to work within that 2.7 M section, the long FFA makes no sense, single pulse searches work on only 32 K samples and could be tried on all the unblanked data. Processing time that way should be less than 10% of the full run, and scientific value would be maximized. That assumes it's possible to have actual clean data in short sections surrounded by noise, we're not on a path to discover that yet.

As it stands, scientific value is going to lie in the realm of illustrating flaws in the implementation; sometimes that's the most important part of the scientific method.
                                                                          Joe

Turned out to be over 16 hours - slightly slower than normal for r69 on this box. Don't know if that's significant.

Found 6 single pulses and 27 repetitive pulses - I suppose there are fewer edges to have edge artefacts on, when the whole thing is blanked ;). Result attached.

Oh, and please contribute to to my 'dilemma' thread at SETI :-\

[ooops, wrong file]

[attachment deleted by admin]
« Last Edit: 25 Nov 2008, 07:50:57 am by Haselgrove »

Offline Jason G

  • Construction Fraggle
  • Knight who says 'Ni!'
  • *****
  • Posts: 8980
Re: Report on new optimized Astropulse apps for Windows
« Reply #73 on: 25 Nov 2008, 07:53:40 am »
..
Oh, and please contribute to to my 'dilemma' thread at SETI :-\
..

Done.  Feel free to disagree.

Offline Richard Haselgrove

  • Messenger Pigeon
  • Knight who says 'Ni!'
  • *****
  • Posts: 2819
Re: Report on new optimized Astropulse apps for Windows
« Reply #74 on: 25 Nov 2008, 07:57:53 am »

Done.  Feel free to disagree.


Yours is probably the nearest thing to a 'right' answer, but I just wanted to get the debate out into the open.....

I'll probably end up doing it with v5, just so we get another indices.txt file to play with.

 

Welcome, Guest.
Please login or register.
 
 
 
Forgot your password?
Members
Total Members: 97
Latest: ToeBee
New This Month: 0
New This Week: 0
New Today: 0
Stats
Total Posts: 59559
Total Topics: 1672
Most Online Today: 355
Most Online Ever: 983
(20 Jan 2020, 03:17:55 pm)
Users Online
Members: 0
Guests: 86
Total: 86
Powered by EzPortal