+- +-
Say hello if visiting :) by Gecko
11 Jan 2023, 07:43:05 pm

Seti is down again by Mike
09 Aug 2017, 10:02:44 am

Some considerations regarding OpenCL MultiBeam app tuning from algorithm view by Raistmer
11 Dec 2016, 06:30:56 am

Loading APU to the limit: performance considerations by Mike
05 Nov 2016, 06:49:26 am

Better sleep on Windows - new round by Raistmer
26 Aug 2016, 02:02:31 pm

Author Topic: Optimized AP 5.03 for Windows and %age blanked  (Read 10442 times)

WinyterKnight

  • Guest
Optimized AP 5.03 for Windows and %age blanked
« on: 25 Feb 2009, 12:17:39 am »
Have now done 5 AP tasks with Opti 5.03 on my Q6600, and noticed crunch time is either 12 hrs (2 tasks) or 14+ hrs (3 tasks).
Looking further I see that the 12 hr tasks have 0% blanked, the others have 76% or more blanked.
Is there any explanation for this or is it the case that the noise inserted in the blanked portions is still not right.

I haven't done any 5.03's with default app, as it wasn't tested on Beta, and I have been trying to clear the 5.00's on main.

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #1 on: 25 Feb 2009, 04:08:45 am »
Have now done 5 AP tasks with Opti 5.03 on my Q6600, and noticed crunch time is either 12 hrs (2 tasks) or 14+ hrs (3 tasks).
Looking further I see that the 12 hr tasks have 0% blanked, the others have 76% or more blanked.
Is there any explanation for this or is it the case that the noise inserted in the blanked portions is still not right.

I haven't done any 5.03's with default app, as it wasn't tested on Beta, and I have been trying to clear the 5.00's on main.

Check if your non-blanked fast results have overflows (30 single or 30 repeated pulses or both) ?

WinyterKnight

  • Guest
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #2 on: 25 Feb 2009, 04:16:42 am »
Task 1171357741 reports
    single pulses: 1
repetitive pulses: 1
  percent blanked: 0.00

Task 1171358497 reports
    single pulses: 3
repetitive pulses: 1
  percent blanked: 0.00


So no, there are no overflows.

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #3 on: 25 Feb 2009, 04:38:26 am »
Task 1171357741 reports
    single pulses: 1
repetitive pulses: 1
  percent blanked: 0.00

Task 1171358497 reports
    single pulses: 3
repetitive pulses: 1
  percent blanked: 0.00


So no, there are no overflows.

Hm very interesting... There were reports that blanking itself takes pretty small amount of time...

Offline Richard Haselgrove

  • Messenger Pigeon
  • Knight who says 'Ni!'
  • *****
  • Posts: 2819
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #4 on: 25 Feb 2009, 05:31:24 am »
Jason and I both saw that slow-processing effect for heavily-blanked WUs in early testing - Raistmer, review the pre-release thread for 13/14 Feb.

Offline Raistmer

  • Working Code Wizard
  • Volunteer Developer
  • Knight who says 'Ni!'
  • *****
  • Posts: 14349
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #5 on: 25 Feb 2009, 05:34:44 am »
Jason and I both saw that slow-processing effect for heavily-blanked WUs in early testing - Raistmer, review the pre-release thread for 13/14 Feb.
Ok, thanks! Missed that probably.

WinyterKnight

  • Guest
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #6 on: 25 Feb 2009, 07:08:19 am »
Glad I'm not the only one seeing this on tasks with lots of blanking.
I've got 2 more 5.03's crunching both at over 50% completed, one is proceeding at over 8%/hr, so approx 100% complete in 12 hrs,  the other is only going a just about 7%/hr so probably over 14 hrs.

Offline Jason G

  • Construction Fraggle
  • Knight who says 'Ni!'
  • *****
  • Posts: 8980
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #7 on: 25 Feb 2009, 07:23:14 am »
This variation is a known effect of Berkeley's insertion of noise shaping envelopes into the radar blanking.  Nothing to worry about.  Luck of the draw.  I see this in about 10% of WUs only, and the time penalty for 90%+ blanking seems to be about 20-30% here.  Once we're more confident with validations, we can streamline this fairly radically.

Jason
« Last Edit: 25 Feb 2009, 07:34:38 am by Jason G »

WinyterKnight

  • Guest
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #8 on: 25 Feb 2009, 07:44:45 am »
This variation is a known effect of Berkeley's insertion of noise shaping envelopes into the radar blanking.  Nothing to worry about.  Luck of the draw.  I see this in about 10% of WUs only, and the time penalty for 90%+ blanking seems to be about 20-30% here.  Once we're more confident with validations, we can streamline this fairly radically.

Jason

Glad to know it is not the optmised app. And that Berkeley haven't got the correct shaped noise envelope yet.

I know the problems, I spent years injecting noise into comms channels hunting for distortion, intermodulation products, harmonic distortion, etc, and if the noise is not the correct shape you are just wasting your time.

Offline Josef W. Segur

  • Janitor o' the Board
  • Knight who says 'Ni!'
  • *****
  • Posts: 3112
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #9 on: 26 Feb 2009, 12:51:48 am »
This variation is a known effect of Berkeley's insertion of noise shaping envelopes into the radar blanking.  Nothing to worry about.  Luck of the draw.  I see this in about 10% of WUs only, and the time penalty for 90%+ blanking seems to be about 20-30% here.  Once we're more confident with validations, we can streamline this fairly radically.

Jason

Glad to know it is not the optmised app. And that Berkeley haven't got the correct shaped noise envelope yet.

I know the problems, I spent years injecting noise into comms channels hunting for distortion, intermodulation products, harmonic distortion, etc, and if the noise is not the correct shape you are just wasting your time.

The impression I get is the shaped noise is probably good, knowing when to inject or not in the raw data still uncertain. In any case, the slowdown is related to the internal 'blanking' in AP_v5. As that's based on a more general noise detection approach, it probably can be triggered by other RFI sources in addition to the particular radar which is the main problem. Josh Von Korff does estimate that generating the needed patterns is a small fraction of processing time but his reference is stock processing rate, in the optimized code it's effectively multiplied by the reductions that have been found for other parts of the code. A 20% time variance in optimized might be only 5% or so in stock.

Josh seems to agree in principle that the internal blanking should be just that; skip processing the parts which have been judged bad. I think we can get that implemented for the next version. If so the more internal blanking needed the faster the app will run.
                                                                               Joe

WinyterKnight

  • Guest
Re: Optimized AP 5.03 for Windows and %age blanked
« Reply #10 on: 26 Feb 2009, 10:31:15 pm »
Thought I would report the first of my Opt AP5.03 tasks has validated against a X9770 host that uses stock application.
The task was one with 76.6% blanked, hence 14h:10m, his time was 52h:20m.

 

Welcome, Guest.
Please login or register.
 
 
 
Forgot your password?
Members
Total Members: 97
Latest: ToeBee
New This Month: 0
New This Week: 0
New Today: 0
Stats
Total Posts: 59559
Total Topics: 1672
Most Online Today: 23
Most Online Ever: 983
(20 Jan 2020, 03:17:55 pm)
Users Online
Members: 0
Guests: 17
Total: 17
Powered by EzPortal