Seti@Home optimized science apps and information

Optimized Seti@Home apps => Discussion Forum => Topic started by: msattler on 19 Oct 2010, 12:18:40 pm

Title: Latest Seti news.......
Post by: msattler on 19 Oct 2010, 12:18:40 pm
Uhhhhhhhh.....
This is a little grim.
Not pretty, but you might as well hear it from the kittyman rather than scuttlebutt down the road.

Eric informs me that mork has now been officially declared brain dead.........
Taken out of service entirely.
Leaving his cousin jocelyn to take over.  Which is not a good thing, as she's a little wimpy.

There is gonna be a rough road ahead for a couple of weeks until the new server is in place.
Sounds like HP came through with some kinda discount,,,,,,about 20%......which is good.

So the new server specs are totally in disarray.

This is gonna be a very hard time for Seti.....

I trust t hat those here are wise enough to understand and not try to run their mouths off about how badly things are going.  Facts, not bullshit, will carry us through this.

I am sad for the present term, but the kitties are dancing for the future.
It's gonna be a very bright day when it comes.
It really is.
Title: Re: Latest Seti news.......
Post by: Geek@Play on 19 Oct 2010, 12:26:27 pm
Thanks for the info Mark.

I'm sure Eric and Matt will make sure that they purchase equipment that is more than adequate for the job.  Thanks to HP for the 20% discount.

A bright future is in store for SETI hopefully in a few weeks time.  And thanks to you Mark for having the foresight to run the two funding drives before the total crash.  Without your help it would be a very bleak picture for SETI.
Title: Re: Latest Seti news.......
Post by: msattler on 19 Oct 2010, 12:35:40 pm
Thanks for the info Mark.

I'm sure Eric and Matt will make sure that they purchase equipment that is more than adequate for the job.  Thanks to HP for the 20% discount.

A bright future is in store for SETI hopefully in a few weeks time.  And thanks to you Mark for having the foresight to run the two funding drives before the total crash.  Without your help it would be a very bleak picture for SETI.

Shit.......it wasn't me........
I just presented the truth and the need, and the rest of you responded,
I dropped a K note  in the pot when I could.
I just can't anymore.
My freakin' car died, I am driving the RX, which should be in the shop by now, and things are not pretty.......

Bkut I have poured 10 years of my life into this thing, and, by God, I am gonna see it through.
Title: Re: Latest Seti news.......
Post by: msattler on 19 Oct 2010, 12:44:26 pm
We need a diversion.........

I don't do windows, so honey, don't even ask.

But.........I am pretty good at drinkin' beer.

Crack one and settle back, it's gonna be a bumpy ride.d


I luv you all sooo much that I can't quite express it..
Those that care will understand my feeble means of saying so.

Title: Re: Latest Seti news.......
Post by: perryjay on 19 Oct 2010, 12:54:17 pm
Yes, thanks for the news Mark, no matter it is not the best. I hope Jocelyn doesn't slow us down too much.  I would imagine the server specs being up in flux as the boys decide how to utilize the great discount from HP. Having the servers cost 20% less than they expected means they can load them up with even more goodies!!   ;D  I'm sure looking forward to seeing what they end up with.

I wonder though if it would be possible to cannibalize Mork and Mindy to come up with one that could hold us through. I guess that would probably be more trouble than it is worth for just the relatively short time till the new servers arrive. They might do that later just to have it as a backup  in case one of the other older servers bites the dust.  These last two fund drives have been really something, seeing how so many people really care for our project but we can only give so much. I think the old saying "give until it hurts" has been reached.  It will probably be quite some time before most of us can give again.
Title: Re: Latest Seti news.......
Post by: msattler on 19 Oct 2010, 06:27:42 pm
Just heard from Eric again.........
They are still trying to get jocelyn up to speed to handle mork's duties.......not sure when or how well she might perform once configured.
Title: Re: Latest Seti news.......
Post by: Richard Haselgrove on 19 Oct 2010, 06:52:36 pm
Just heard from Eric again.........
They are still trying to get jocelyn up to speed to handle mork's duties.......not sure when or how well she might perform once configured.

They'll need to keep the query rate down - both the number of queries, and the size of the result recordsets.

Quota is a bad tool for that. If it's high, the database, and the recordsets, get huge. If it's low, the client work request rate gets huge - probably two or three work requests per completed task (not done an exact count). With a multi-CUDA host finishing a task every couple of minutes, that'll reduce Jocelyn to a heap of smoking ashes the first day.

My judgement would be to keep quota (to keep the size down), but to add a scheduler server-requested backoff of something realistic - say 10 minutes. That wouldn't be any hardship to multi-CUDA - report five, get five, instead of report one, get one - but it would slow down the request rate dramatically.
Title: Re: Latest Seti news.......
Post by: msattler on 19 Oct 2010, 06:55:54 pm
Just heard from Eric again.........
They are still trying to get jocelyn up to speed to handle mork's duties.......not sure when or how well she might perform once configured.

They'll need to keep the query rate down - both the number of queries, and the size of the result recordsets.

Quota is a bad tool for that. If it's high, the database, and the recordsets, get huge. If it's low, the client work request rate gets huge - probably two or three work requests per completed task (not done an exact count). With a multi-CUDA host finishing a task every couple of minutes, that'll reduce Jocelyn to a heap of smoking ashes the first day.

My judgement would be to keep quota (to keep the size down), but to add a scheduler server-requested backoff of something realistic - say 10 minutes. That wouldn't be any hardship to multi-CUDA - report five, get five, instead of report one, get one - but it would slow down the request rate dramatically.

Whatever it takes to keep things alive until the cavalry arrives........
You won't hear any complaining from me.

Have you passed your suggestions on to Eric?

Sounds like mork is nothing but a parts donor in the future, but Eric says they might try to put him back online temporarily as the replica DB.
Title: Re: Latest Seti news.......
Post by: Richard Haselgrove on 20 Oct 2010, 04:41:02 am

They'll need to keep the query rate down - both the number of queries, and the size of the result recordsets.

Quota is a bad tool for that. If it's high, the database, and the recordsets, get huge. If it's low, the client work request rate gets huge - probably two or three work requests per completed task (not done an exact count). With a multi-CUDA host finishing a task every couple of minutes, that'll reduce Jocelyn to a heap of smoking ashes the first day.

My judgement would be to keep quota (to keep the size down), but to add a scheduler server-requested backoff of something realistic - say 10 minutes. That wouldn't be any hardship to multi-CUDA - report five, get five, instead of report one, get one - but it would slow down the request rate dramatically.

Whatever it takes to keep things alive until the cavalry arrives........
You won't hear any complaining from me.

Have you passed your suggestions on to Eric?


No, I reckon he's got more then enough in his inbox to keep him busy, let alone get on with the real work. He doesn't need shrapnel from the peanut gallery.

If the community can come up with some consensus advice, based on real understanding of large-scale databases and operating system comms infrastructure, then it can go back to Eric in one of the comms channels which is already open. Yours seems to be working well at the moment.
Title: Re: Latest Seti news.......
Post by: Richard Haselgrove on 20 Oct 2010, 07:00:01 pm
He got the message....

http://setiathome.berkeley.edu/forum_thread.php?id=61828&nowrap=true#1043291
Title: Re: Latest Seti news.......
Post by: skildude on 21 Oct 2010, 10:37:39 am
unfortunately, they went offline at some point during the night or very early morning.  Back to square one?
Title: Re: Latest Seti news.......
Post by: msattler on 21 Oct 2010, 11:49:18 am
unfortunately, they went offline at some point during the night or very early morning.  Back to square one?
Looks like they are working on it......at least the home page and server status page are accessible again....although I wouldn't trust the server status page.
Title: Re: Latest Seti news.......
Post by: Zeus Fab3r on 21 Oct 2010, 11:50:27 am
From Tech News...

Quote
21 Oct 2010 1:50:22 UTC
Our capacity is a bit dicey right now. So to keep things from getting out of hand while we are not watching, we are running uploads only over night and will turn on downloads tomorrow morning (pacific time).
Title: Re: Latest Seti news.......
Post by: msattler on 21 Oct 2010, 11:58:02 am
Just heard from Eric.......

Mysql crashed on jocelyn last night.
They are perusing the crash dumps and resynching tables now.
Title: Re: Latest Seti news.......
Post by: msattler on 21 Oct 2010, 01:40:22 pm
I also questioned Eric about the possibility of a code bug or corruption of mysql causing some of these problems...he agreed, and suggested to Jeff that they load a clean, latest revision copy.

And he will be checking in with the Berk purchasing dept. to see if he can get an updated delivery status on the new servers.
Title: Re: Latest Seti news.......
Post by: msattler on 21 Oct 2010, 08:43:09 pm
Apparently, jocelyn has much slower drives than mork did.......
They just now finished rebuilding the tables, and need to do a backup before they can try a restart.
Dunno how long the backup might take.
Title: Re: Latest Seti news.......
Post by: Geek@Play on 21 Oct 2010, 10:39:29 pm
If I were in the San Francisco area I would not be working on no computer.  I would be at the Giants game!!
Title: Re: Latest Seti news.......
Post by: RottenMutt on 21 Oct 2010, 10:43:25 pm
Apparently, jocelyn has much slower drives than mork did.......
They just now finished rebuilding the tables, and need to do a backup before they can try a restart.
Dunno how long the backup might take.

thanks for the update.  i'm out of gpu work and the leaf blowers have fallen silent:(

go RANGERS!!! :)
Title: Re: Latest Seti news.......
Post by: msattler on 21 Oct 2010, 10:45:09 pm
Eric is not sure if the backups will finish soon enough to attempt a restart yet tonight.....
So I guess you all might as well enjoy the games and check back in tomorrow morning.

Meow meow.
Title: Re: Latest Seti news.......
Post by: msattler on 21 Oct 2010, 11:23:02 pm
FORUMS ARE UP!!!
Eric is not sure if the data part of the project will make it yet tonight, but the forums are up.

Yippety meow!!!

And Jeff reports that he will not try to restart data transmission until tomorrow morning.....
So get some sleep, and get ready to abuse the buttons tomorrow.
Title: Re: Latest Seti news.......
Post by: msattler on 25 Oct 2010, 01:15:47 pm
So far the closest delivery date for the new servers has been quoted as the week of November 8th....so they are in process!