Seti@Home optimized science apps and information

Optimized Seti@Home apps => Linux => Topic started by: Simon on 26 Mar 2007, 07:18:10 pm

Title: Initial public release - Rev-2.2B Linux science apps
Post by: Simon on 26 Mar 2007, 07:18:10 pm
Hi folks,

it's been a long time coming: new optimized Linux science apps (http://lunatics.at/index.php?module=Downloads;catd=14) based on the same R-2.2B code as the Windows ones have been released.

The Linux Port was done by Crunch3r, Hans Dorn and myself, the 2.2B code is by Ben Herndon, Josef W. Segur and Alex Kan with some compatibility edits by me.

MMX (http://lunatics.at/index.php?module=Downloads;sa=dlview;id=73) - Intel P1MMX/P2, AMD Athlon
SSE (http://lunatics.at/index.php?module=Downloads;sa=dlview;id=74) - Intel P3, Athlon XP
SSE2-generic (http://lunatics.at/index.php?module=Downloads;sa=dlview;id=75) - AMD Athlon64/X2
SSE2-P4 (http://lunatics.at/index.php?module=Downloads;sa=dlview;id=76) - Intel P4 (Willamette & Northwood)
SSE2-PM (http://lunatics.at/index.php?module=Downloads;sa=dlview;id=77) - Intel Pentium M/Banias/Core Solo or Duo (NOT Core 2 Duo!)
SSE3-P4 (http://lunatics.at/index.php?module=Downloads;sa=dlview;id=78) - Intel P4 (Prescott) and Pentium D
SSE3-C2 (http://lunatics.at/index.php?module=Downloads;sa=dlview;id=79) - Intel Core 2 Duo & Quad

Please unpack the app of your choice ("tar xfvj KWSN-R2.2B--SSE.tar.bz2") and read Instructions.txt inside the folder it creates.

Should you be unsure about which version to use, please type:

"cat /proc/cpuinfo"

This should show you what CPU you have, whether it's an AMD or an Intel one and what its name is. Should be helpful in choosing; if you're still unsure,  please post a reply in this thread about it.

Regards,
Simon.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Roy on 26 Mar 2007, 08:21:39 pm
Whoo-Hooo!!  Yippee!

Thank You to everyone involved - we DO appreciatte all the hard work this has taken!

Unfortunately - when I try to open the downloaded archive, bzip2 reports errors. :(
Running
     bunzip2 -t KWSN-R2.2B--SSE.tar.bz2
yields this message:
    bunzip2: Desktop/KWSN-R2.2B--SSE.tar.bz2: bad magic number (file not created by bzip2)


I've had the same problem on both my Linux systems (one Intel, one AMD).

Is it me, or is there a problem with the files provided?

Roy
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Crunch3r on 26 Mar 2007, 08:47:25 pm
Whoo-Hooo!!  Yippee!

Thank You to everyone involved - we DO appreciatte all the hard work this has taken!

Unfortunately - when I try to open the downloaded archive, bzip2 reports errors. :(
Running
     bunzip2 -t KWSN-R2.2B--SSE.tar.bz2
yields this message:
    bunzip2: Desktop/KWSN-R2.2B--SSE.tar.bz2: bad magic number (file not created by bzip2)


I've had the same problem on both my Linux systems (one Intel, one AMD).

Is it me, or is there a problem with the files provided?

Roy

I've checked the files and their all ok.

Not sure what's going wrong on your side ....

I'd recommencd you to open a shell/terminal and NOT using any other software to extrackt the files.

1. open a terminal
2. "cd" to the directory that contains the downloaded files
3. extract the files with "tar -xvjf KWSN-R2.2B--SSE.tar.bz2"
4. stop boinc
5. copy the new files over the old apps.
6. start boinc again

That's all you got to do.

Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Roy on 26 Mar 2007, 08:59:17 pm
Thanks for the suggestion, but....  command line used and erro message received:

roy@zaphod:~/boinc_temp$ tar -xvjf ../Desktop/KWSN-R2.2B--SSE.tar.bz2
bzip2: (stdin) is not a bzip2 file.
tar: Child returned status 2
tar: Error exit delayed from previous errors

Not sure I understand - I installed the  "old" Linux version okay.....
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Natronomonas on 26 Mar 2007, 09:00:03 pm
I am encountering the same error running Ubuntu 6.10, whether I use "Archive manager" or go to the terminal and use bunzip2 or tar to extract the files, e.g.

 $ tar -xvjf KWSN-R2.2B--SSE.tar.bz2
bzip2: (stdin) is not a bzip2 file.
tar: Child returned status 2
tar: Error exit delayed from previous errors

It also occurs on the SSE2 version, I haven't tried the others. Is there anything else I can try?

Thanks ; )
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: michael37 on 26 Mar 2007, 09:04:03 pm
I am confirming a problem with bzip2 which does NOT open on all platforms.  7-zip on Windows opened the archive successfully. 

Here is from Fedora Core 5:

[testing-C2]# ls
KWSN-R2.2B--SSE3-C2.tar.bz2
[testing-C2]# tar xvfj KWSN-R2.2B--SSE3-C2.tar.bz2
bzip2: (stdin) is not a bzip2 file.
tar: Child returned status 2
tar: Error exit delayed from previous errors
[testing-C2]# tar --version
tar (GNU tar) 1.15.1
[testing-C2]# bzip2 --version
bzip2, a block-sorting file compressor.  Version 1.0.3, 15-Feb-2005.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Roy on 26 Mar 2007, 09:05:19 pm
Sorry to hear it's not just me. :(

Ubunto 6.10 here as well.

I re-downloaded just to make sure it was'n't a bad download - same results.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Roy on 26 Mar 2007, 09:23:37 pm
Based on the comment by michael37, I tried DLing and unzipping the Linux app on my Windows platform. 

Put the files in a shared folder, and went to my Linux box and copied the files into BOINC/projects/setiathome

Seems to be working fine!

One thing threw me for a  second - all the apps before this had "seti" somewhere in their name - this time, doing a
ps -ef | grep seti
showed nothing!  But I figured it out...

It would certainly appear that there may be some sort of incompatibility between 7zip on windows and bzip2 on Linux.

Thanks again, everyone!
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Natronomonas on 26 Mar 2007, 09:29:40 pm
I have had success extracting the files on OSX, then copying to my linux host.
So thus far it would seem the only platform unable to open the linux app archives is .... linux.  ;D

Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: michael37 on 26 Mar 2007, 09:32:52 pm
Based on the comment by michael37, I tried DLing and unzipping the Linux app on my Windows platform. 

Put the files in a shared folder, and went to my Linux box and copied the files into BOINC/projects/setiathome

Seems to be working fine!

One thing threw me for a  second - all the apps before this had "seti" somewhere in their name - this time, doing a
ps -ef | grep seti
showed nothing!  But I figured it out...

It would certainly appear that there may be some sort of incompatibility between 7zip on windows and bzip2 on Linux.

Thanks again, everyone!


You got it.  The applications are now called KWSN-R2.2B-SSEXX-XX

For the time being, use 7-zip to open the archives. bzip2 on most distributions will not work
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Simon on 27 Mar 2007, 06:10:52 am
Hm,

interesting. I used "tar cfj archive.tar.bz2 directory/" as command to compress the files; so far, I haven't had any trouble unpacking on my test hosts (Suse 9.2, Debian Sarge, Slackware 10.1).

This is the very first time I've heard of bzip2 Archives not opening; I could always make .tar.gz's if that'll help anything.

Also, yes, the apps are now called KWSN-R2.2B-* where * is MMX/SSE/SSE2-generic/SSE2-P4/SSE2-PM/SSE3-P4/SSE3-C2, as with the Windows versions.

Regards,
Simon.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Metod, S56RKO on 27 Mar 2007, 07:32:16 am
interesting. I used "tar cfj archive.tar.bz2 directory/" as command to compress the files; so far, I haven't had any trouble unpacking on my test hosts (Suse 9.2, Debian Sarge, Slackware 10.1).

This is the very first time I've heard of bzip2 Archives not opening; I could always make .tar.gz's if that'll help anything.

Just downloaded KWSN-R2.2B--SSE2-generic.tar.bz2 and surely enough tar on my Debian Etch AMD64 barfed:

Quote
tar jxvf KWSN-R2.2B--SSE2-generic.tar.bz2
bzip2: (stdin) is not a bzip2 file.
tar: Child returned status 2
tar: Error exit delayed from previous errors

However, this gave some clue:

Quote
file KWSN-R2.2B--SSE2-generic.tar.bz2
KWSN-R2.2B--SSE2-generic.tar.bz2: gzip compressed data, from Unix, last modified: Tue Mar 27 00:33:43 2007

Surely enough:

Quote
tar zxvf KWSN-R2.2B--SSE2-generic.tar.bz2
KWSN-R2.2B--SSE2-generic/
KWSN-R2.2B--SSE2-generic/Instructions.txt
KWSN-R2.2B--SSE2-generic/Readme+Licenses/
KWSN-R2.2B--SSE2-generic/Readme+Licenses/setiathome-5.15-kwsn-AUTHORS
KWSN-R2.2B--SSE2-generic/Readme+Licenses/setiathome-5.15-kwsn-COPYING
KWSN-R2.2B--SSE2-generic/Readme+Licenses/setiathome-5.15-kwsn-COPYRIGHT
KWSN-R2.2B--SSE2-generic/Readme+Licenses/setiathome-5.15-kwsn-EXTRA_NOTE
KWSN-R2.2B--SSE2-generic/Readme+Licenses/setiathome-5.15-kwsn-README
KWSN-R2.2B--SSE2-generic/Readme+Licenses/setiathome-5.15-kwsn-README_APP
KWSN-R2.2B--SSE2-generic/Files-to-install/
KWSN-R2.2B--SSE2-generic/Files-to-install/app_info.xml
KWSN-R2.2B--SSE2-generic/Files-to-install/KWSN-R2.2B-SSE2-generic

So, these are not Bzip2 compressed, but rather gzip compressed archives.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Metod, S56RKO on 27 Mar 2007, 07:42:10 am
An item to add on a wish list: could you provide statically-linked binaries?

I have an old machine here which doesn't like new binaries:

Quote
ldd KWSN-R2.2B-SSE
./KWSN-R2.2B-SSE: /lib/i686/libc.so.6: version `GLIBC_2.3.4' not found (required by ./KWSN-R2.2B-SSE)
./KWSN-R2.2B-SSE: /lib/i686/libc.so.6: version `GLIBC_2.3.2' not found (required by ./KWSN-R2.2B-SSE)
./KWSN-R2.2B-SSE: /lib/i686/libc.so.6: version `GLIBC_2.3' not found (required by ./KWSN-R2.2B-SSE)
./KWSN-R2.2B-SSE: /lib/i686/libpthread.so.0: version `GLIBC_2.3.2' not found (required by ./KWSN-R2.2B-SSE)
        libdl.so.2 => /lib/libdl.so.2 (0xb7fd4000)
        libm.so.6 => /lib/i686/libm.so.6 (0xb7fb1000)
        libpthread.so.0 => /lib/i686/libpthread.so.0 (0xb7f9d000)
        libc.so.6 => /lib/i686/libc.so.6 (0x42000000)
        /lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0xb7fed000)

If you have some time ...
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Prognatus on 27 Mar 2007, 11:08:13 am
So, these are not Bzip2 compressed, but rather gzip compressed archives.

I can confirm this. As many others here, I had problems opening the files (tried SSE and MMX), but when I renamed them to a .gz suffix instead of .bz2 they opened like a charm in the package manager.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Simon on 27 Mar 2007, 12:07:21 pm
Hm,

maybe a typo? I do believe I did type "tar cfj", not "tar cfz"; still, to err is human. I'll recompress and upload archives that are what their suffix suggests ;)

Regards,
Simon.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Simon on 27 Mar 2007, 02:38:37 pm
Hi folks,

I recompressed the R-2.2B Linux apps, this time I'm positive they're all what they pretend to be ;)

Quote
compilatrix:~/KWSN-R2.2B-App-Packs# tar cfj KWSN-R2.2B-MMX.tar.bz2 KWSN-R2.2B--MMX
compilatrix:~/KWSN-R2.2B-App-Packs# tar cfj KWSN-R2.2B-SSE.tar.bz2 KWSN-R2.2B--SSE
compilatrix:~/KWSN-R2.2B-App-Packs# tar cfj KWSN-R2.2B-SSE2-generic.tar.bz2 KWSN-R2.2B--SSE2-generic
compilatrix:~/KWSN-R2.2B-App-Packs# tar cfj KWSN-R2.2B-SSE2-PM.tar.bz2 KWSN-R2.2B--SSE2-PM
compilatrix:~/KWSN-R2.2B-App-Packs# tar cfj KWSN-R2.2B-SSE2-P4.tar.bz2 KWSN-R2.2B--SSE2-P4
compilatrix:~/KWSN-R2.2B-App-Packs# tar cfj KWSN-R2.2B-SSE3-P4.tar.bz2 KWSN-R2.2B--SSE3-P4
compilatrix:~/KWSN-R2.2B-App-Packs# tar cfj KWSN-R2.2B-SSE3-C2.tar.bz2 KWSN-R2.2B--SSE3-C2

compilatrix:~/KWSN-R2.2B-App-Packs# file *.bz2
KWSN-R2.2B-MMX.tar.bz2:          bzip2 compressed data, block size = 900k
KWSN-R2.2B-SSE2-generic.tar.bz2: bzip2 compressed data, block size = 900k
KWSN-R2.2B-SSE2-P4.tar.bz2:      bzip2 compressed data, block size = 900k
KWSN-R2.2B-SSE2-PM.tar.bz2:      bzip2 compressed data, block size = 900k
KWSN-R2.2B-SSE3-C2.tar.bz2:      bzip2 compressed data, block size = 900k
KWSN-R2.2B-SSE3-P4.tar.bz2:      bzip2 compressed data, block size = 900k
KWSN-R2.2B-SSE.tar.bz2:          bzip2 compressed data, block size = 900k

I've uploaded these new archives in place of the old ones; the links remain the same.

As Douglas Adams put it so well in the HHGTTG - "Sorry for the inconvenience.".

Static apps may come sometime later; the platform we used for compilation is Suse 9.2.

Quote
compilator:~ # gcc -v
Reading specs from /usr/lib/gcc-lib/i586-suse-linux/3.3.4/specs
Configured with: ../configure --enable-threads=posix --prefix=/usr --with-local-prefix=/usr/local --infodir=/usr/share/info --mandir=/usr/share/man --enable-languages=c,c++,f77,objc,java,ada --disable-checking --libdir=/usr/lib --enable-libgcj --with-gxx-include-dir=/usr/include/g++ --with-slibdir=/lib --with-system-zlib --enable-shared --enable-__cxa_atexit i586-suse-linux
Thread model: posix
gcc version 3.3.4 (pre 3.3.5 20040809)

YaST says glibc-2.3.3 is installed, 2.3.2 may also work, anything newer definitely should.

Regards,
Simon.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Simon on 27 Mar 2007, 03:23:43 pm
Okay,

static apps may come a little more quickly; in fact, I've just updated the downloads yet again.

That is to say, I used the same process as with the 1.3 app releases: a "statified" app. That means, it is fully static as far as Linux is concerned, it just wasn't compiled that way.

http://statifier.sf.net is what I used; seemed to work well enough last time ;)

So - any new downloads will get the static ones. Anyone who needs them, please redownload. Also, I did make sure the archives are valid this time ;)

Regards,
Simon.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: ajs on 27 Mar 2007, 07:44:12 pm
nice work Simon, I also had a couple of machines that complained.
And well done to the team
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: Natronomonas on 27 Mar 2007, 09:03:18 pm
ditto! : )

Thanks for the statics, I also had a few problems with one machine, but that should solve it.

Really appreciate the time you put into these.
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: clk on 30 Mar 2007, 12:43:55 am
Howdy all,
     A note that I'm getting errors trying to run the new Linux 2.2B apps.  They won't work on multiple RHEL3 and RHEL4 boxes.  I get errors with some note about "Signal 11"  I've tried SSE3 P4, SSE2 P4, and SSE2 generic.  I've tried with systems using both BOINC 5.4.11 and 5.8.15.

     The SSE3 P4 app does work on one RHEL4 x86_64 bit OS box.  Using Augustine's 64 bit BOINC 5.8.15.

     I've been able to use the SSE3 app that Crunch3r posted over on the Seti message board with RHEL4 boxes (32bit OS).
http://setiathome.berkeley.edu/forum_thread.php?id=38058

Hope this is helpful info for tracking down the fixes.  This is my first post so I'd like to properly thank Simon, Crunch3r and Hans Dorn for this new Linux port, and of course also thanks to the original optimizer crew of Ben Herndon, Josef Segur, Alex Kan, and again Simon.  I've been using the optimized code on Linux and Windows for a while now and getting significant speed enhancement.

Cheers, Chris
Title: Re: Initial public release - Rev-2.2B Linux science apps
Post by: michael37 on 30 Mar 2007, 01:32:13 am
Howdy all,
     A note that I'm getting errors trying to run the new Linux 2.2B apps.  They won't work on multiple RHEL3 and RHEL4 boxes.  I get errors with some note about "Signal 11"  I've tried SSE3 P4, SSE2 P4, and SSE2 generic.  I've tried with systems using both BOINC 5.4.11 and 5.8.15.

Thanks for the note.  I have tried Crunch3r's apps, and they work on RHEL4 systems, but they do not work on RHEL3.  Neither  do statified Simon's -- those segfault with error -11.

So far, no solution for 2.4 kernels with 2.3.2 GLIBC libraries it seems.