[SCore-users] libgoto (again) /dynamic libraries under SCore

[Nick Birkett]

Hi there.

Having just got back from SC2003 I see that many HPL top500 results are made with libgoto BLAS library :

http://www.cs.utexas.edu/users/kgoto/

Robert van de Geijn
wrote:

>Now that SC03 is over, we are curious to find out how many systems on 
>that list used Kazushige Goto's BLAS libraries to boost performance.  

However I still cannot seem to use the dynamic libgoto library under Score 5.4:

>SCOUT: Spawning done.
>FEP:ERROR '/users/sccomp/benchmarks/hpl/bin/score_goto_p4/./xhpl' is not an SCore application.

sccomp at rr2 score_goto_p4]$ ldd ./xhpl
        libintrins.so.3 => /opt/intel/compiler70/ia32/lib/libintrins.so.3 (0x404cc000)
        libIEPCF90.so.3 => /opt/intel/compiler70/ia32/lib/libIEPCF90.so.3 (0x40647000)
        libF90.so.3 => /opt/intel/compiler70/ia32/lib/libF90.so.3 (0x407b9000)
        libPEPCF90.so.3 => /opt/intel/compiler70/ia32/lib/libPEPCF90.so.3 (0x4087c000)
        libimf.so => /opt/intel/compiler70/ia32/lib/libimf.so (0x408ab000)
        libm.so.6 => /lib/i686/libm.so.6 (0x4099e000)
        libcxa.so.3 => /opt/intel/compiler70/ia32/lib/libcxa.so.3 (0x409c0000)
        libunwind.so.3 => /opt/intel/compiler70/ia32/lib/libunwind.so.3 (0x409f3000)
        /users/sccomp/benchmarks/hpl/BLAS/LIBGOTO/libgoto_p4_512-r0.6.so => /users/sccomp/benchmarks/hpl/BLAS/LIBGOTO/libgoto_p4_512-r0.6.so (0x409f8000)
        libc.so.6 => /lib/i686/libc.so.6 (0x42000000)
        libcprts.so.3 => /opt/intel/compiler70/ia32/lib/libcprts.so.3 (0x40a9d000)
        /lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0x80000000)

All these libs are available on the compute nodes and front end.

Using mpich-gm it all works fine and gives very good results (we had 330GFlops on 48 dual 2.8GH xeons
using Myrinet D cards).

I cannot make a statically linked xhpl as the libgoto is only available as a dynamic library.

These are the HPL compiler and linker flags (using Intel compiler):

 # - Compilers / linkers - Optimization flags ---------------------------
# ----------------------------------------------------------------------
#
CC           = mpicc -compiler intel7
NOOPT        =
CCFLAGS      = -O3
#
# On some platforms,  it is necessary  to use the Fortran linker to find
# the Fortran internals used in the BLAS library.
#
LINKER       = mpif77 -compiler intel7
LINKFLAGS    = $(CCFLAGS) $(TOPdir)/BLAS/LIBGOTO/xerbla.o -shared
#


I also get the same problem if I use the gnu compilers:

[sccomp at rr2 score_goto_p4]$ ldd ./xhpl
        /users/sccomp/benchmarks/hpl/BLAS/LIBGOTO/libgoto_p4_512-r0.6.so => /users/sccomp/benchmarks/hpl/BLAS/LIBGOTO/libgoto_p4_512-r0.6.so (0x40448000)
        libm.so.6 => /lib/i686/libm.so.6 (0x40506000)
        libc.so.6 => /lib/i686/libc.so.6 (0x42000000)
        /lib/ld-linux.so.2 => /lib/ld-linux.so.2 (0x80000000)


If anyone finds how to get this to work please let Score users know.


Many thanks,

Nick


-- 
Dr Nick Birkett     
Technical Director
Streamline Computing Ltd
The Innovation Centre
Warwick Technology Park
Gallows Hill
Warwick CV34 6UW 

Tel     :  +44 (0)1926 623130 
Fax     :  +44 (0)1926 623140
Mobile  :  +44 (0)7890 246662
Email   :  nrcb at streamline-computing.com
Support :  support at streamline-computing.com
Web     :  http://www.streamline-computing.com