Software Distribution

PC Cluster Consortium

You are the th visitor.

Current Release Information

  • SCore Cluster System Software Version 7
    1. SCore 7 beta (Released 2008/11/17)
      1. The SCore 7 beta binary distributin is for Centos 5.2 on x86-64.

        The SCore 7 beta binary distribution provides only the RPM files for CentOS 5 on x86-64. The distribution in RPM files includes the MPI libraries for Fujitsu compiler, Intel compiler version 9.1 and PGI compiler. If you want to use SCore 7 beta on any other Linux OSes and/or distributions, you must build SCore 7 beta form source codes.
        Attention:SCore 7 beta does NOT have binary compatibility with SCore 6 or before.

      2. The release note of the SCore 7 beta is here.
  • SCore Cluster System Software Version 6
    1. SCore 6.0.2.1 (Released 2007/3/2)

      sorry, Nobody can compile the scored command on SCore 6.0.2. And the scored command dose not include binary rpm on SCore 6.0.2. SCore 6.0.2.1 fixed the bug.

    2. SCore 6.0.2 (Released 2007/2/26)
      1. The SCore 6.0.2 binary distribution is for CentOS 4.4

        The SCore 6.0.2 binary distribution provides only the RPM files for CentOS 4.4. The distribution in RPM files includes the MPI libraries for Fujitsu compiler, Intel compiler version 9.1 and PGI compiler. If you want to use SCore 6.0.2 on any other Linux OSes and/or distributions, you must build SCore 6.0.2 form source codes.
        Attention:SCore 6.0.2 does NOT have binary compatibility with SCore 5.8,3 or before.

      2. New Features in SCore 6.0.2

        1. When compute hosts are booted, CRT module is loaded.
          You can use new checkpoint/restart as default.

        2. The setup command saves log file.

        3. If you install new version of SCore, old files in /opt/score/etc are copy to new one.

        4. corebinding option is added to scrun command to specify the core (processor) and process binding.

      3. Bug Fixes
        1. Fix malloc() is allocated more memory when PM is used.
        2. e1000 driver is updated. You can use PM/Ethernet on PCI-Express e1000 NIC.
        3. Dependency fixed to make OMNI and MPI rpm.
        4. If you compile SCore program with -nocheckpoint option, the program didn't w ork.
      4. Unsupported in SCore 6.0.2
      5. Limitation
        1. Because the document of the new checkpoint facility has not been available, please send an e-mail to the user mailing list if you want to use it.
        2. Because the document of the auto configuration tool has not been available, please send an e-mail to the user mailing list if you want to use it.
    3. SCore 6.0.1 (Releaseed 2006/12/14)
      1. The SCore 6.0.1 binary distribution is for CentOS 4.4

        The SCore 6.0.1 binary distribution provides only the RPM files for CentOS 4.4. The distribution in RPM files includes the MPI libraries for Fujitsu compiler, Intel compiler version 8 and PGI compiler. If you want to use SCore 6.0.1 on any other Linux OSes and/or distributions, you must build SCore 6.0.1 form source codes.
        Attention:SCore 6.0.1 does NOT have binary compatibility with earlier versions.

      2. New Features in SCore 6.0.1

        1. PM/Myrinet2XP device come back.

        2. X11 relay come back.
          When the SCore program use X11, the program connect via ssh with X11 forwarding and X11 server disable TCP/IP.

        3. SCore Auto Configuration Tool Documents is available.
          But Japanese only.
      3. Bug Fixes
        1. Port is used when execute SCore-D multi user mode is fixed.
        2. PM/Myrinet is hang when pmRead() use the first.
        3. When SCore program is abnormal end with a node and without debug option, the program is exited quickly.
      4. Limitation
        1. Because the document of the new checkpoint facility has not been available, please send an e-mail to the user mailing list if you want to use it.
        2. Because the document of the auto configuration tool has not been available, please send an e-mail to the user mailing list if you want to use it.
    4. SCore 6.0.0 (Releaseed 2006/11/13)
      1. The SCore 6.0.0 binary distribution is for CentOS 4.4

        The SCore 6.0.0 binary distribution provides only the RPM files for CentOS 4.4. The distribution in RPM files includes the MPI libraries for Fujitsu compiler, Intel compiler version 8 and PGI compiler. If you want to use SCore 6.0.0 on any other Linux OSes and/or distributions, you must build SCore 6.0.0 form source codes.
        Attention:SCore 6.0.0 does NOT have binary compatibility with earlier versions.

      2. New Features in SCore 6.0.0

        1. New Checkpoint Facility
          The new checkpoint facility called CRT (Checkpoint/Restart for Threads) supports the checkpoint of a multi-threaded and/or dynamically linked application.

        2. No kernel patch
          SCore has required the Linux kernel path in the previous SCore distributions. SCore 6.0.0 does not require any kernel patches. All kernel functions realized in SCore are implemented as kernel modules.

        3. YAMPI MPI Communication Library
          In addition of MPICH1.2.5, YAMPI MPI Communication Library is supported.

        4. Auto Configuration Tool
          A tool to provide the dynamic compute host configuration. The tool manages the SCore-D database so that the compute host list is dynamically maintained.

        5. Dynamic Reconfiguration Tool
          In the SCore-D multi user mode, a compute host is dynamically joined or leaved. For more information, please look at the SCore-D "-daemon" option described in the man page

        6. Easy Installation Tool, EIT Version 2.0
          The GUI based SCore installation tool comes back !

      3. Bug Fixes
        1. Application aborted when a lot of messages are printed
      4. Unsupported in SCore 6.0.0

      5. Limitation
        1. Because the document of the new checkpoint facility has not been available, please send an e-mail to the user mailing list if you want to use it.
        2. Because the document of the auto configuration tool has not been available, please send an e-mail to the user mailing list if you want to use it.
  • SCore Cluster System Software Version 5
    1. SCore 5.8.3 (Released 2005/11/14)
      Attention:SCore 5.8.3 does NOT have binary compatibility with SCore 5.8.1 and before SCore 5.0.1.
      1. The SCore 5.8.3 binary distribution is for Fedora Core 3. If you want to use SCore 5.8.3 on any other Linux OSes, you must build SCore 5.8.3 form source codes.
        This distribution includes the MPI libraries for Fujitsu compiler, Intel compiler version 8 and PGI compiler.
        SCore 5.8.3 does not include Easy Installation Tool.
      2. Changes in SCore 5.8.3
        1. Linux Kernel 2.6.11 is supported.
        2. The pmopt and rpmopt commands are added to query PM options.
        3. The scoreld command is added.
        4. The -noscwrap option is added to the compile drivers such as scorecc . If you specify this option, the compiler does not link the scwrap library.
        5. Add a new PM/Ethernet driver which is no need of kernel patch (Experimental).
        6. The llseek() wrapper bug is fixed.
        7. The smake command bug, that does not make OMNI OpenMP programs, is fixed.
        8. An SCore program can handle /dev/stdin, /dev/stdout, /dev/stderr.
        9. umask of an SCore program is inherited from the one of the scrun program.
        10. An SCore program can use the LD_LIBRARY_PATH environment variable.
        11. A new option bincopy of the scrun command is introduced for not copying an executable file, assuming the file is distributed via a network file system.
        12. A bug in which SCore-D hangs when some user jobs terminate simultaneously is fixed.
      3. Unsupported in SCore 5.8.3
        1. PM/Infiniband for TopSpin HCA is unsupported.
      4. Limitation

        1. The checkpoint function does not work at this moment.

        2. When a program outputs a lot of messages continuously, SCore-D may be crashed.

        3. The IA64 platforms have not not been tested.

        4. AMD64 porting

          The following features in an AMD64 cluster are NOT tested:

          1. Omni OpenMP

          2. Remote DMA functions on Myrinet, Myrinet2K, MyrinetXP and Myrinet2XP

        5. Remote DMA functions on PM/Ethernet does not work on SCore 5.8.3 and Linux 2.6.x

        6. PM/myrinet2xp

          The pmWrite() function does not work with Myrinet2XP.

        7. PM/Infiniband for TopSpin HCA does not tested on SCore 5.8.3

        8. PM/Infiniband for Fujitsu HCA

          A special HCA firmware dedicated to SCore is required. Ask Fujitsu to get the firmware.
    2. SCore 5.8.2 (Released 2004/11/29)
      Attention:SCore 5.8.2 does NOT have binary compatibility with SCore 5.8.1 and before SCore 5.0.1.
      1. The SCore 5.8.2 binary distribution is for Fedora Core 1
        Attention: The SCore 5.8.2 binary distribution provides only the RPM files for Fedora Core 1. If you want to use SCore 5.8.2 on any other Linux OSes, you must build SCore 5.8.2 form source codes.
        This distribution includes the MPI libraries for Fujitsu compiler, Intel compiler version 8 and PGI compiler.
        SCore 5.8.2 does not include Easy Installation Tool.
      2. New Features in SCore 5.8.2

        1. PathScale compiler can be used as a backend compiler.

      3. Bug Fixes
        1. PBS did not work on IA64.
        2. Checkpoint and restart did not work on AMD64.
        3. The binary compatibility with SCore 5.8.1 bug is fixed.
          SCore 5.8.2 is binary-compatible with SCore 5.2 or newer except SCore 5.8.1.
        4. truncate64() and ftruncate64() problems are fixed.
        5. C++ programs compiled with Intel compiler on AMD64 were unable to link.
        6. sctop was unable to compile on IA64.
      4. Limitations

        1. IA64 porting

          We have not tested the following features in an IA64 cluster:

          1. Omni OpenMP

        2. AMD64 porting

          The following features in an AMD64 cluster are NOT tested:

          1. Omni OpenMP

          2. Remote DMA functions on Myrinet, Myrinet2K, MyrinetXP and Myrinet2XP

        3. PM/Infiniband for Fujitsu HCA

          A special HCA firmware dedicated to SCore is required. Ask Fujitsu to get the firmware.

        4. The PM/Ethernet trunking has only been tested on up to three Intel EEPRO100 NICs and up to two Syskonnect SK9843 NICs, Intel PRO1000/XT NICs and Broadcom BCM5701 NICs. It is already known that the Ethernet trunking does not work with some mixture of different NIC cards, e.g., the combination of the tulip and 3C05B NICs.

        5. PVM is not fully tested.

        6. About the PM/Infiniband for Topspin

          If you want to use PM/InfiniBand for Topspin, the driver modules NOT included in this distribution are required.
      5. Known Bugs

        1. PM/myrinet2xp

          The pmWrite() function does not work with Myrinet2XP.

        2. PVM does not work in an SMP cluster.

    3. SCore 5.8.1 (Released 2004/11/8)
      Attention:SCore 5.8 dose NOT have binary compatibility of other SCore version.
      If you want to execute old SCore programs, you have to re-compile.

      1. The SCore 5.8.1 binary distribution is for Fedora Core 1
        Attention: The SCore 5.8.1 binary distribution provides rpm files for Fedora Core 1. It does not provide rpms for Redhat 7.3. If you want to use SCore 5.8.1 on Redhat 7.3, you must compile SCore 5.8.1 sources.
        The rpm files include the MPI library for Fujitsu compiler and Intel compiler ve rsion 8. SCore 5.8.1 does not include Easy Installation Tool.
      2. New features in SCore 5.8.1
        1. PM device is now loadable
        2. scrun add the -ts option to specify the time interval interrupting user program execution to detect a deadlock situation.
        3. rsh-all add the -norsh option and the @host keyword to use a command that communicates with the compute hosts directory (for example rcp).
      3. Changes
        1. rcp-all is renamed score-cp. The new rcp-all was rewritten using rsh-all.
      4. Limitations
        1. IA64 porting
          We dose not tested the following features in an IA64 cluster:
          1. Omni OpenMP
          2. PBS
          3. sctop is not compiled
        2. AMD64 porting
          We have not tested the following features in an AMD64 cluster:

          1. Checkpoint

          2. Omni OpenMP

          3. pm_read and pmwrite with PM/myrinet*

        3. PM/Infiniband for Fujitsu HCA porting

          HCA firmware update is needed to use SCore.
        4. The PM/Ethernet network trunking feature has been only tested on up to three
          Intel EEPRO100 NICs and up to two Syskonnect SK9843 NICs, Intel PRO1000/XT NICs and Broadcom BCM5701 based NICs. We already found that the feature does not work using some different NIC cards, e.g., the combination of tulip and 3C05B NICs.
        5. PM/myrinet2xp
          The pmWrite() function does not work with PM/myrinet2xp.
        6. PVM is not fully tested.
        7. PVM does not work in an SMP cluster
        8. The PM/InfiniBand for Topspin porting
          The driver module is not currently open sourced. If you want to use PM/InfiniBand for Topspin, request the binary from the Topspin InfiniBand distributor. We are currently in the process of implementing the open source version.

    4. SCore 5.8 (Released 2004/8/6)
      Attention:SCore 5.8 dose NOT have binary compatibility of SCore 5.0.1 or before.
      If you want to execute old SCore programs, you have to re-compile.

      1. New features in SCore 5.8
        1. Following distributions are newly supported.

          • Fedora Core 1 for x86

          • Fedora Core 1 for AMD64

        2. The following PM devices are supported:

          • Myrinet 2XP

          • Infiniband-ts (TopSpin InfiniBand Fabric)

        3. The following Compilers are suppported:

          • Intel compiler version 8

          • Fujitsu compiler version 5

        4. The following contribution package s are added:

          • Gram Job Manager(SGE/SCore)
          • BLASTBAND for SCore
        5. In scout, -nostdin option is added.

        6. In scoreboard, scorednetwork attribute to specify SCore-D network is added.

        7. In SCore-D console command, limiting user resouces is added.

        8. ULT_STACK_SIZE environment variable is added to specify stack size for mpc++

      2. Changes

        1. The SCore compile drivers output warning message when -nockpt option is specified.

        2. If -lpthread is specified, SCore compile drivers assume -nockpt option.

        3. Delete bustest2k, bustestxp. These commands are merged into the bustest command

        4. scstest output numbers of packet per second and network configuration.

      3. Bug Fixes

        1. Myrinet XP firmware bug is fixed.

        2. PM/Infiniband for Fujitsu HCA porting

          Checkpoint is now supported in this version.

        3. Memory allocation over 1 GB bug on redhat 7.3 and 8.0 is fixed.

        4. MPI program can run over 2048 processors now.

        5. The Fortran compiler recognizes to configure mpich 1.2.5.

        6. Mpc++ program was unable to work on IA64 with dynamic link.

        7. The checkpoint is now able to work on IA64 and Opteron.

      4. Limitations

        1. IA64 porting

          We have not tested the following features in an IA64 cluster:

          1. Omni OpenMP

          2. PBS

        2. AMD64 porting

          We have not tested the following features in an AMD64 cluster:

          1. Omni OpenMP

        3. PM/Infiniband for Fujitsu HCA porting

          HCA firmware update is needed to use SCore.

        4. The PM/Ethernet network trunking feature has been only tested on up to th ree Intel EEPRO100 NICs and up to two Syskonnect SK9843 NICs, Intel PRO1000/XT NICs and Broadcom BCM5701 based NICs. We already found that the feature does not work using some different NIC cards, e.g., the combination of tulip and 3C05B NICs.

        5. PM/myrinet2xp

          pmWrite() function is not work with PM/myrinet2xp.

        6. PVM is not fully tested.

        7. PVM does not work in an SMP cluster.

        8. The PM/InfiniBand for Topspin porting

          The driver modules are not currently open sourced. If you want to use PM/InfiniB and for Topspin, request the binary from InfiniBand vendor. We are currently in the process of implementing the open source version.
      5. Known Bugs
        1. EIT
          1. The modification of the display name in the network configuration window is not effective.

        2. If you specify group option with scrun, and if you specify wrong group or hostname, scrun will not stop.
        3. If you specify group and checkpoint option with scrun, and you specify wrong resource (for example, too many CPU is specified), scrun try to execute scored infinite.

    5. SCore 5.6.0 and SCore 5.6.1 Myrinet XP bug fixed(Released 2003/11/26)

      The interrupt bug of PM MCP firmware for Myrinet XP is fixed. If you use Myrinet XP, the MCP program must be replaced with the bug fixed version.

    6. SCore 5.6.1 bug fixes from SCore 5.6.0 (Released 2003/11/17)
      Attention:SCore 5.6 dose not have binary compatibility of SCore 5.0.1 or before.
      If you want to execute old SCore programs, please recompile them.

      The following SCore 5.6.0 bugs are fixed:

      1. rbustest is not work by default for PATH probrem.

      2. linkage errors with the -nostatic option.

      3. No mpic++ driver in mpich 1.2.5.

      4. Fortran 90 programs could not be compiled in mpich 1.2.5.

      5. The kernel patch for IA64 is reject with some files.

      If you want to upgrade from SCore 5.6.0, please get The patch from SCore 5.6.0.

    7. SCore 5.6.0 (CD-ROM Released at SC2003)
      Attention:SCore 5.6 dose not have binary compatibility of SCore 5.0.1 or before.
      If you want to execute old SCore programs, please recompile them.
      1. New features in SCore 5.6

        1. Linux Kernel 2.4.21 is supported.

        2. The following distributions are supported:

          • Red Hat 9 (You may compile the SCore source under the Red Hat 9)

          • SuSE Linux 8.1 for AMD64 (pre-alpha version: You may compile the SCore so urce under the SuSE linux for AMD64)

        3. The following PM devices are supported:

          • Myrinet XP

          • Infiniband for Fujtisu HCA (Beta-version)

        4. MPICH 1.2.5 is supported.

        5. rbustest is introduced.

        6. msgblock is enhanced.

        7. Enhanced Network Security

        8. Job freeze (Experimental)

        9. Sun Grid Engine tight integration support (Experimental)

      2. Changes

        1. sctop format is changed (PID instead of TCP port number).

      3. Bug Fixes

        1. RMA bug on PM/myrinet for IA64 is fixed.

        2. pmTruncateBuffer() bug on PM/shmem is dixed.

        3. The cache bug on scoreboard is fixed.

        4. scout bug is fixed.

        5. Checkpoint bug is fixed.

        6. Output redirection bug is fixed.

      4. Limitations

        1. IA64 porting

          We have not tested the following features in an IA64 cluster:

          1. Checkpoint

          2. Omni OpenMP

          3. PBS

        2. AMD64 porting

          This version is a pre-alpha version. We have tested only PMv2 communication library.(PM/Myrinet, PM/Ethernet, PM/Shme m). Use bcm5700 driver instead of tg3 driver for PM/Ethernet.

        3. PM/Infiniband for Fujitsu HCA porting

          HCA firmware update is needed to use SCore.
          Checkpoint is not supported in this version.

        4. The PM/Ethernet network trunking feature has been only tested on up to th ree Intel EEPRO100 NICs and up to two Syskonnect SK9843 NICs, Intel PRO1000/XT NICs and Broadcom BCM5701 baseed NICs. We already found that the feature does not work using some different NIC cards, e.g., the combination of tulip and 3C05B NICs.

        5. PVM is not fully tested.

        6. PVM does not work in an SMP cluster.

      5. Known Bugs
      6. EIT
        1. The modification of the display name in the network configuration window is not effective.

      7. To use rbustest, you must add /opt/score/deploy in PATH variable on compu te hosts.

      8. The kernel patch file for IA64 (linux2.4.21_ia64.score.patch) is faild in some files. If you want to run the kernel on SGI SN system, please patch arch/ia64/sn/io /sn2/shub.c by hand. If you want to run on other system, please ignore reject files.

    8. SCore 5.4 (Released 2003/02/20)
      Attention:SCore 5.4 dose not have binary compatibility of SCore 5.0.1 or before.
      If you want to execute old SCore programs, please recompile them.
      1. New features in SCore 5.4

        1. A standard input for the scout command is supported.

        2. Kernel 2.4.19 is supported.

        3. The following distributions are supported:

          • Red Hat 7.3 (The SCore binary image is compiled for Red Hat 7.3)

          • Red Hat 8.0 (You may compile the SCore source under the Red Hat 8.0)

          • Red Hat Advanced Workstation 2.1 (IA64)

        4. The OSCAR installation tool is used for IA64.

        5. The pmmyri kernel option is introduced.

          To use the GM driver of Myrinet in the distributed kernel, the pmmyri=0 option is specified at the boot time.

        6. The msgblock is introduced (actuall y come back).

        7. Performance Improvements

          • The PM/Myrinet bi-direction bandwidth performance is improved

          • MPICH/SCore tuned

          • The PM/Ethernet RMA tuned

        8. The SCORE_RSH environment variable is introduced so that you may specify an rsh command used in the rsh-all and rpmtest commands.

        9. The mkpmmyrinetconf is intro duced.

        10. The scare command is introduced for the xinetd environment.

        11. Contributions

          The contribution packages from members and others are included. You may get them from the /mnt/cdrom/score-5.4.0.contrib.tar.gz file.

          These contribution packages are as is, and the consortium does not support them.

          1. OpenPBS/SCore from Fujitsu Laboratories

          2. SGE/SCore, Sun Grid Engine, from NEC corporation

          3. Acebox and Icebox from Swimmy software, Inc.

          4. MPICH-G2/SCore from The National Institute of Advanced Industrial Science and Technology

          5. PXE boot from Streamline Computing

      2. Bug Fixes

        1. SCore does not work more than 128 hosts.

        2. The mpich 1.2.4 logviewer command does not have an execution right.

        3. The mpich 1.2.4 Fortran 90 library does not exist.

        4. PM/shmem does not work in IA64.

      3. Binaries

        1. MPICH 1.2.0/SCore and openPBS binaries are not distributed.

        2. MPICH libraries for Intel Compiler versions 6 and 7 are distributed.

      4. Limitations

        1. IA64 porting

          We have not tested the following features in an IA64 cluster:

          1. Checkpoint

          2. Omni OpenMP

          3. PBS

        2. The PM/Ethernet network trunking feature has been only tested on up to th ree Intel EEPRO100 NICs and up to two Syskonnect SK9843 NICs, Intel PRO1000/XT NICs and Broadcom BCM5701 baseed NICs. We already found that the feature does not wor k using some different NIC cards, e.g., the combination of tulip and 3C05B NICs.

        3. PVM is not fully tested.

        4. PVM does not work in an SMP cluster.

      5. Known Bugs
        1. EIT
          1. The modification of the display name in the network configuration window is not effective.

    9. SCore 5.2 (Released 2002/10/31)
      Attention:SCore 5.2 dose not have binary compatibility of SCore 5.0.1 or before.
      If you want to execute old SCore programs, please recompile them.
      1. New features in SCore 5.2

        1. Checkpoint facility is also available under the single user mode

        2. IA64 is supported

        3. RedHat 7.3 is supported

        4. The compiler description format is changed

        5. MPICH 1.2.4 is supported

        6. OpenPBS is supported

        7. SCore libraries for Intel, PGI, and Fujitsu comiplers are included

        8. The -l option of the sc_qsub command is available.

        9. EIT supports the e1000, bcm5700, and hamachi drivers. Those are Gigabit E thernet.

      2. Bug Fixes

        1. The previous EIT bug is fixed.

        2. The officialname command was not installed on compute host.

      3. Limitations

        1. IA64 porting

          We have not tested the following features in an IA64 cluster:

          1. Checkpoint

          2. Omni OpenMP

          3. PBS

        2. The PM/Ethernet network trunking feature has been only tested on up to th ree Intel EEPRO100 NICs and up to two Syskonnect SK9843 NICs, Intel PRO1000/XT NICs and Broadcom BCM5701 baseed NICs. We already found that the feature does not wor k using some different NIC cards, e.g., the combination of tulip and 3C05B NICs.

        3. PVM is not fully tested.

        4. PVM does not work in an SMP cluster.

      4. Known Bugs
        1. EIT
          1. The modification of the display name in the network configuration window is not effective.

    10. SCote 5.0.1 bug fixes from SCore 5.0 (Released at 2002/04/23)
      1. kernel
        1. kernel hangs to exec mandel on PM/Eternet
        2. PM/Ethernet don't work on RealTek Ethernet cards.
      2. SCore
        1. Wrong usage on /etc/rc.d/init.d/pbs* usage.
        2. Don't use mpif90 on Fujitsu compiler.
        3. scout fails if server host only FQDN hostname.
        4. On single user mode, scout done still scored don't done completely.
        5. RPM update replace /etc/profile.d/score.sh and score.csh.
      3. mpich
        1. jumpshot is not include in binary rpm.
        2. mpif90 dosen't work.
      4. doc
        1. bug fix rsh-all and scbcast description in Japanese man page.
      5. util
        1. rsh-all dosen't work with -i option.
      6. build
        1. make returns exit status 1.
    11. SCore 5.0 (Released at 2002/03/19)
      1. New features in SCore 5.0
        1. The copyright is transferred to the PC Cluster Consortium.

        2. SCore is now distributed under the LGPL license.

        3. Linux kernel 2.4.18 support (RedHat 7.2)

        4. No require of the scout command to run a user program in the single user environment
          A traditional command sequence is shown below: 
              $ scout -g pcc
    $ scrun ./a.out
    $ exit
          The above commands are equivalent to the following command. 
              $ scrun -group=pcc ./a.out

        5. A notation of the host group specification is enhanced
          Assume that the pcc1 group consists of host1, host2, host3, and host4 and the pcc2 group consists of hosta, hostb, hostc, and hostd.

          • -group=pcc1+pcc2
            In this example, all hosts of both pcc1 and pcc2 groups are used.

          • -group=pcc1~host2
            In this example, host1, host3, and host4 are used

          • -group=pcc1:2+pcc2:2
            In this example, host1, host2, hosta, and hostb are used

          • -group=pcc1@host3:2+pcc2:2
            In this example, host3, host4, hosta, and hostb are used

        6. The execution hosts may be defined in a file
              $ scrun -file=machines.LINUX ./a.out
          In the above example, the host list in the machines.LINUX file is used. An example of the machines.LINUX file is shown as follows: 
          host1
host2
host4

        7. The documents are reorganized

        8. The EIT easy installation tool
          • No temporal IP addresses for DHCP is required
          • More friendly GUI

      2. Bug Fixes
        1. A bug in 1 GB or larger physical main memory is fixed.
      3. Limitations
        1. The PM/Ethernet network trunking feature has been only tested on up to three Intel EEPRO100 NICs and up to two Syskonnect SK9843 NIC. We already found that the feature does not work using some different NIC cards, e.g., the combination of tulip and 3C05B NICs.
        2. PVM is not fully tested.
        3. PVM does not work in an SMP cluster.
      4. Known Bugs
        1. EIT
          1. The modification of the display name in the network configuration window is not effective.

          2. EIT will generate a wrong network format in the scorehosts.db file if
            • the cluster has more than one network and
            • all compute hosts do not have all networks
            In the following cluster configuration, for example,
            HostNetwork
            server.pccluster.orgEthernet
            comp0.pccluster.orgMyrinet and Ethernet
            comp1.pccluster.orgMyrinet and Ethernet
            If you configure a compute host group including server and compute hosts, EIT will generate a wrong network specification as follows: 
            server.pccluster.org  HOST_0 network=ethernet group=_scoreall_,pcc-server smp=1 MSGBSERV
comp0.pccluster.org  HOST_1 network=myrinet2k,ethernet group=_scoreall_,pcc-server,pcc smp=1 MSGBSERV
comp1.pccluster.org  HOST_2 network=myrinet2k,ethernet group=_scoreall_,pcc-server,pcc smp=1 MSGBSERV
            This should be as follows: 
            server.pccluster.org  HOST_0 network=ethernet group=_scoreall_,pcc-server smp=1 MSGBSERV
comp0.pccluster.org  HOST_1 network=ethernet,myrinet2k group=_scoreall_,pcc-server,pcc smp=1 MSGBSERV
comp1.pccluster.org  HOST_2 network=ethernet,myrinet2k group=_scoreall_,pcc-server,pcc smp=1 MSGBSERV
            However, be carefull that default network in the pcc group is ethernet, not myrinet2k !
  • SCore Cluster System Software Version 4
    1. SCore 4.2.1 (Released at 2001/11/13)
      1. Bug fixes in SCore 4.2.1
        1. PVM/SCore now works on PM/Ethernet
        2. Self checking of PM/Ethernet Network Trunking bug fix
        3. PM/SCI is now working
        4. PBS now works more than 512 node
        5. PM/Ethernet works using 3Com 3c590
        6. Installation document for installing from binary rpm and from source is added (English version only)
    2. SCore 4.2 (Released at 2001/10/17)
      1. New Features in SCore 4.2
        1. Linux Kernel 2.4.10 support (RedHat 7.1)
        2. Checkpoint/Restart supports disk parity to recover from one host crash
        3. MPE updated to mpich 1.2.1
        4. Basic benchmark programs are added
      2. Unsupported in SCore 4.2
        1. Compaq Alpha Processor is unsupported (untested)
        2. MPICH-SCore driver version 2.0 (ch-score2) is unsupported. Note that the default MPICH-SCore is version 1.0 (ch-score1). If you do not know version 2.0, do not worry about this information.
        3. PM/Agent/UDP is unsupported
    3. SCore 4.0 (Released at 2001/07/06)
      1. New Features in SCore 4.0
        1. License of SCore Cluster software is changed
        2. PVM-SCore, a PVM implementation on SCore, is available
        3. TACO, a C++ template library for topolofies and collections, is introduced
        4. PM test
          scstest is introduced
        5. Checking cluster host
          sceptic is introduced
        6. Scorehosts, rsh-all, kill-all, scout
          Host group specification is enhanced. Spare host specification is introduced
        7. SCore-D
          Session is implemented
      2. Unsupported in SCore 4.0
        1. SCOOP is unsupported
      3. Bugs Fixed in SCore 4.0
        1. SCore-D
          1. The bug of checking current working directory on cluster hosts is fixed
          2. The bug of limiting the number of jobs on a host is fixed

        2. PM/Myrinet for Myrinet 2000 with serial and fiber links (M3S-PCI64B and M3F-PCI64B)
          PM/Myrinet for Myrinet 2000 gets more stable. However Zero-copy message transfer is not stable yet. Myrinet 2000 with SAN link should be worked using myrinet network type and, can be used with both myrinet and myrinet2k network types.

          CAUTION: Myinet 2000 NICs with serial link, which delivered before the middle of April 2001, may cause severe CRC errors such as hundreds of CRC errors in one hour. So network stress test using rcstest should be processed, and checked using following command.
          # cat /proc/pm/myrinet/0/info

  • SCore Cluster System Software Version 3
    1. SCore 3.3.1 (Released at 2000/11/30)
      Because SCore 3.3 has a bug related to the SCore-D multi-user mode, SCore 3.3.1 is released. If you have the RWC Cluster Development Kit CD-ROM distributed at SC2000 or already downloaded the SCore 3.3 release, it is better to download patch files via the ftp site: score0.trc.rwcp.or.jp
    2. SCore 3.3 (Released at 2000/11/6)
      SCore 3.3 fixes bugs of SCore3.2 and improves SCore 3.2 performance. It also includes some new features.
      1. scrun command
        Some Unix signals including SIGINT is forwarded and broadcasted to all processes running on a cluster.
      2. sc_watch command
        Add retry max option.
    3. SCore 3.2 (Released at 2000/10/3)
      SCore 3.2 fixes bugs of SCore3.1 and improves SCore 3.1 performance and userbiliy. It also includes some new features.
      • Installation Tool
        Redhat6.2/i386 and Redhat6.2/alpha are supported.
      • Compilers Support
        The Fujitsu compilers for i386 are now supported.
      • New PM Devices
        • PM/agent, new PM/UDP implementation
        • PM/RHiNET
      • PM/Ethernet
        • Network trunking
          You benefit from multiple Ethernet cards.
        • VRead/VWrite facilities
      • PM/Myrinet
        Myrinet-2000, Lanai9, is supported
      • SCore-D
        • New Job Scheduling
        • sc_console
      • PBS
        Portable Batch System is ported to the SCore environment.
      • MPICH/SCore
        Optional C compiler support
      • MPICH/SCore version2
        SCore 3.2 has two versions of MPICH/SCore, versions 1 and 2.
      • Omni OpenMP Compiler for SCore
        An OpenMP program runs on your cluster. The OpenMP users can migrate from an SMP machine to a cluster without any program modifications.
    4. SCore 3.1 (Release at 2000/6/12)
      SCore 3.1 fixes bugs of SCore3.0 and improves SCore 3.0 performance and userbility. It also includes some new features.
      • MPICH-SCore
        Bugs related to the zerocopy function were fixed.
      • SCore-D
        • parallel job documents are included.
        • the checkpoint function under PM/Shmem and PM/Ethernet is now
        • available in addition to PM/Mrinet.
        • the Global clock function is available for PM/Myrinet.
        • sc_watch, watching the SCore-D activity and restarting it if no
        • response, is introduced.
        • Xauthority works in default.
        • fast scout setup.
      • PM/Myrinet
        64bit PCI Myrinet is more stable.
      • PM/Shmem
        more robust and fast.
      • PM/Ethernet
        more robust and fast.
      • Supported compiler
        Absoft Fortran 77 is now supported.
      • Others
        • the "scorecc" command is newly introduced to compile a C program written in the PM library and SCASH.
        • the mpc++ compiler has the -scash option to compile a program using SCASH.
    5. SCore 3.0 (Released at 2000/3/10)
      SCore 3.0 features
      • Single System Image
        Using the "scout" command, users are not aware whether or not a system is a cluster of single/multi-processor computers or a cluster of clusters. The user just sees it as if it were a single parallel computer.
      • Multiple Network Support
        The PM II API is a communication API for cluster computing. It hides the underling communication devices such as Myrinet, Gigabit/fast ethernet, etc. The current implementations of PM II are:
        • Shared memory,
        • Myrinet,
        • Ethernet, and
        • UDP/IP.
      • Seamless Programming Environment
        The "Hmake" command enables a user to compile a program on heterogeneous computers. It generates binaries for different underlying types of execution environments.
      • Heterogeneous Programming Language
        Programs using the MPC++ Multi-Threaded Template library run on an heterogeneous computer environment.
      • Multiple Programming Paradigms
        SCore supports:
        • Message Passing Programming Paradigm using PM and MPI.
        • Shared Memory Programming Paradigm using the SCASH software distributed shared memory system.
      • Parallel Programming Support
        The SCore-D global operating system contains the following programming support:
        • Real-time process activity monitor
        • Deadlock detection
        • Automatic debugger attachment
      • Fault Tolerance
        SCore-D supports the following fault tolerance capabilities:
        • preemptive checkpoint/restart
        • parallel process migration
      • Flexible Job Scheduling
        Both gang scheduling and batch scheduling are supported.

  • MPC++ Multi-Thread Template Library
    The MPC++ Multiple Thread Template Library on MPI is the MPC++ level 0 implementation on top the MPI library. It is a set of templates and classes to support multi-threaded local/remote function invocation, synchronization structure, global pointer, reduction, and barrier synchronization. We have tested the software on Sun SunOS4.X.X, Soralis, and Hitachi SR2201. To run other platforms, some hacking is required in this release. To obtain the software, please click by http or by ftp.

Future Release Information

  • MPC++ Version 2.0 Language System
    We are currently re-implementing the MPC++ language system for adapting to the version 2.0 metalevel architecture.

　

　

　
© Copyright 2001-2002, PC Cluster Consortium. All rights reserved.