Standard Linux Modifications

  1. Install Linux 2.2.17
    In this release, kernel patches for the Linux 2.2.17 are provided.

    1. When choosing the filesystems to create, we recommend creating a file system called /scored with a space of 1GB for checkpointing.

    2. The host name must be specified with a fully qualified domain name (FQDN).
      For example, server.score.rwcp.or.jp, instead of just the host name server

  2. Add the PM-II device drivers to the kernel
    SCore includes kernel PM-II device drivers for Myrinet, 100Mbps and Gigabit Ethernet, and shared memory. Drivers except for PM/Ethernet must be statically linked into the kernel on all compute hosts.

    1. To create new kernel source code, issue the following commands:
      	# cd /usr/src/linux
      	# patch -p1 -s < /opt/score/work/linux.patch
      
    2. To create a new configuration file for the kernel, execute the following:
      	# make menuconfig
      
      Then,

      1. Select the ``Character devices'' menu. You will find the following entries:

        RWCP PM/Myrinet (Myricom Myrinet PCI) support (NEW)
        Page Coloring (NEW)
        RWCP PM/Ethernet support (NEW)
        RWCP PM/Shmem (Shared Memory) support (NEW)

        Please select those drivers which are appropriate for your configuration, so that they are STATICALLY linked into the kernel or, in other words, as a built-in driver. To select a driver as a built-in driver, type the y key instead of typing the space key.

        ``RWCP PM/Myrinet (Myricom Myrinet PCI) support (NEW)'' MUST be selected even though the machine may not have a Myrinet card. If you select ``RWCP PM/Myrinet (Myricom Myrinet PCI) support (NEW)'', the following option will also be displayed:

        RWCP OLD PM (Myricom Myrinet PCI) support (NEW)
        This option can be ignored.

        If you select ``RWCP PM/Ethernet support (NEW)'', the following options will also be displayed:

        Interrupt-reaping
        Select ``Interrupt-reaping'' to increase PM/Ethernet make performance.

        Be aware that ``RWCP PM/Myrinet (Myricom Myrinet PCI) support (NEW)'' MUST be selected even though the machine may not have a Myrinet card.

      2. Save the configuration, then exit menuconfig.

    3. To make a new kernel, perform the following:

      1. Issue the following commands to make and install a new kernel, and update the lilo database.
        	# insmod loop
        	# cd /usr/src/linux
        	# make dep clean
        	# make
        	# make modules
        	# make install
        	# make modules_install
        
        NOTE: The insmod loop command must be issued before installing the modules.

        Make sure that there are no errors to install the new kernel.

      2. Halt the system and install a Myrinet card, then reboot the system
        	# /sbin/halt
        
        If a Myrinet card has been installed, the following kernel messages will appear during the boot sequence:
        
        Myrinet 9 revison(1) bus(0) iobase(e7000000) irq(c) vmem(d0800000)
        Values depend on the version of the Myrinet card and the host system.

        To make sure the PM drivers have been installed, issue the following command:

        	# dmesg | grep -i pm
        
        You will see several messages. e.g.,
        PM memory support
        Register pm_memory as major(123)
        pm[0]: clockval = 90449044, cpu = 403, delay = 0, board = 1, sram = 100000
        pm[0]: 30 contexts using 3840K bytes of memory
        Register pm as major(121)
        PM/Ethernet: "$Id: pm_ethernet_dev.c,v 1.68 2001/02/24 12:48:14 s-sumi Exp$"
        PM/Ethernet: register etherpm device as major(122)
        pmshmem: version = $Id: pm_shmem.c,v 1.6 2000/09/25 12:42:28 kameyama Exp $
        pmshmem_init: register pm_shmem as major(124)
        etherpm0: 8 contexts using 2048K bytes of memory, maxunit=2, maxnodes=128.
        etherpm0: Interrupt Reaping on eth0, irq 10
        
    Be sure that the above procedures are performed on all hosts so that a new kernel is installed on all hosts.


Parallel and Distributed System Software Laboratory
Real World Computing Partnership
score-info@rwcp.or.jp

CREDIT
This document is a part of the SCore cluster system software developed at Real World Computing Partnership, Japan. Copyright (c) 2000, 1999 Real World Computing Partnership.