Linux 2.6 Modifications


  1. Install Linux 2.6.11
    In this release, kernel patches for the Linux 2.6.11 are provided.

    1. When choosing the filesystems to create, we recommend creating a file system called /scored with a space of 1GB for checkpointing, and setting the access rights so all users are permitted access.
    2. The host name must be specified with a fully qualified domain name (FQDN).
      For example, server.pccluster.org, instead of just the host name server
  2. Add the PMv2 device drivers to the kernel
    SCore includes kernel PMv2 device drivers for Myrinet, 100Mbps and Gigabit Ethernet, and shared memory. Drivers except for PM/Ethernet must be statically linked into the kernel on all compute hosts.

    1. To create new kernel source code, issue the following commands:
      	# cd /usr/src
      	# tar vxzf linux2.6.11.tar.gz
      	# cd linux-2.6.11
      	# patch -p1 -s < linux2.6.11.score.patch
      
    2. To create a new configuration file for the kernel, execute the following:
      	# make menuconfig
      
      Then,

      1. Select the ``Device Drivers'' menu and ``SCore PM devices'' menu. You will find the following entries:

        SCore PM/Shmem (Shared Memory) support (NEW)
        SCore PM/Ethernet support (NEW)
        SCore PM/Ethernet-nkp drivers (w/o Kernel Patch) (NEW)
        SCore PM/Myrinet drivers (NEW)
        SCore PM/Memory (Common) drivers (NEW)

        Please select those drivers which are appropriate for your configuration, so that they are MODULE. To select a driver as a module driver, type the m key instead of typing the space key.

        If you select ``RWCP PM/Ethernet support (NEW)'', the following options will also be displayed:

        Interrupt-reaping
        Select ``Interrupt-reaping'' to increase PM/Ethernet make performance.

      2. Save the configuration, then exit menuconfig.

    3. To make a new kernel, perform the following:

      1. Issue the following commands to make and install a new kernel.
        	# cd /usr/src/linux
        	# make bzImage
        	# make modules
        	# make modules_install
        	# make install
        
        Make sure that there are no errors to install the new kernel.
      2. /etc/lilo.conf

        If you use lilo, edit the /etc/lilo.conf so that the SCore linux kernel is used. An example of the /etc/lilo.conf is shown below:

        boot=/dev/hda
        map=/boot/map
        install=/boot/boot.b
        prompt
        timeout=50
        message=/boot/message
        linear
        default=linux
        image=/boot/vmlinuz-2.6.11
                label=linux
                initrd=/boot/initrd-2.6.11.img
                read-only
                root=/dev/hda5
        

        Please don't delete the kernel that use currently for dose not work the SCore linux kernel.

        Then, please don't forget execute lilo command:

                # sync
                # lilo
        

      3. /boot/grub/grub.conf

        If you use grub, edit the /boot/grub/grub.conf so that the SCore linux kernel is used.

      4. Halt the system and install a Myrinet card, then reboot the system
        	# /sbin/reboot
        

        To make sure the PM drivers have been installed, issue the following command:

        	# dmesg | grep -i pm
        
        You will see several messages. e.g.,
        pm_memory:PM memory support
        pm_memory:Register pm_memory as major(123)
        pm_myrinet:Probe Myrinet rev 1
        pm_myrinet:Register pm_myrinet as major(121)
        pm_myrinet:[0]: clockval = 90479047, cpu = 403, delay = 0, board = 1, sram = 100000
        pm_myrinet:[0]: 30 contexts using 15360K bytes of memory
        PM/Ethernet: "$ Id: pm_ethernet_dev.c,v 1.14 2005/10/10 04:49:13 s-sumi Exp $"
        PM/Ethernet: register pm-ethernet device as major(122)
        pm-ethernet0: 16 contexts using 4096KB MEM, maxunit=4, maxnodes=512, mtu=1468, eth0.
        etherpm0: Interrupt Reaping on eth0, irq 0
        pm_shmem:pmshmem: version = $ Id: pm_shmem.c,v 1.4 2005/09/21 08:15:04 hori Exp $
        pm_shmem:pmshmem_init: register pm_shmem as major(124)
        
    Be sure that the above procedures are performed on all hosts so that a new kernel is installed on all hosts.


PCCC logo PC Cluster Consotium


CREDIT
This document is a part of the SCore cluster system software developed at PC Cluster Consortium, Japan. Copyright (C) 2003-2004 PC Cluster Consortium.