[SCore-users-jp] Re: [SCore-users] Communication Performance with Score, with and without network trunking

[Shinji Sumimoto]

Dear Viet.

From: "Viet" <viet ＠ sowa.is.uec.ac.jp>
Subject: RE: [SCore-users] Communication Performance with Score, with and without network trunking
Date: Thu, 13 Jul 2006 19:29:33 +0900
Message-ID: <000001c6a667$3b2ec140$ca4315ac ＠ spc0608>

viet> Dear Shinji Sumimoto Sensei,
viet> 
viet> >options e1000 TxIntDelay=0,0 TxAbsIntDelay=0,0  RxIntDelay=0,0 
viet> >RxAbsIntDelay=0,0 InterruptThrottleRate=0,0 
viet> >TxDescriptors=512,512 RxDescriptors=512,512 
viet> 
viet> I added that line into modprobe.conf before the line "alias eth0 e1000"
viet> and reboot the system.

Usually, the options are added to after "alias eth1 e1000".

viet> Hereunder is the result with network trunking (ethernet-x2):
viet> 
viet> Before reboot (without changing modprobe.conf)
viet> + rpmtest -ping		8	0.00102167
viet> + rpmtest -burst		8	100660
viet>      (-len 1400)		1400	1.75823 e+07 (is it bit per
viet> second? If yes, this is really a good bandwidth for dual Gigabit ports)
viet> 
viet> After reboot:
viet> + rpmtest -ping		8	0.00101375 (still too bad)
viet> + rpmtest -burst		8	213129 (better)
viet>      (-len 1400)		1400	1.74813 e+07
viet> 
viet> And I still cannot get good communication performance with my own
viet> application.

It seems that the option is not able to take effect.

When  the options take effect, following messages are output to syslog
or dmesg command output.

========================================================================
e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
ACPI: PCI Interrupt 0000:06:01.1[B] -> GSI 73 (level, low) -> IRQ 50
e1000: 0000:00:01.1: e1000_validate_option: Transmit Descriptors set to 512
e1000: 0000:00:01.1: e1000_validate_option: Receive Descriptors set to 512
e1000: 0000:00:01.1: e1000_validate_option: Transmit Interrupt Delay set to 256
e1000: 0000:00:01.1: e1000_validate_option: Transmit Absolute Interrupt Delay set to 256
e1000: 0000:00:01.1: e1000_validate_option: Receive Interrupt Delay set to 0
e1000: 0000:00:01.1: e1000_validate_option: Receive Absolute Interrupt Delay set to 10
e1000: 0000:00:01.1: e1000_check_options: Interrupt Throttling Rate (ints/sec) turned off
========================================================================

Can you see the messages?

viet> One more question, please. With Score MPICH, a large message (say, 2200
viet> double, i.e. 2200x8 bye length) cannot be sent with MPI_Send (blocking
viet> send). I tried to set P4_GLOBMEMSIZE variable to a large value but it
viet> does not work. Could you please give some advice.

There is no limitation that only 16KB message.

Shinji.

viet> Viet
viet> 
viet> 
viet> 
viet> _______________________________________________
viet> SCore-users mailing list
viet> SCore-users ＠ pccluster.org
viet> http://www.pccluster.org/mailman/listinfo/score-users
------
Shinji Sumimoto, Fujitsu Labs
_______________________________________________
SCore-users mailing list
SCore-users ＠ pccluster.org
http://www.pccluster.org/mailman/listinfo/score-users