[SCore-users-jp] Re: [SCore-users] Communication Performance with Score, with and without network trunking

[Shinji Sumimoto]

Hi.

Could you show the results of communication performance RTT and
bandwidth using rpmtest?

http://www.pccluster.org/score/dist/score/html/en/installation/pm-testethernet.html

RTT can be measured by combinations of "rpmtest -reply" and "rpmtest -ping".
Bandwidth can be measured by combinations of "rpmtest -sink" and "rpmtest -burst".

PS: How do you defined the e1000 device driver parameters on
    /etc/modprobe.conf?  The default parameters of the e1000 device
    driver is really bad for PM/Ethernet.

Thank you for using SCore and network trunking.

Shinji.

From: "Viet" <viet ＠ sowa.is.uec.ac.jp>
Subject: [SCore-users] Communication Performance with Score, with and without network trunking
Date: Wed, 12 Jul 2006 17:01:02 +0900
Message-ID: <000001c6a589$51961250$ca4315ac ＠ spc0608>

viet> Dear Users,
viet> 
viet> We have installed Score on a cluster of 2 nodes. We want to increase
viet> communication speed with network trunking with a dual port NIC.
viet> Howerver, we cannot get a good communication performance with Score.
viet> 
viet> Tested application: exchanging 16000 byte long messages between 2 nodes
viet> (in fact, we performed the experiments with several message sizes and
viet> show here only results of 16000 byte long, test result for other sizes
viet> are in a similar pattern: single port no Score > dual port channel
viet> bonding no Score > Score network trunking > Score single port)
viet> 
viet> Exchange bandwidth:
viet> 	without Score    + single port: 950 Mbps
viet> 			+ dual port, channel bonding (Linux, FC3): 610
viet> Mbps
viet> 	with Score	+ single port: 415 Mbps
viet> 			+ dual port:  430 Mbps
viet> 
viet> Do I have any mistake in Score configuration?
viet> 
viet> Hardware platform:
viet> + Dell PowerEdge 1850 
viet> + 2 Dual-core Intel Xeon 2.8GHz processors
viet> + 4 GB Memory
viet> + Intel PRO 1000 PT Dual Gigabit Ethernet Adapter (PCI-Express x4)
viet> + Fedora-core 3 for x86-64
viet> + Score installed by source
viet> + Hostnames: ypc0515.jp and ypc0516.jp, 
viet> + ypc0515 as server and compute host.
viet> 
viet> 
viet> Score configuration files are as follows:
viet> 1.scorehosts.db:
viet> /* PM/Ethernet */
viet> ethernet0		type=ethernet \
viet> 		-config:file=/opt/score/etc/pm-ethernet-0.conf
viet> ethernet1		type=ethernet \
viet> 		-config:file=/opt/score/etc/pm-ethernet-1.conf
viet> ethernet-x2	type=ethernet \
viet> 		-config:file=/opt/score/etc/pm-ethernet-1.conf \
viet> 		-trunk0:file=/opt/score/etc/pm-ethernet-0.conf
viet> shmem0		type=shmem -node=0
viet> shmem1		type=shmem -node=1
viet> shmem2		type=shmem -node=2
viet> shmem3		type=shmem -node=3
viet> 
viet> /*Macro to difine a host */
viet> #define PCC	msgbserv=(ypc0515.jp:8764) \
viet> 		cpugen=XeonEMT speed=2800 smp=4 \
viet> 		network=ethernet-x2,shmem0,shmem1,shmem2,shmem3 \
viet> 		group=pcc
viet> ypc0515.jp	PCC
viet> ypc0516.jp	PCC
viet> (for network trunking test, and network=ethernet0 for single port test)
viet> 
viet> 
viet> 2.pm-ethernet-0.conf:
viet> unit 0
viet> maxnsend 32
viet> backoff 1000
viet> checksum 0
viet> # PE 	MAC address		base hostname		# comment
viet> 0	00:0E:0C:B3:BD:90	ypc0515.jp	# ip=10.0.5.150 on eth0
viet> 1	00:0E:0C:B4:18:CA	ypc0516.jp	# ip=10.0.5.160 on eth0
viet> 
viet> 3.pm-ethernet-1.conf:
viet> unit 1
viet> maxnsend 32
viet> backoff 1000
viet> checksum 0
viet> # PE 	MAC address		base hostname		# comment
viet> 0	00:0E:0C:B3:BD:91	ypc0515.jp	# on eth1
viet> 1	00:0E:0C:B4:18:CB	ypc0516.jp	# on eth1
viet> 
viet> Thank you very much for your help.
viet> 
viet> Ta Quoc Viet
viet> 
viet> 
viet> _______________________________________________
viet> SCore-users mailing list
viet> SCore-users ＠ pccluster.org
viet> http://www.pccluster.org/mailman/listinfo/score-users
------
Shinji Sumimoto, Fujitsu Labs
_______________________________________________
SCore-users mailing list
SCore-users ＠ pccluster.org
http://www.pccluster.org/mailman/listinfo/score-users