Cent OS 5.5 Catalyst 3750 Jumbo Frameのテスト
Hadoop Clusterを組む際に、Jumbo Frameが、有効かを調べてみたいと思い
設定をいれて、確認をおこないました。
SWは、Catalyst 3750を使用しました。
OSは、Linux(CentOS 5.5 (64bit))です。
ネットワークは、前回に書いたように、1GbpsをLACPで接続しています。
Catalyst 3750の設定確認
以下のマニュアルを参考にすると、GbEでは、9000まで有効にできるようです。
このページは移動しました。 - テクニカルサポート - Cisco Systems
設定後、確認してみます。
3750>show interfaces Port-channel 1 Load for five secs: 6%/0%; one minute: 6%; five minutes: 6% Time source is NTP, 18:34:58.390 JST Fri Dec 24 2010 Port-channel1 is up, line protocol is up (connected) Hardware is EtherChannel, address is xxxx.xxxx.xxxx (bia xxxx.xxxx.xxxx) Description: # To Hadoop-1# MTU 9000 bytes, BW 2000000 Kbit, DLY 10 usec, reliability 255/255, txload 1/255, rxload 1/255 Encapsulation ARPA, loopback not set Keepalive set (10 sec) Full-duplex, 1000Mb/s, link type is auto, media type is unknown input flow-control is off, output flow-control is unsupported Members in this channel: Gi1/0/1 Gi2/0/1 ARP type: ARPA, ARP Timeout 04:00:00 Last input never, output 00:00:00, output hang never Last clearing of "show interface" counters never Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0 Queueing strategy: fifo Output queue: 0/40 (size/max) 5 minute input rate 0 bits/sec, 0 packets/sec 5 minute output rate 0 bits/sec, 0 packets/sec 59 packets input, 7552 bytes, 0 no buffer Received 59 broadcasts (59 multicasts) 0 runts, 0 giants, 0 throttles 0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored 0 watchdog, 59 multicast, 0 pause input 0 input packets with dribble condition detected 688 packets output, 63368 bytes, 0 underruns 0 output errors, 0 collisions, 0 interface resets 0 babbles, 0 late collision, 0 deferred 0 lost carrier, 0 no carrier, 0 PAUSE output 0 output buffer failures, 0 output buffers swapped out
9000に、なっている事を、確認出来ました。
ethに、9000を設定して実行する
まずは、設定をします。
計る2台のサーバの両方ともに、設定をいれます。
[root@2 ~]# ifconfig bond0 mtu 9000 [root@2 ~]# ifconfig eth1 mtu 9000 [root@2 ~]# ifconfig eth2 mtu 9000 [root@2 ~]# ifconfig bond0 bond0 Link encap:Ethernet HWaddr F0:4D:A2:07:9C:4C inet addr:10.29.154.2 Bcast:10.29.154.255 Mask:255.255.255.0 inet6 addr: fe80::f24d:a2ff:fe07:9c4c/64 Scope:Link UP BROADCAST RUNNING MASTER MULTICAST MTU:9000 Metric:1 RX packets:4 errors:0 dropped:0 overruns:0 frame:0 TX packets:3 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:512 (512.0 b) TX bytes:384 (384.0 b) [root@2 ~]# ifconfig eth1 eth1 Link encap:Ethernet HWaddr F0:4D:A2:07:9C:4C UP BROADCAST RUNNING SLAVE MULTICAST MTU:9000 Metric:1 RX packets:2 errors:0 dropped:0 overruns:0 frame:0 TX packets:2 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:256 (256.0 b) TX bytes:256 (256.0 b) Interrupt:98 Memory:d8000000-d8012800 [root@2 ~]# ifconfig eth2 eth2 Link encap:Ethernet HWaddr F0:4D:A2:07:9C:4C UP BROADCAST RUNNING SLAVE MULTICAST MTU:9000 Metric:1 RX packets:2 errors:0 dropped:0 overruns:0 frame:0 TX packets:2 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:256 (256.0 b) TX bytes:256 (256.0 b) Interrupt:106 Memory:da000000-da012800
[root@3 ~]# ifconfig bond0 mtu 9000 [root@3 ~]# ifconfig eth1 mtu 9000 [root@3 ~]# ifconfig eth2 mtu 9000 [root@3 ~]# ifconfig bond0 bond0 Link encap:Ethernet HWaddr F0:4D:A2:07:88:93 inet addr:10.29.154.3 Bcast:10.29.154.255 Mask:255.255.255.0 inet6 addr: fe80::f24d:a2ff:fe07:8893/64 Scope:Link UP BROADCAST RUNNING MASTER MULTICAST MTU:9000 Metric:1 RX packets:1 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:128 (128.0 b) TX bytes:0 (0.0 b) [root@3 ~]# ifconfig eth1 eth1 Link encap:Ethernet HWaddr F0:4D:A2:07:88:93 UP BROADCAST RUNNING SLAVE MULTICAST MTU:9000 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:98 Memory:d8000000-d8012800 [root@3 ~]# ifconfig eth2 eth2 Link encap:Ethernet HWaddr F0:4D:A2:07:88:93 UP BROADCAST RUNNING SLAVE MULTICAST MTU:9000 Metric:1 RX packets:2 errors:0 dropped:0 overruns:0 frame:0 TX packets:1 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:256 (256.0 b) TX bytes:128 (128.0 b) Interrupt:106 Memory:da000000-da012800
netperfを使用して、速度を計測します。
[root@3 ~]# netperf -H 10.29.154.2 -l 60 -t TCP_STREAM -- -m 65535 TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.29.154.2 (10.29.154.2) port 0 AF_INET Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 87380 16384 65535 60.03 990.02
mtuを、1500に戻して、計測してみます。
[root@3 ~]# ifconfig bond0 mtu 1500 [root@3 ~]# ifconfig eth1 mtu 1500 [root@3 ~]# ifconfig eth2 mtu 1500 [root@3 ~]# ifconfig bond0 bond0 Link encap:Ethernet HWaddr F0:4D:A2:07:88:93 inet addr:10.29.154.3 Bcast:10.29.154.255 Mask:255.255.255.0 inet6 addr: fe80::f24d:a2ff:fe07:8893/64 Scope:Link UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1 RX packets:2 errors:0 dropped:0 overruns:0 frame:0 TX packets:2 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:256 (256.0 b) TX bytes:256 (256.0 b) [root@3 ~]# ifconfig eth1 eth1 Link encap:Ethernet HWaddr F0:4D:A2:07:88:93 UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1 RX packets:1 errors:0 dropped:0 overruns:0 frame:0 TX packets:1 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:128 (128.0 b) TX bytes:128 (128.0 b) Interrupt:98 Memory:d8000000-d8012800 [root@3 ~]# ifconfig eth2 eth2 Link encap:Ethernet HWaddr F0:4D:A2:07:88:93 UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1 RX packets:2 errors:0 dropped:0 overruns:0 frame:0 TX packets:1 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:256 (256.0 b) TX bytes:128 (128.0 b) Interrupt:106 Memory:da000000-da012800 [root@3 ~]# netperf -H 10.29.154.2 -l 60 -t TCP_STREAM -- -m 65535 TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.29.154.2 (10.29.154.2) port 0 AF_INET Recv Send Send Socket Socket Message Elapsed Size Size Size Time Throughput bytes bytes bytes secs. 10^6bits/sec 87380 16384 65535 60.03 941.42
結果
mtu 9000で、990Mbpsでています。1500では、941Mbpsなので、約、50Mbps増速した事になります。
今回は、netperfでの結果ですので、今後は、アプリケーションを使う中で、計測してみたいと思います。