Cent OS 5.5 Catalyst 3750 Jumbo Frameのテスト

Hadoop Clusterを組む際に、Jumbo Frameが、有効かを調べてみたいと思い
設定をいれて、確認をおこないました。

SWは、Catalyst 3750を使用しました。
OSは、LinuxCentOS 5.5 (64bit))です。
ネットワークは、前回に書いたように、1GbpsをLACPで接続しています。

Catalyst 3750の設定確認

以下のマニュアルを参考にすると、GbEでは、9000まで有効にできるようです。

このページは移動しました。 - テクニカルサポート - Cisco Systems

設定後、確認してみます。

3750>show interfaces Port-channel 1
Load for five secs: 6%/0%; one minute: 6%; five minutes: 6%
Time source is NTP, 18:34:58.390 JST Fri Dec 24 2010

Port-channel1 is up, line protocol is up (connected) 
  Hardware is EtherChannel, address is xxxx.xxxx.xxxx (bia xxxx.xxxx.xxxx)
  Description: # To  Hadoop-1#
  MTU 9000 bytes, BW 2000000 Kbit, DLY 10 usec, 
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 1000Mb/s, link type is auto, media type is unknown
  input flow-control is off, output flow-control is unsupported 
  Members in this channel: Gi1/0/1 Gi2/0/1 
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input never, output 00:00:00, output hang never
  Last clearing of "show interface" counters never
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     59 packets input, 7552 bytes, 0 no buffer
     Received 59 broadcasts (59 multicasts)
     0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
     0 watchdog, 59 multicast, 0 pause input
     0 input packets with dribble condition detected
     688 packets output, 63368 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier, 0 PAUSE output
     0 output buffer failures, 0 output buffers swapped out

9000に、なっている事を、確認出来ました。

ethに、9000を設定して実行する

まずは、設定をします。

計る2台のサーバの両方ともに、設定をいれます。

[root@2 ~]# ifconfig bond0 mtu 9000
[root@2 ~]# ifconfig eth1 mtu 9000
[root@2 ~]# ifconfig eth2 mtu 9000
[root@2 ~]# ifconfig bond0
bond0     Link encap:Ethernet  HWaddr F0:4D:A2:07:9C:4C  
          inet addr:10.29.154.2  Bcast:10.29.154.255  Mask:255.255.255.0
          inet6 addr: fe80::f24d:a2ff:fe07:9c4c/64 Scope:Link
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:9000  Metric:1
          RX packets:4 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:512 (512.0 b)  TX bytes:384 (384.0 b)

[root@2 ~]# ifconfig eth1
eth1      Link encap:Ethernet  HWaddr F0:4D:A2:07:9C:4C  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:9000  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:256 (256.0 b)  TX bytes:256 (256.0 b)
          Interrupt:98 Memory:d8000000-d8012800 

[root@2 ~]# ifconfig eth2
eth2      Link encap:Ethernet  HWaddr F0:4D:A2:07:9C:4C  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:9000  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:256 (256.0 b)  TX bytes:256 (256.0 b)
          Interrupt:106 Memory:da000000-da012800 
[root@3 ~]# ifconfig bond0 mtu 9000
[root@3 ~]# ifconfig eth1 mtu 9000
[root@3 ~]# ifconfig eth2 mtu 9000
[root@3 ~]# ifconfig bond0
bond0     Link encap:Ethernet  HWaddr F0:4D:A2:07:88:93  
          inet addr:10.29.154.3  Bcast:10.29.154.255  Mask:255.255.255.0
          inet6 addr: fe80::f24d:a2ff:fe07:8893/64 Scope:Link
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:9000  Metric:1
          RX packets:1 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:128 (128.0 b)  TX bytes:0 (0.0 b)

[root@3 ~]# ifconfig eth1
eth1      Link encap:Ethernet  HWaddr F0:4D:A2:07:88:93  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:9000  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:0 (0.0 b)  TX bytes:0 (0.0 b)
          Interrupt:98 Memory:d8000000-d8012800 

[root@3 ~]# ifconfig eth2
eth2      Link encap:Ethernet  HWaddr F0:4D:A2:07:88:93  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:9000  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:256 (256.0 b)  TX bytes:128 (128.0 b)
          Interrupt:106 Memory:da000000-da012800 

netperfを使用して、速度を計測します。

[root@3 ~]# netperf -H 10.29.154.2 -l 60 -t TCP_STREAM -- -m 65535
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.29.154.2 (10.29.154.2) port 0 AF_INET
Recv   Send    Send                          
Socket Socket  Message  Elapsed              
Size   Size    Size     Time     Throughput  
bytes  bytes   bytes    secs.    10^6bits/sec  

 87380  16384  65535    60.03     990.02   

mtuを、1500に戻して、計測してみます。

[root@3 ~]# ifconfig bond0 mtu 1500
[root@3 ~]# ifconfig eth1 mtu 1500
[root@3 ~]# ifconfig eth2 mtu 1500
[root@3 ~]# ifconfig bond0
bond0     Link encap:Ethernet  HWaddr F0:4D:A2:07:88:93  
          inet addr:10.29.154.3  Bcast:10.29.154.255  Mask:255.255.255.0
          inet6 addr: fe80::f24d:a2ff:fe07:8893/64 Scope:Link
          UP BROADCAST RUNNING MASTER MULTICAST  MTU:1500  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:256 (256.0 b)  TX bytes:256 (256.0 b)

[root@3 ~]# ifconfig eth1
eth1      Link encap:Ethernet  HWaddr F0:4D:A2:07:88:93  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:1 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:128 (128.0 b)  TX bytes:128 (128.0 b)
          Interrupt:98 Memory:d8000000-d8012800 

[root@3 ~]# ifconfig eth2
eth2      Link encap:Ethernet  HWaddr F0:4D:A2:07:88:93  
          UP BROADCAST RUNNING SLAVE MULTICAST  MTU:1500  Metric:1
          RX packets:2 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:256 (256.0 b)  TX bytes:128 (128.0 b)
          Interrupt:106 Memory:da000000-da012800 

[root@3 ~]# netperf -H 10.29.154.2 -l 60 -t TCP_STREAM -- -m 65535
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 10.29.154.2 (10.29.154.2) port 0 AF_INET
Recv   Send    Send                          
Socket Socket  Message  Elapsed              
Size   Size    Size     Time     Throughput  
bytes  bytes   bytes    secs.    10^6bits/sec  

 87380  16384  65535    60.03     941.42   

結果

mtu 9000で、990Mbpsでています。1500では、941Mbpsなので、約、50Mbps増速した事になります。

今回は、netperfでの結果ですので、今後は、アプリケーションを使う中で、計測してみたいと思います。