nxge 10gig ethernet very slow
in [Solaris]
|
Prev: EMC SymCLI - RBAC for symclone error: Access denied - you are not an authorized base daemon user
Next: Solaris 10 x86 installation problem
From: chriseas on 16 Jul 2008 12:52 We installed a PCIe nxge card in our V445 server a while back and simply cannot get it to run a a decent speed. It's connected to a HP ProCurve 8212zl. This morning I noticed that straight after a reboot it was reading from on of our NAS devices (with 10GbE) at about 70M/s. We then started another read from a gigabit attached workstation which transferred at around 4M/s. When this second copy kicked in the speed from the server dropped to around 20M/s. At the moment it is reading at these speeds: >iostat -XcnM 5 500 r/s w/s Mr/s Mw/s wait actv wsvc_t asvc_t %w %b device 741.9 0.0 22.4 0.0 0.1 3.5 0.1 4.8 4 79 silver:/ user_data 418.9 0.0 12.2 0.0 0.0 2.5 0.1 6.1 2 52 tin:/ user_data 548.2 0.0 16.5 0.0 0.0 2.9 0.1 5.3 3 80 woolly:/ user_data 172.2 0.0 4.7 0.0 0.0 3.5 0.1 20.2 1 83 malton:/ user_data2 silver and tin are Bluearc NAS devices attached with 10gig ehternet. wooly and malton are gigabit attached workstations. Before installing the 10gig card we had this on a quad-gig trunk and were seeing speeds of around 140meg/s, so I'm pretty sure that this is either the new network card or the switch causing the problem. The card in question is: http://www.sun.com/products/networking/ethernet/10gigethernet/ Only one of the ports is connected. The server is a V445 with an dual FC attached raid on it and all the latest patches. There doesn't seem to be much info on the net about these cards - I have searched and searched, does anybody have any ideas on what I can do? Thanks Chris
From: Rick Jones on 16 Jul 2008 15:55 Just for grins you might try running something that only does networking - like say netperf :) or something else and see what you get there. When you were using four gig interfaces, depending on how many cores you have you were probably getting interrupts from each on different CPUs/cores/whatevertheyarecalledtoday. You might want to see if you are getting interrupts spread-out from the 10G NIC or not. rick jones -- No need to believe in either side, or any side. There is no cause. There's only yourself. The belief is in your own precision. - Jobert these opinions are mine, all mine; HP might not want them anyway... :) feel free to post, OR email to rick.jones2 in hp.com but NOT BOTH...
From: Ian Collins on 16 Jul 2008 17:02 > > Before installing the 10gig card we had this on a quad-gig trunk and > were seeing speeds of around 140meg/s, so I'm pretty sure that this is > either the new network card or the switch causing the problem. > If you where only getting 140MB/S with a quad GigE trunk, why fit a 10 GigE card? -- Ian Collins.
From: John L on 17 Jul 2008 01:26 <chriseas(a)googlemail.com> wrote in message news:50efd92f-53f6-480b-a74e-de2aae9085c8(a)l64g2000hse.googlegroups.com... > > We installed a PCIe nxge card in our V445 server a while back and > simply cannot get it to run a a decent speed. A while back? Iirc there were a lot of problems with the nxge drivers (and workarounds which slowed performance) so it might be worth a visit to sunsolve to see if anything newer is available. -- John.
From: ndjilinski on 17 Jul 2008 22:37
try to have a look at netstat -i 1 (or -I int-name 1) - look at possible errors then - tail -f /var/adm/messages | grep nxge and - look at recent patches for nxge |