Alcatel 7750SR QoS problem: only 60% load is supported

[pkiran]

Hi all,

I have the following topology for my network:

7750-1 -------------------- 7750-2
| |
7450-1 7450-2

Here, 7750-1 and 7750-2 are the two Service Routers with Alcatel 7750SR-1.
7750-1 and 7750-2 are the two Service switches with Alcatel 7750ESS-7. All the links are 10Gbps full-duplex links.

I have default network queue policy applied on all the ports. I'm sending 80% load (8Gbps full-duplex) from 7450-1 to 7450-2.

Now I'm observing that, the packets are getting dropped and the traffic is limited to 63% as shown below:

*A:7750-1# monitor port 1/1/1 rate

===============================================================================
Monitor statistics for Port 1/1/1
===============================================================================
Input Output
-------------------------------------------------------------------------------
-------------------------------------------------------------------------------
At time t = 0 sec (Base Statistics)
-------------------------------------------------------------------------------
Octets 10910510779 10826883713
Packets 10665125 10393560
Errors 0 0

-------------------------------------------------------------------------------
At time t = 10 sec (Mode: Rate)
-------------------------------------------------------------------------------
Octets 772434176 766734964
Packets 755074 736047
Errors 0 0
Utilization (% of port capacity) 63.00 62.51
------------------------

Here is my QoS settings:

*A:7750-1# show qos network-queue default detail

===============================================================================
QoS Network Queue Policy
===============================================================================
-------------------------------------------------------------------------------
Network Queue Policy (default)
-------------------------------------------------------------------------------
Policy : default
Description : Default network queue QoS policy.

-------------------------------------------------------------------------------
Queue CIR PIR CBS MBS HiPrio PIR Lvl/Wght AvgOvrhd Parent
CIR Rule PIR Rule CIR Lvl/Wght
Named-Buffer Pool
-------------------------------------------------------------------------------
1 0 100 def 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
2 25 100 3.00 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
3 25 100 10.00 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
4 25 100 3.00 25.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
5 100 100 10.00 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
6 100 100 10.00 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
7 10 100 3.00 25.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
8 10 100 3.00 25.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
9 0 100 def 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
10 5 100 def 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
11 5 100 def 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
12 5 100 def 25.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
13 100 100 def 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
14 100 100 def 50.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
15 10 100 def 25.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)
16 10 100 def 25.00 10 n/a 0.00 No
closest closest n/a
(not-assigned)

-------------------------------------------------------------------------------
FC UCastQ MCastQ
-------------------------------------------------------------------------------
be 1 9
l2 2 10
af 3 11
l1 4 12
h2 5 13
ef 6 14
h1 7 15
nc 8 16

-------------------------------------------------------------------------------
Associations
-------------------------------------------------------------------------------
MDA : 1/1
MDA : 1/2
Port-id : 1/1/1
Port-id : 1/1/2
Port-id : 1/1/3
Port-id : 1/1/4
Port-id : lag-1
Port-id : lag-2
===============================================================================

Here is my 7750-1 port 1/1/1 details:

*A:7750-1# show port 1/1/1 detail

===============================================================================
Ethernet Interface
===============================================================================
Description : 10-Gig Ethernet
Interface : 1/1/1 Oper Speed : 10 Gbps
Link-level : Ethernet Config Speed : N/A
Admin State : up Oper Duplex : full
Oper State : up Config Duplex : N/A
Physical Link : Yes MTU : 9212
Single Fiber Mode : No
IfIndex : 35684352 Hold time up : 0 seconds
Last State Change : 10/18/2009 08:39:17 Hold time down : 0 seconds
Last Cleared Time : 10/21/2009 04:05:59 DDM Events : Enabled

Configured Mode : network Encap Type : null
Dot1Q Ethertype : 0x8100 QinQ Ethertype : 0x8100
PBB Ethertype : 0x88e7
Ing. Pool % Rate : 100 Egr. Pool % Rate : 100
Ing. Pool Policy : n/a
Egr. Pool Policy : n/a
Net. Egr. Queue Pol: default
Egr. Sched. Pol : n/a
Auto-negotiate : N/A MDI/MDX : N/A
Accounting Policy : None Collect-stats : Disabled
Egress Rate : Default Ingress Rate : Default
Load-balance-algo : default LACP Tunnel : Disabled

Down-when-looped : Disabled Keep-alive : 10
Loop Detected : False Retry : 120

Sync. Status Msg. : Disabled Rx Quality Level : N/A

Configured Address : 00:21:05:7f:35:f0
Hardware Address : 00:21:05:7f:35:f0
Cfg Alarm : remote local
Alarm Status :

Transceiver Data

Transceiver Type : XFP
Model Number : 3HE00564AAAA01 ALA IPUIARRDAA
TX Laser Wavelength: 1310 nm Diag Capable : yes
Connector Code : LC Vendor OUI : 00:0a:1d
Manufacture date : 2009/05/22 Media : Ethernet
Serial Number : 953121A00655
Part Number : SXP3101LX-A8
Optical Compliance : 10GBASE-LR 10GBASE-LW
Link Length support: 10km for SMF

===============================================================================
Transceiver Digital Diagnostic Monitoring (DDM)
===============================================================================
Value High Alarm High Warn Low Warn Low Alarm
-------------------------------------------------------------------------------
Temperature (C) +40.9 +80.0 +75.0 -10.0 -15.0
Tx Bias Current (mA) 45.1 100.0 80.0 0.0 0.0
Tx Output Power (dBm) -2.26 2.00 0.00 -7.00 -9.00
Rx Optical Power (avg dBm) -3.57 2.50 1.50 -15.51 -40.00
Aux1: 3.3 Voltage (V) 3.22 3.63 3.46 3.13 2.97
===============================================================================

===============================================================================
Traffic Statistics
===============================================================================
Input Output
-------------------------------------------------------------------------------
Octets 101282473015 100537796147
Packets 99007280 96517754
Errors 0 0

===============================================================================
Ethernet Statistics
===============================================================================

Broadcast Pckts : 0 Drop Events : 0
Multicast Pckts : 319 CRC/Align Errors : 0
Undersize Pckts : 0 Fragments : 0
Oversize Pckts : 0 Jabbers : 0
Collisions : 0

Octets : 201820269162
Packets : 195525034
Packets of 64 Octets : 422
Packets of 65 to 127 Octets : 1963436
Packets of 128 to 255 Octets : 30834
Packets of 256 to 511 Octets : 572
Packets of 512 to 1023 Octets : 138659
Packets of 1024 to 1518 Octets : 193391112
Packets of 1519 or more Octets : 0
===============================================================================

===============================================================================
Port Statistics
===============================================================================
Input Output
-------------------------------------------------------------------------------
Unicast Packets 99766008 97258141
Multicast Packets 160 162
Broadcast Packets 0 0
Discards 0 0
Unknown Proto Discards 0
===============================================================================

===============================================================================
Ethernet-like Medium Statistics
===============================================================================

Alignment Errors : 0 Sngl Collisions : 0
FCS Errors : 0 Mult Collisions : 0
SQE Test Errors : 0 Late Collisions : 0
CSE : 0 Excess Collisns : 0
Too long Frames : 0 Int MAC Tx Errs : 0
Symbol Errors : 0 Int MAC Rx Errs : 0
===============================================================================

==============================================================================
Per Threshold MDA Discard Statistics
==============================================================================
Packets Octets
------------------------------------------------------------------------------
Threshold 0 Dropped : 0 0
Threshold 1 Dropped : 0 0
Threshold 2 Dropped : 0 0
Threshold 3 Dropped : 0 0
Threshold 4 Dropped : 0 0
Threshold 5 Dropped : 0 0
Threshold 6 Dropped : 0 0
Threshold 7 Dropped : 0 0
Threshold 8 Dropped : 0 0
Threshold 9 Dropped : 0 0
Threshold 10 Dropped : 0 0
Threshold 11 Dropped : 0 0
Threshold 12 Dropped : 0 0
Threshold 13 Dropped : 0 0
Threshold 14 Dropped : 0 0
Threshold 15 Dropped : 7773869 8100249130
==============================================================================

===============================================================================
Queue Statistics
===============================================================================

-------------------------------------------------------------------------------
Ingress Queue 1 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 85205101 88783563234
Out Profile dropped : 0 0
Ingress Queue 2 Packets Octets
In Profile forwarded : 5110820 3488079144
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 3 Packets Octets
In Profile forwarded : 55257 31672216
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 4 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 5 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 6 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 7 Packets Octets
In Profile forwarded : 80 6812
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 8 Packets Octets
In Profile forwarded : 155 10336
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 9 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 10 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 11 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 12 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 13 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 14 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 15 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Ingress Queue 16 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0

Egress Queue 1 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 93582340 97512532784
Out Profile dropped : 1129490 1176920952
Egress Queue 2 Packets Octets
In Profile forwarded : 1746192 1822430927
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Egress Queue 3 Packets Octets
In Profile forwarded : 151634 122551576
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Egress Queue 4 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Egress Queue 5 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Egress Queue 6 Packets Octets
In Profile forwarded : 0 0
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Egress Queue 7 Packets Octets
In Profile forwarded : 76 6184
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
Egress Queue 8 Packets Octets
In Profile forwarded : 516 50510
In Profile dropped : 0 0
Out Profile forwarded : 0 0
Out Profile dropped : 0 0
===============================================================================

Here are my questions:
(1) I can see Egress Queue 1 is dropping packets. How do I make sure that it won't drop any packets ?
(2) What is "Threshold 15 Dropped" under the show output of "per threshold MDA discard statistics" ?

Can someone, through some light on this?

Best Regards
Kiran