QFE Routing Abnormality

From: js (sellers@3sheep.com)
Date: Thu Oct 10 2002 - 11:04:27 EDT


Brief Description:

[Load Balancer A] [Load Balancer B]
        | |
      qfe0 qfe1
       ------[Sun 420]------

entire arp table

/captures# arp -a

Net to Media Table: IPv4
Device IP Address Mask Flags Phys Addr
------ -------------------- --------------- ----- ---------------
qfe0 192.168.35.1 255.255.255.255 00:10:58:03:c6:b0
qfe1 172.16.40.1 255.255.255.255 00:10:58:04:3d:6c
qfe1 10.37.18.185 255.255.255.255 00:10:58:04:3d:6c
qfe1 10.37.18.177 255.255.255.255 00:10:58:04:3d:6c
qfe1 10.37.18.169 255.255.255.255 00:10:58:04:3d:6c
qfe1 10.37.18.161 255.255.255.255 00:10:58:04:3d:6c
qfe0 10.37.18.153 255.255.255.255 00:10:58:03:c6:b0
qfe0 10.37.18.145 255.255.255.255 00:10:58:03:c6:b0
qfe0 10.37.18.137 255.255.255.255 00:10:58:03:c6:b0
qfe0 10.37.18.129 255.255.255.255 00:10:58:03:c6:b0
qfe0 192.168.35.3 255.255.255.255 SP 08:00:20:f3:cc:ac
qfe1 10.37.18.187 255.255.255.255 SP 08:00:20:f3:cc:ad
qfe1 10.37.18.179 255.255.255.255 SP 08:00:20:f3:cc:ad
qfe1 10.37.18.171 255.255.255.255 SP 08:00:20:f3:cc:ad
qfe1 172.16.40.3 255.255.255.255 SP 08:00:20:f3:cc:ad
qfe1 10.37.18.163 255.255.255.255 SP 08:00:20:f3:cc:ad
qfe0 10.37.18.155 255.255.255.255 SP 08:00:20:f3:cc:ac
qfe0 10.37.18.147 255.255.255.255 SP 08:00:20:f3:cc:ac
qfe0 10.37.18.139 255.255.255.255 SP 08:00:20:f3:cc:ac
qfe0 10.37.18.131 255.255.255.255 SP 08:00:20:f3:cc:ac
qfe1 BASE-ADDRESS.MCAST.NET 240.0.0.0 SM 01:00:5e:00:00:00
qfe0 BASE-ADDRESS.MCAST.NET 240.0.0.0 SM 01:00:5e:00:00:00

netstat -rn

10.37.18.152 10.37.18.155 U 1 22 qfe0:3
10.37.18.184 10.37.18.187 U 1 22 qfe1:3
192.168.35.0 192.168.35.3 U 1 22 qfe0:4
10.37.18.144 10.37.18.147 U 1 22 qfe0:2
10.37.18.176 10.37.18.179 U 1 22 qfe1:2
172.16.40.0 172.16.40.3 U 1 22 qfe1:4
10.37.18.136 10.37.18.139 U 1 21 qfe0:1
10.37.18.168 10.37.18.171 U 1 22 qfe1:1
10.37.18.128 10.37.18.131 U 1 21 qfe0
10.37.18.160 10.37.18.163 U 1 22 qfe1
default 10.37.18.129 UG 1 33
default 10.37.18.137 UG 1 33
default 10.37.18.145 UG 1 31
default 10.37.18.153 UG 1 33
default 10.37.18.161 UG 1 34
default 10.37.18.169 UG 1 29
default 10.37.18.177 UG 1 33
default 10.37.18.185 UG 1 34
default 192.168.35.1 UG 1 32
default 172.16.40.1 UG 1 32

The Loadbalancers are using NAT pools, thus if a packet goes into qfe0 the
response packets are expected to return out qfe. This works as tested
combinations of hme/dmfe/gem.

>From a packet sniff: (since the email is longwinded enough I'll paste
relevant details)

snoop on qfe0

ETHER: Destination = 8:0:20:f3:cc:ac, Sun
ETHER: Source = 0:10:58:3:c6:b0,
IP: Source address = 216.34.79.209, 216.34.79.209
IP: Destination address = 192.168.35.3, 192.168.35.3

return packet was found on qfe1:

ETHER: Destination = 0:10:58:4:3d:6c,
ETHER: Source = 8:0:20:f3:cc:ad, Sun
IP: Source address = 192.168.35.3, 192.168.35.3
IP: Destination address = 216.34.79.209, 216.34.79.209

The source address in the above capture is that of qfe0, not qfe1

Solaris 8
QFE patch rev: 108806-12.
Standard driver set. QFE Trunking software not installed
IPMP not turned on
IP Forwarding off on all interfaces
rdisc not being used.. routing information static in /etc/gateways

Ran out of ideas..

/js
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:25:05 EDT