Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Quagga: Users

getting google-is-is to run

 

 

Quagga users RSS feed   Index | Next | Previous | View Threaded


hristo.s.asenov at gmail

May 13, 2012, 9:48 PM

Post #1 of 8 (876 views)
Permalink
getting google-is-is to run

Hello,

I cannot get isisd to run with zebra. If I start up an instance on one node, it will stay up but as soon as I start up another neighboring node with isis, the original node aborts with an assertion failure. I am using the latest cloned version from git (after 0.99.21 release). Here is a the run with the assertion failure:

bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i /var/run/quagga/isisd.pid
2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN IIH from eth1

2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id, vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function isis_spf_add2tent
2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
2012/05/08 17:52:42 ISIS: [bt 0] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f) [0xb782707a]
2012/05/08 17:52:42 ISIS: [bt 1] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92) [0xb78271dd]
2012/05/08 17:52:42 ISIS: [bt 2] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7) [0xb7884bf7]
2012/05/08 17:52:42 ISIS: [bt 3] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f) [0xb7884e9f]
2012/05/08 17:52:42 ISIS: [bt 4] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3) [0xb78857d3]
2012/05/08 17:52:42 ISIS: [bt 5] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03) [0xb786cb03]
2012/05/08 17:52:42 ISIS: [bt 6] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c) [0xb786cb3c]
2012/05/08 17:52:42 ISIS: [bt 7] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec) [0xb78704ec]
2012/05/08 17:52:42 ISIS: [bt 8] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc) [0xb78708cc]
2012/05/08 17:52:42 ISIS: [bt 9] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d) [0xb788328d]
2012/05/08 17:52:42 ISIS: [bt 10] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d) [0xb786c19d]
2012/05/08 17:52:42 ISIS: [bt 11] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a) [0xb787778a]
2012/05/08 17:52:42 ISIS: [bt 12] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3) [0xb787a9b3]
2012/05/08 17:52:42 ISIS: [bt 13] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b) [0xb781ad50]
2012/05/08 17:52:42 ISIS: [bt 14] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c) [0xb786b4cb]
2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7) [0xb767bce7]
2012/05/08 17:52:42 ISIS: [bt 16] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51) [0xb786af51]
Abort
And here is my config:

hostname isisd
password foo
enable password foo
log stdout
!
interface eth0
!
interface eth1
ip router isis Test1
isis circuit-type level-1
!
interface eth2
! ip router isis Test1
! isis circuit-type level-1
!
interface eth3
!
interface lo
!
router isis Test1
net 51.0000.0000.0116.00
metric-style wide
is-type level-1
!
line vty
!
- Hristo


nick at buraglio

May 14, 2012, 8:22 AM

Post #2 of 8 (826 views)
Permalink
Re: getting google-is-is to run [In reply to]

I've seen strange behaviors with the original isisd (non-google) when
the adjacent side is configured with point-to-point. Basically, when
configured as such (since the quagga isisd doesn't seem to have a
point-to-point mode), the quagga isisd will die as soon as the
adjacency comes up.
I don't recall the exact failure code, but the behavior sounds
similar. Possibly related, possibly not, but it's extremely annoying
since point-to-point mode is what I'd really like to run in those
cases.
I have yet to test out the google isisd, but it's on the short list.
nb


On Sun, May 13, 2012 at 11:48 PM, Hristo Asenov
<hristo.s.asenov [at] gmail> wrote:
> Hello,
>
> I cannot get isisd to run with zebra. If I start up an instance on one node,
> it will stay up but as soon as I start up another neighboring node with
> isis, the original node aborts with an assertion failure. I am using the
> latest cloned version from git (after 0.99.21 release). Here is a the run
> with the assertion failure:
>
> bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i
> /var/run/quagga/isisd.pid
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
> 2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN
> IIH from eth1
>
> 2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id,
> vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function
> isis_spf_add2tent
> 2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
> 2012/05/08 17:52:42 ISIS: [bt 0]
> /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f)
> [0xb782707a]
> 2012/05/08 17:52:42 ISIS: [bt 1]
> /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92)
> [0xb78271dd]
> 2012/05/08 17:52:42 ISIS: [bt 2]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7)
> [0xb7884bf7]
> 2012/05/08 17:52:42 ISIS: [bt 3]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f)
> [0xb7884e9f]
> 2012/05/08 17:52:42 ISIS: [bt 4]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3)
> [0xb78857d3]
> 2012/05/08 17:52:42 ISIS: [bt 5]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03)
> [0xb786cb03]
> 2012/05/08 17:52:42 ISIS: [bt 6]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c)
> [0xb786cb3c]
> 2012/05/08 17:52:42 ISIS: [bt 7]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec)
> [0xb78704ec]
> 2012/05/08 17:52:42 ISIS: [bt 8]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc)
> [0xb78708cc]
> 2012/05/08 17:52:42 ISIS: [bt 9]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d)
> [0xb788328d]
> 2012/05/08 17:52:42 ISIS: [bt 10]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d)
> [0xb786c19d]
> 2012/05/08 17:52:42 ISIS: [bt 11]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a)
> [0xb787778a]
> 2012/05/08 17:52:42 ISIS: [bt 12]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3)
> [0xb787a9b3]
> 2012/05/08 17:52:42 ISIS: [bt 13]
> /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b)
> [0xb781ad50]
> 2012/05/08 17:52:42 ISIS: [bt 14]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c)
> [0xb786b4cb]
> 2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7)
> [0xb767bce7]
> 2012/05/08 17:52:42 ISIS: [bt 16]
> /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51)
> [0xb786af51]
> Abort
>
> And here is my config:
>
> hostname isisd
> password foo
> enable password foo
> log stdout
> !
> interface eth0
> !
> interface eth1
> ip router isis Test1
> isis circuit-type level-1
> !
> interface eth2
> ! ip router isis Test1
> ! isis circuit-type level-1
> !
> interface eth3
> !
> interface lo
> !
> router isis Test1
> net 51.0000.0000.0116.00
> metric-style wide
> is-type level-1
> !
> line vty
> !
>
> - Hristo
>
> _______________________________________________
> Quagga-users mailing list
> Quagga-users [at] lists
> http://lists.quagga.net/mailman/listinfo/quagga-users
>
_______________________________________________
Quagga-users mailing list
Quagga-users [at] lists
http://lists.quagga.net/mailman/listinfo/quagga-users


mwinter at opensourcerouting

May 14, 2012, 6:17 PM

Post #3 of 8 (821 views)
Permalink
Re: getting google-is-is to run [In reply to]

Hristo,

I would be careful at this time with the ISIS. We (at OpenSourceRouting) are working on many bugs trying to get it into a better shape. As of today, I would wait a bit. I have a long list of crashes and we try to clean it up a bit to get it into a useable shape for the next version.
I think the release message made it clear that ISIS isn't yet ready for use in 0.99.21

For a list of compliance errors we found, see
http://opensourcerouting.org/wiki/ANVL+ISIS+Results
(look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)

For a list of errors found with the protocol fuzzer (these are mostly crashes), see:
http://opensourcerouting.org/wiki/MU+ISIS+L1+Results
(look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)

"OSR-TESTPOINT-20120430" is actually a label in our git (git://github.com/opensourcerouting/quagga)
(there are some fixes in a separate branch already on our github for a few ISIS crashes. But most of them still in verification. They will be all committed to the mainline once we know they are good. [which should be in days/weeks] )

Regards,
Martin Winter

PS: The crash you've seen (assert in isis_find_vertex) is not on my list. If you are able to give me more details (ie configuration and what's on the other side, topology etc), then please let me know.

On May 13, 2012, at 9:48 PM, Hristo Asenov wrote:

> Hello,
>
> I cannot get isisd to run with zebra. If I start up an instance on one node, it will stay up but as soon as I start up another neighboring node with isis, the original node aborts with an assertion failure. I am using the latest cloned version from git (after 0.99.21 release). Here is a the run with the assertion failure:
>
> bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i /var/run/quagga/isisd.pid
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
> 2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
> 2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN IIH from eth1
>
> 2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id, vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function isis_spf_add2tent
> 2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
> 2012/05/08 17:52:42 ISIS: [bt 0] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f) [0xb782707a]
> 2012/05/08 17:52:42 ISIS: [bt 1] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92) [0xb78271dd]
> 2012/05/08 17:52:42 ISIS: [bt 2] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7) [0xb7884bf7]
> 2012/05/08 17:52:42 ISIS: [bt 3] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f) [0xb7884e9f]
> 2012/05/08 17:52:42 ISIS: [bt 4] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3) [0xb78857d3]
> 2012/05/08 17:52:42 ISIS: [bt 5] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03) [0xb786cb03]
> 2012/05/08 17:52:42 ISIS: [bt 6] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c) [0xb786cb3c]
> 2012/05/08 17:52:42 ISIS: [bt 7] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec) [0xb78704ec]
> 2012/05/08 17:52:42 ISIS: [bt 8] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc) [0xb78708cc]
> 2012/05/08 17:52:42 ISIS: [bt 9] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d) [0xb788328d]
> 2012/05/08 17:52:42 ISIS: [bt 10] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d) [0xb786c19d]
> 2012/05/08 17:52:42 ISIS: [bt 11] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a) [0xb787778a]
> 2012/05/08 17:52:42 ISIS: [bt 12] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3) [0xb787a9b3]
> 2012/05/08 17:52:42 ISIS: [bt 13] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b) [0xb781ad50]
> 2012/05/08 17:52:42 ISIS: [bt 14] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c) [0xb786b4cb]
> 2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7) [0xb767bce7]
> 2012/05/08 17:52:42 ISIS: [bt 16] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51) [0xb786af51]
> Abort
>
> And here is my config:
>
> hostname isisd
> password foo
> enable password foo
> log stdout
> !
> interface eth0
> !
> interface eth1
> ip router isis Test1
> isis circuit-type level-1
> !
> interface eth2
> ! ip router isis Test1
> ! isis circuit-type level-1
> !
> interface eth3
> !
> interface lo
> !
> router isis Test1
> net 51.0000.0000.0116.00
> metric-style wide
> is-type level-1
> !
> line vty
> !
>
> - Hristo
> _______________________________________________
> Quagga-users mailing list
> Quagga-users [at] lists
> http://lists.quagga.net/mailman/listinfo/quagga-users


_______________________________________________
Quagga-users mailing list
Quagga-users [at] lists
http://lists.quagga.net/mailman/listinfo/quagga-users


hristo.s.asenov at gmail

May 14, 2012, 8:00 PM

Post #4 of 8 (818 views)
Permalink
Re: getting google-is-is to run [In reply to]

Martin, can I try to run the separate branch you guys made for a few ISIS fixes? Maybe it somehow may change the behavior of crash I am getting.

To be more precise, the configuration we are running is on a LAN with Ubuntu VM images, however we have only two addresses per subnet, so we are using the links as if they were point-to-point but are using Ethernet protocol. It is something like

host_01 (eth1: 10.100.2.1) <-------------> (eth1: 10.100.2.2) host_02

where eth1 on both interfaces is under the subnet 10.100.2.0/30 and they are connected to out-of-band network so we can control them remotely.

I ran the code with EXTREME_DEBUG enabled and debugging of adjacency packets enabled one more time. Here is the output I got: http://pastebin.ca/2148465. Also the stack trace from gdb: http://pastebin.ca/2148471. These are the configs we use for zebra: http://pastebin.ca/2148473. Let me know if there is more information I could provide. Thanks,

- Hristo

On May 14, 2012, at 9:17 PM, Martin Winter wrote:

> Hristo,
>
> I would be careful at this time with the ISIS. We (at OpenSourceRouting) are working on many bugs trying to get it into a better shape. As of today, I would wait a bit. I have a long list of crashes and we try to clean it up a bit to get it into a useable shape for the next version.
> I think the release message made it clear that ISIS isn't yet ready for use in 0.99.21
>
> For a list of compliance errors we found, see
> http://opensourcerouting.org/wiki/ANVL+ISIS+Results
> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>
> For a list of errors found with the protocol fuzzer (these are mostly crashes), see:
> http://opensourcerouting.org/wiki/MU+ISIS+L1+Results
> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>
> "OSR-TESTPOINT-20120430" is actually a label in our git (git://github.com/opensourcerouting/quagga)
> (there are some fixes in a separate branch already on our github for a few ISIS crashes. But most of them still in verification. They will be all committed to the mainline once we know they are good. [which should be in days/weeks] )
>
> Regards,
> Martin Winter
>
> PS: The crash you've seen (assert in isis_find_vertex) is not on my list. If you are able to give me more details (ie configuration and what's on the other side, topology etc), then please let me know.
>
> On May 13, 2012, at 9:48 PM, Hristo Asenov wrote:
>
>> Hello,
>>
>> I cannot get isisd to run with zebra. If I start up an instance on one node, it will stay up but as soon as I start up another neighboring node with isis, the original node aborts with an assertion failure. I am using the latest cloned version from git (after 0.99.21 release). Here is a the run with the assertion failure:
>>
>> bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i /var/run/quagga/isisd.pid
>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>> 2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
>> 2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>> 2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>> 2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>> 2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN IIH from eth1
>>
>> 2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id, vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function isis_spf_add2tent
>> 2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
>> 2012/05/08 17:52:42 ISIS: [bt 0] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f) [0xb782707a]
>> 2012/05/08 17:52:42 ISIS: [bt 1] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92) [0xb78271dd]
>> 2012/05/08 17:52:42 ISIS: [bt 2] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7) [0xb7884bf7]
>> 2012/05/08 17:52:42 ISIS: [bt 3] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f) [0xb7884e9f]
>> 2012/05/08 17:52:42 ISIS: [bt 4] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3) [0xb78857d3]
>> 2012/05/08 17:52:42 ISIS: [bt 5] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03) [0xb786cb03]
>> 2012/05/08 17:52:42 ISIS: [bt 6] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c) [0xb786cb3c]
>> 2012/05/08 17:52:42 ISIS: [bt 7] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec) [0xb78704ec]
>> 2012/05/08 17:52:42 ISIS: [bt 8] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc) [0xb78708cc]
>> 2012/05/08 17:52:42 ISIS: [bt 9] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d) [0xb788328d]
>> 2012/05/08 17:52:42 ISIS: [bt 10] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d) [0xb786c19d]
>> 2012/05/08 17:52:42 ISIS: [bt 11] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a) [0xb787778a]
>> 2012/05/08 17:52:42 ISIS: [bt 12] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3) [0xb787a9b3]
>> 2012/05/08 17:52:42 ISIS: [bt 13] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b) [0xb781ad50]
>> 2012/05/08 17:52:42 ISIS: [bt 14] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c) [0xb786b4cb]
>> 2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7) [0xb767bce7]
>> 2012/05/08 17:52:42 ISIS: [bt 16] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51) [0xb786af51]
>> Abort
>>
>> And here is my config:
>>
>> hostname isisd
>> password foo
>> enable password foo
>> log stdout
>> !
>> interface eth0
>> !
>> interface eth1
>> ip router isis Test1
>> isis circuit-type level-1
>> !
>> interface eth2
>> ! ip router isis Test1
>> ! isis circuit-type level-1
>> !
>> interface eth3
>> !
>> interface lo
>> !
>> router isis Test1
>> net 51.0000.0000.0116.00
>> metric-style wide
>> is-type level-1
>> !
>> line vty
>> !
>>
>> - Hristo
>> _______________________________________________
>> Quagga-users mailing list
>> Quagga-users [at] lists
>> http://lists.quagga.net/mailman/listinfo/quagga-users
>


mwinter at opensourcerouting

May 15, 2012, 12:18 AM

Post #5 of 8 (822 views)
Permalink
Re: getting google-is-is to run [In reply to]

Hristo,

On May 14, 2012, at 8:00 PM, Hristo Asenov wrote:

> Martin, can I try to run the separate branch you guys made for a few ISIS fixes? Maybe it somehow may change the behavior of crash I am getting.

Feel free to try, but keep in mind that things may be even more broken (or fixed). Code is public on Github as mentioned before. However if you can wait a few days, then you may be better off - I'm in the process to test the fixes (and then move on to the next bugs - many more to work on).

> To be more precise, the configuration we are running is on a LAN with Ubuntu VM images, however we have only two addresses per subnet, so we are using the links as if they were point-to-point but are using Ethernet protocol. It is something like
>
> host_01 (eth1: 10.100.2.1) <-------------> (eth1: 10.100.2.2) host_02
>
> where eth1 on both interfaces is under the subnet 10.100.2.0/30 and they are connected to out-of-band network so we can control them remotely.
>
> I ran the code with EXTREME_DEBUG enabled and debugging of adjacency packets enabled one more time. Here is the output I got: http://pastebin.ca/2148465. Also the stack trace from gdb: http://pastebin.ca/2148471. These are the configs we use for zebra: http://pastebin.ca/2148473. Let me know if there is more information I could provide. Thanks,

I've looked at the pastbin's but I can't see the ISIS config. Only the Interface config (zebra config) and only one side. Are you using the same Quagga on both sides? If yes, can you give me the full Quagga config? Or let me know what's on the other side (with the config).

Does the crash happen immediately when the neighbors are built or some time later (triggered by some change?)

- Martin

> On May 14, 2012, at 9:17 PM, Martin Winter wrote:
>
>> Hristo,
>>
>> I would be careful at this time with the ISIS. We (at OpenSourceRouting) are working on many bugs trying to get it into a better shape. As of today, I would wait a bit. I have a long list of crashes and we try to clean it up a bit to get it into a useable shape for the next version.
>> I think the release message made it clear that ISIS isn't yet ready for use in 0.99.21
>>
>> For a list of compliance errors we found, see
>> http://opensourcerouting.org/wiki/ANVL+ISIS+Results
>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>
>> For a list of errors found with the protocol fuzzer (these are mostly crashes), see:
>> http://opensourcerouting.org/wiki/MU+ISIS+L1+Results
>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>
>> "OSR-TESTPOINT-20120430" is actually a label in our git (git://github.com/opensourcerouting/quagga)
>> (there are some fixes in a separate branch already on our github for a few ISIS crashes. But most of them still in verification. They will be all committed to the mainline once we know they are good. [which should be in days/weeks] )
>>
>> Regards,
>> Martin Winter
>>
>> PS: The crash you've seen (assert in isis_find_vertex) is not on my list. If you are able to give me more details (ie configuration and what's on the other side, topology etc), then please let me know.
>>
>> On May 13, 2012, at 9:48 PM, Hristo Asenov wrote:
>>
>>> Hello,
>>>
>>> I cannot get isisd to run with zebra. If I start up an instance on one node, it will stay up but as soon as I start up another neighboring node with isis, the original node aborts with an assertion failure. I am using the latest cloned version from git (after 0.99.21 release). Here is a the run with the assertion failure:
>>>
>>> bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i /var/run/quagga/isisd.pid
>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>> 2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
>>> 2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>> 2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>> 2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>> 2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN IIH from eth1
>>>
>>> 2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id, vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function isis_spf_add2tent
>>> 2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
>>> 2012/05/08 17:52:42 ISIS: [bt 0] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f) [0xb782707a]
>>> 2012/05/08 17:52:42 ISIS: [bt 1] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92) [0xb78271dd]
>>> 2012/05/08 17:52:42 ISIS: [bt 2] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7) [0xb7884bf7]
>>> 2012/05/08 17:52:42 ISIS: [bt 3] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f) [0xb7884e9f]
>>> 2012/05/08 17:52:42 ISIS: [bt 4] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3) [0xb78857d3]
>>> 2012/05/08 17:52:42 ISIS: [bt 5] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03) [0xb786cb03]
>>> 2012/05/08 17:52:42 ISIS: [bt 6] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c) [0xb786cb3c]
>>> 2012/05/08 17:52:42 ISIS: [bt 7] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec) [0xb78704ec]
>>> 2012/05/08 17:52:42 ISIS: [bt 8] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc) [0xb78708cc]
>>> 2012/05/08 17:52:42 ISIS: [bt 9] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d) [0xb788328d]
>>> 2012/05/08 17:52:42 ISIS: [bt 10] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d) [0xb786c19d]
>>> 2012/05/08 17:52:42 ISIS: [bt 11] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a) [0xb787778a]
>>> 2012/05/08 17:52:42 ISIS: [bt 12] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3) [0xb787a9b3]
>>> 2012/05/08 17:52:42 ISIS: [bt 13] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b) [0xb781ad50]
>>> 2012/05/08 17:52:42 ISIS: [bt 14] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c) [0xb786b4cb]
>>> 2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7) [0xb767bce7]
>>> 2012/05/08 17:52:42 ISIS: [bt 16] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51) [0xb786af51]
>>> Abort
>>>
>>> And here is my config:
>>>
>>> hostname isisd
>>> password foo
>>> enable password foo
>>> log stdout
>>> !
>>> interface eth0
>>> !
>>> interface eth1
>>> ip router isis Test1
>>> isis circuit-type level-1
>>> !
>>> interface eth2
>>> ! ip router isis Test1
>>> ! isis circuit-type level-1
>>> !
>>> interface eth3
>>> !
>>> interface lo
>>> !
>>> router isis Test1
>>> net 51.0000.0000.0116.00
>>> metric-style wide
>>> is-type level-1
>>> !
>>> line vty
>>> !
>>>
>>> - Hristo
>>> _______________________________________________
>>> Quagga-users mailing list
>>> Quagga-users [at] lists
>>> http://lists.quagga.net/mailman/listinfo/quagga-users
>>
>


_______________________________________________
Quagga-users mailing list
Quagga-users [at] lists
http://lists.quagga.net/mailman/listinfo/quagga-users


hristo.s.asenov at gmail

May 15, 2012, 7:34 AM

Post #6 of 8 (824 views)
Permalink
Re: getting google-is-is to run [In reply to]

Martin,

We are using the same zebra and isis configs on both sides. Also here is my isisd config: http://pastebin.ca/2149006. The zebra config on the other side just differs by the static ip addresses that are assigned to it. Here is the config for it: http://pasebin.ca/2149012. The other eth2 interfaces currently have no routing protocol running on them. I also built the program with

./configure --enable-vtysh --enable-isisd --enable-multipath=0

- Hristo

On May 15, 2012, at 3:18 AM, Martin Winter wrote:

> Hristo,
>
> On May 14, 2012, at 8:00 PM, Hristo Asenov wrote:
>
>> Martin, can I try to run the separate branch you guys made for a few ISIS fixes? Maybe it somehow may change the behavior of crash I am getting.
>
> Feel free to try, but keep in mind that things may be even more broken (or fixed). Code is public on Github as mentioned before. However if you can wait a few days, then you may be better off - I'm in the process to test the fixes (and then move on to the next bugs - many more to work on).
>
>> To be more precise, the configuration we are running is on a LAN with Ubuntu VM images, however we have only two addresses per subnet, so we are using the links as if they were point-to-point but are using Ethernet protocol. It is something like
>>
>> host_01 (eth1: 10.100.2.1) <-------------> (eth1: 10.100.2.2) host_02
>>
>> where eth1 on both interfaces is under the subnet 10.100.2.0/30 and they are connected to out-of-band network so we can control them remotely.
>>
>> I ran the code with EXTREME_DEBUG enabled and debugging of adjacency packets enabled one more time. Here is the output I got: http://pastebin.ca/2148465. Also the stack trace from gdb: http://pastebin.ca/2148471. These are the configs we use for zebra: http://pastebin.ca/2148473. Let me know if there is more information I could provide. Thanks,
>
> I've looked at the pastbin's but I can't see the ISIS config. Only the Interface config (zebra config) and only one side. Are you using the same Quagga on both sides? If yes, can you give me the full Quagga config? Or let me know what's on the other side (with the config).
>
> Does the crash happen immediately when the neighbors are built or some time later (triggered by some change?)
>
> - Martin
>
>> On May 14, 2012, at 9:17 PM, Martin Winter wrote:
>>
>>> Hristo,
>>>
>>> I would be careful at this time with the ISIS. We (at OpenSourceRouting) are working on many bugs trying to get it into a better shape. As of today, I would wait a bit. I have a long list of crashes and we try to clean it up a bit to get it into a useable shape for the next version.
>>> I think the release message made it clear that ISIS isn't yet ready for use in 0.99.21
>>>
>>> For a list of compliance errors we found, see
>>> http://opensourcerouting.org/wiki/ANVL+ISIS+Results
>>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>>
>>> For a list of errors found with the protocol fuzzer (these are mostly crashes), see:
>>> http://opensourcerouting.org/wiki/MU+ISIS+L1+Results
>>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>>
>>> "OSR-TESTPOINT-20120430" is actually a label in our git (git://github.com/opensourcerouting/quagga)
>>> (there are some fixes in a separate branch already on our github for a few ISIS crashes. But most of them still in verification. They will be all committed to the mainline once we know they are good. [which should be in days/weeks] )
>>>
>>> Regards,
>>> Martin Winter
>>>
>>> PS: The crash you've seen (assert in isis_find_vertex) is not on my list. If you are able to give me more details (ie configuration and what's on the other side, topology etc), then please let me know.
>>>
>>> On May 13, 2012, at 9:48 PM, Hristo Asenov wrote:
>>>
>>>> Hello,
>>>>
>>>> I cannot get isisd to run with zebra. If I start up an instance on one node, it will stay up but as soon as I start up another neighboring node with isis, the original node aborts with an assertion failure. I am using the latest cloned version from git (after 0.99.21 release). Here is a the run with the assertion failure:
>>>>
>>>> bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i /var/run/quagga/isisd.pid
>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>> 2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
>>>> 2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>> 2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>> 2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>> 2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN IIH from eth1
>>>>
>>>> 2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id, vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function isis_spf_add2tent
>>>> 2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
>>>> 2012/05/08 17:52:42 ISIS: [bt 0] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f) [0xb782707a]
>>>> 2012/05/08 17:52:42 ISIS: [bt 1] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92) [0xb78271dd]
>>>> 2012/05/08 17:52:42 ISIS: [bt 2] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7) [0xb7884bf7]
>>>> 2012/05/08 17:52:42 ISIS: [bt 3] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f) [0xb7884e9f]
>>>> 2012/05/08 17:52:42 ISIS: [bt 4] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3) [0xb78857d3]
>>>> 2012/05/08 17:52:42 ISIS: [bt 5] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03) [0xb786cb03]
>>>> 2012/05/08 17:52:42 ISIS: [bt 6] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c) [0xb786cb3c]
>>>> 2012/05/08 17:52:42 ISIS: [bt 7] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec) [0xb78704ec]
>>>> 2012/05/08 17:52:42 ISIS: [bt 8] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc) [0xb78708cc]
>>>> 2012/05/08 17:52:42 ISIS: [bt 9] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d) [0xb788328d]
>>>> 2012/05/08 17:52:42 ISIS: [bt 10] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d) [0xb786c19d]
>>>> 2012/05/08 17:52:42 ISIS: [bt 11] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a) [0xb787778a]
>>>> 2012/05/08 17:52:42 ISIS: [bt 12] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3) [0xb787a9b3]
>>>> 2012/05/08 17:52:42 ISIS: [bt 13] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b) [0xb781ad50]
>>>> 2012/05/08 17:52:42 ISIS: [bt 14] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c) [0xb786b4cb]
>>>> 2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7) [0xb767bce7]
>>>> 2012/05/08 17:52:42 ISIS: [bt 16] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51) [0xb786af51]
>>>> Abort
>>>>
>>>> And here is my config:
>>>>
>>>> hostname isisd
>>>> password foo
>>>> enable password foo
>>>> log stdout
>>>> !
>>>> interface eth0
>>>> !
>>>> interface eth1
>>>> ip router isis Test1
>>>> isis circuit-type level-1
>>>> !
>>>> interface eth2
>>>> ! ip router isis Test1
>>>> ! isis circuit-type level-1
>>>> !
>>>> interface eth3
>>>> !
>>>> interface lo
>>>> !
>>>> router isis Test1
>>>> net 51.0000.0000.0116.00
>>>> metric-style wide
>>>> is-type level-1
>>>> !
>>>> line vty
>>>> !
>>>>
>>>> - Hristo
>>>> _______________________________________________
>>>> Quagga-users mailing list
>>>> Quagga-users [at] lists
>>>> http://lists.quagga.net/mailman/listinfo/quagga-users
>>>
>>
>


mwinter at opensourcerouting

May 15, 2012, 6:37 PM

Post #7 of 8 (815 views)
Permalink
Re: getting google-is-is to run [In reply to]

Hristo,

I think I found a way to reproduce the issue. We'll look into it.

However, can you confirm something for me?
It only happens in my lab if I set the same NSAP on both ISIS routers.

ie you show
router isis Test1
net 51.0000.0000.0116.00

on host_01 and I believe you use the same NSAP on the 2nd isis router. At least in my lab this is the way to reproduce it.
Still shouldn't crash ISIS, but don't expect ISIS to work either.

If the 2nd host has a different NSAP, ie

router isis Test1
net 51.0000.0000.0117.00

then it seems to work.

(This is with ISIS from savannah git)

- Martin

On May 15, 2012, at 7:34 AM, Hristo Asenov wrote:

> Martin,
>
> We are using the same zebra and isis configs on both sides. Also here is my isisd config: http://pastebin.ca/2149006. The zebra config on the other side just differs by the static ip addresses that are assigned to it. Here is the config for it: http://pasebin.ca/2149012. The other eth2 interfaces currently have no routing protocol running on them. I also built the program with
>
> ./configure --enable-vtysh --enable-isisd --enable-multipath=0
>
> - Hristo
>
> On May 15, 2012, at 3:18 AM, Martin Winter wrote:
>
>> Hristo,
>>
>> On May 14, 2012, at 8:00 PM, Hristo Asenov wrote:
>>
>>> Martin, can I try to run the separate branch you guys made for a few ISIS fixes? Maybe it somehow may change the behavior of crash I am getting.
>>
>> Feel free to try, but keep in mind that things may be even more broken (or fixed). Code is public on Github as mentioned before. However if you can wait a few days, then you may be better off - I'm in the process to test the fixes (and then move on to the next bugs - many more to work on).
>>
>>> To be more precise, the configuration we are running is on a LAN with Ubuntu VM images, however we have only two addresses per subnet, so we are using the links as if they were point-to-point but are using Ethernet protocol. It is something like
>>>
>>> host_01 (eth1: 10.100.2.1) <-------------> (eth1: 10.100.2.2) host_02
>>>
>>> where eth1 on both interfaces is under the subnet 10.100.2.0/30 and they are connected to out-of-band network so we can control them remotely.
>>>
>>> I ran the code with EXTREME_DEBUG enabled and debugging of adjacency packets enabled one more time. Here is the output I got: http://pastebin.ca/2148465. Also the stack trace from gdb: http://pastebin.ca/2148471. These are the configs we use for zebra: http://pastebin.ca/2148473. Let me know if there is more information I could provide. Thanks,
>>
>> I've looked at the pastbin's but I can't see the ISIS config. Only the Interface config (zebra config) and only one side. Are you using the same Quagga on both sides? If yes, can you give me the full Quagga config? Or let me know what's on the other side (with the config).
>>
>> Does the crash happen immediately when the neighbors are built or some time later (triggered by some change?)
>>
>> - Martin
>>
>>> On May 14, 2012, at 9:17 PM, Martin Winter wrote:
>>>
>>>> Hristo,
>>>>
>>>> I would be careful at this time with the ISIS. We (at OpenSourceRouting) are working on many bugs trying to get it into a better shape. As of today, I would wait a bit. I have a long list of crashes and we try to clean it up a bit to get it into a useable shape for the next version.
>>>> I think the release message made it clear that ISIS isn't yet ready for use in 0.99.21
>>>>
>>>> For a list of compliance errors we found, see
>>>> http://opensourcerouting.org/wiki/ANVL+ISIS+Results
>>>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>>>
>>>> For a list of errors found with the protocol fuzzer (these are mostly crashes), see:
>>>> http://opensourcerouting.org/wiki/MU+ISIS+L1+Results
>>>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>>>
>>>> "OSR-TESTPOINT-20120430" is actually a label in our git (git://github.com/opensourcerouting/quagga)
>>>> (there are some fixes in a separate branch already on our github for a few ISIS crashes. But most of them still in verification. They will be all committed to the mainline once we know they are good. [which should be in days/weeks] )
>>>>
>>>> Regards,
>>>> Martin Winter
>>>>
>>>> PS: The crash you've seen (assert in isis_find_vertex) is not on my list. If you are able to give me more details (ie configuration and what's on the other side, topology etc), then please let me know.
>>>>
>>>> On May 13, 2012, at 9:48 PM, Hristo Asenov wrote:
>>>>
>>>>> Hello,
>>>>>
>>>>> I cannot get isisd to run with zebra. If I start up an instance on one node, it will stay up but as soon as I start up another neighboring node with isis, the original node aborts with an assertion failure. I am using the latest cloned version from git (after 0.99.21 release). Here is a the run with the assertion failure:
>>>>>
>>>>> bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i /var/run/quagga/isisd.pid
>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>> 2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
>>>>> 2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>> 2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>> 2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>> 2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN IIH from eth1
>>>>>
>>>>> 2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id, vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function isis_spf_add2tent
>>>>> 2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
>>>>> 2012/05/08 17:52:42 ISIS: [bt 0] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f) [0xb782707a]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 1] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92) [0xb78271dd]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 2] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7) [0xb7884bf7]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 3] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f) [0xb7884e9f]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 4] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3) [0xb78857d3]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 5] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03) [0xb786cb03]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 6] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c) [0xb786cb3c]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 7] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec) [0xb78704ec]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 8] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc) [0xb78708cc]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 9] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d) [0xb788328d]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 10] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d) [0xb786c19d]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 11] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a) [0xb787778a]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 12] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3) [0xb787a9b3]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 13] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b) [0xb781ad50]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 14] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c) [0xb786b4cb]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7) [0xb767bce7]
>>>>> 2012/05/08 17:52:42 ISIS: [bt 16] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51) [0xb786af51]
>>>>> Abort
>>>>>
>>>>> And here is my config:
>>>>>
>>>>> hostname isisd
>>>>> password foo
>>>>> enable password foo
>>>>> log stdout
>>>>> !
>>>>> interface eth0
>>>>> !
>>>>> interface eth1
>>>>> ip router isis Test1
>>>>> isis circuit-type level-1
>>>>> !
>>>>> interface eth2
>>>>> ! ip router isis Test1
>>>>> ! isis circuit-type level-1
>>>>> !
>>>>> interface eth3
>>>>> !
>>>>> interface lo
>>>>> !
>>>>> router isis Test1
>>>>> net 51.0000.0000.0116.00
>>>>> metric-style wide
>>>>> is-type level-1
>>>>> !
>>>>> line vty
>>>>> !
>>>>>
>>>>> - Hristo
>>>>> _______________________________________________
>>>>> Quagga-users mailing list
>>>>> Quagga-users [at] lists
>>>>> http://lists.quagga.net/mailman/listinfo/quagga-users
>>>>
>>>
>>
>


_______________________________________________
Quagga-users mailing list
Quagga-users [at] lists
http://lists.quagga.net/mailman/listinfo/quagga-users


hristo.s.asenov at gmail

May 15, 2012, 7:21 PM

Post #8 of 8 (818 views)
Permalink
Re: getting google-is-is to run [In reply to]

Yeah, I actually didnt realize that NSAP address is something like IP address and needs to be distinct between nodes. I have confirmed that now it doesn't crash. It seemed strange that I was the only one coming up with this error straight from startup.

Also, I cloned from the savannah git so thats where its coming from. Thanks so much for the helpful advice! Ill also make sure to update my checkout once the bug fixes become available in mainline.

- Hristo

On May 15, 2012, at 9:37 PM, Martin Winter wrote:

> Hristo,
>
> I think I found a way to reproduce the issue. We'll look into it.
>
> However, can you confirm something for me?
> It only happens in my lab if I set the same NSAP on both ISIS routers.
>
> ie you show
> router isis Test1
> net 51.0000.0000.0116.00
>
> on host_01 and I believe you use the same NSAP on the 2nd isis router. At least in my lab this is the way to reproduce it.
> Still shouldn't crash ISIS, but don't expect ISIS to work either.
>
> If the 2nd host has a different NSAP, ie
>
> router isis Test1
> net 51.0000.0000.0117.00
>
> then it seems to work.
>
> (This is with ISIS from savannah git)
>
> - Martin
>
> On May 15, 2012, at 7:34 AM, Hristo Asenov wrote:
>
>> Martin,
>>
>> We are using the same zebra and isis configs on both sides. Also here is my isisd config: http://pastebin.ca/2149006. The zebra config on the other side just differs by the static ip addresses that are assigned to it. Here is the config for it: http://pasebin.ca/2149012. The other eth2 interfaces currently have no routing protocol running on them. I also built the program with
>>
>> ./configure --enable-vtysh --enable-isisd --enable-multipath=0
>>
>> - Hristo
>>
>> On May 15, 2012, at 3:18 AM, Martin Winter wrote:
>>
>>> Hristo,
>>>
>>> On May 14, 2012, at 8:00 PM, Hristo Asenov wrote:
>>>
>>>> Martin, can I try to run the separate branch you guys made for a few ISIS fixes? Maybe it somehow may change the behavior of crash I am getting.
>>>
>>> Feel free to try, but keep in mind that things may be even more broken (or fixed). Code is public on Github as mentioned before. However if you can wait a few days, then you may be better off - I'm in the process to test the fixes (and then move on to the next bugs - many more to work on).
>>>
>>>> To be more precise, the configuration we are running is on a LAN with Ubuntu VM images, however we have only two addresses per subnet, so we are using the links as if they were point-to-point but are using Ethernet protocol. It is something like
>>>>
>>>> host_01 (eth1: 10.100.2.1) <-------------> (eth1: 10.100.2.2) host_02
>>>>
>>>> where eth1 on both interfaces is under the subnet 10.100.2.0/30 and they are connected to out-of-band network so we can control them remotely.
>>>>
>>>> I ran the code with EXTREME_DEBUG enabled and debugging of adjacency packets enabled one more time. Here is the output I got: http://pastebin.ca/2148465. Also the stack trace from gdb: http://pastebin.ca/2148471. These are the configs we use for zebra: http://pastebin.ca/2148473. Let me know if there is more information I could provide. Thanks,
>>>
>>> I've looked at the pastbin's but I can't see the ISIS config. Only the Interface config (zebra config) and only one side. Are you using the same Quagga on both sides? If yes, can you give me the full Quagga config? Or let me know what's on the other side (with the config).
>>>
>>> Does the crash happen immediately when the neighbors are built or some time later (triggered by some change?)
>>>
>>> - Martin
>>>
>>>> On May 14, 2012, at 9:17 PM, Martin Winter wrote:
>>>>
>>>>> Hristo,
>>>>>
>>>>> I would be careful at this time with the ISIS. We (at OpenSourceRouting) are working on many bugs trying to get it into a better shape. As of today, I would wait a bit. I have a long list of crashes and we try to clean it up a bit to get it into a useable shape for the next version.
>>>>> I think the release message made it clear that ISIS isn't yet ready for use in 0.99.21
>>>>>
>>>>> For a list of compliance errors we found, see
>>>>> http://opensourcerouting.org/wiki/ANVL+ISIS+Results
>>>>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>>>>
>>>>> For a list of errors found with the protocol fuzzer (these are mostly crashes), see:
>>>>> http://opensourcerouting.org/wiki/MU+ISIS+L1+Results
>>>>> (look at "OSR-TESTPOINT-20120430" which is identical or very close to the 0.99.21)
>>>>>
>>>>> "OSR-TESTPOINT-20120430" is actually a label in our git (git://github.com/opensourcerouting/quagga)
>>>>> (there are some fixes in a separate branch already on our github for a few ISIS crashes. But most of them still in verification. They will be all committed to the mainline once we know they are good. [which should be in days/weeks] )
>>>>>
>>>>> Regards,
>>>>> Martin Winter
>>>>>
>>>>> PS: The crash you've seen (assert in isis_find_vertex) is not on my list. If you are able to give me more details (ie configuration and what's on the other side, topology etc), then please let me know.
>>>>>
>>>>> On May 13, 2012, at 9:48 PM, Hristo Asenov wrote:
>>>>>
>>>>>> Hello,
>>>>>>
>>>>>> I cannot get isisd to run with zebra. If I start up an instance on one node, it will stay up but as soon as I start up another neighboring node with isis, the original node aborts with an assertion failure. I am using the latest cloned version from git (after 0.99.21 release). Here is a the run with the assertion failure:
>>>>>>
>>>>>> bb02-sf% sudo ./isisd -A 127.0.0.1 -f isisd.conf -i /var/run/quagga/isisd.pid
>>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>>> 2012/05/08 17:35:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>>> 2012/05/08 17:35:18 ISIS: Quagga-ISISd 0.99.21 starting: vty [at] 260
>>>>>> 2012/05/08 17:35:48 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>>> 2012/05/08 17:36:18 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>>> 2012/05/08 17:50:29 ISIS: ISIS-Spf: TENT is empty SPF-root:isisd
>>>>>> 2012/05/08 17:52:40 ISIS: ISIS-Adj: No usable IP interface addresses in LAN IIH from eth1
>>>>>>
>>>>>> 2012/05/08 17:52:42 ISIS: Assertion `isis_find_vertex (spftree->paths, id, vtype) == ((void *)0)' failed in file isis_spf.c, line 515, function isis_spf_add2tent
>>>>>> 2012/05/08 17:52:42 ISIS: Backtrace for 17 stack frames:
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 0] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(zlog_backtrace+0x1f) [0xb782707a]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 1] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(_zlog_assert_failed+0x92) [0xb78271dd]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 2] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1dbf7) [0xb7884bf7]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 3] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1de9f) [0xb7884e9f]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 4] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1e7d3) [0xb78857d3]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 5] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b03) [0xb786cb03]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 6] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x5b3c) [0xb786cb3c]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 7] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x94ec) [0xb78704ec]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 8] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x98cc) [0xb78708cc]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 9] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1c28d) [0xb788328d]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 10] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x519d) [0xb786c19d]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 11] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x1078a) [0xb787778a]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 12] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(isis_receive+0x1c3) [0xb787a9b3]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 13] /home/hasenov/quagga_current/quagga/lib/.libs/libzebra.so.0(thread_call+0x5b) [0xb781ad50]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 14] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(main+0x40c) [0xb786b4cb]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 15] /lib/libc.so.6(__libc_start_main+0xe7) [0xb767bce7]
>>>>>> 2012/05/08 17:52:42 ISIS: [bt 16] /home/hasenov/quagga_current/quagga/isisd/.libs/lt-isisd(+0x3f51) [0xb786af51]
>>>>>> Abort
>>>>>>
>>>>>> And here is my config:
>>>>>>
>>>>>> hostname isisd
>>>>>> password foo
>>>>>> enable password foo
>>>>>> log stdout
>>>>>> !
>>>>>> interface eth0
>>>>>> !
>>>>>> interface eth1
>>>>>> ip router isis Test1
>>>>>> isis circuit-type level-1
>>>>>> !
>>>>>> interface eth2
>>>>>> ! ip router isis Test1
>>>>>> ! isis circuit-type level-1
>>>>>> !
>>>>>> interface eth3
>>>>>> !
>>>>>> interface lo
>>>>>> !
>>>>>> router isis Test1
>>>>>> net 51.0000.0000.0116.00
>>>>>> metric-style wide
>>>>>> is-type level-1
>>>>>> !
>>>>>> line vty
>>>>>> !
>>>>>>
>>>>>> - Hristo
>>>>>> _______________________________________________
>>>>>> Quagga-users mailing list
>>>>>> Quagga-users [at] lists
>>>>>> http://lists.quagga.net/mailman/listinfo/quagga-users
>>>>>
>>>>
>>>
>>
>


_______________________________________________
Quagga-users mailing list
Quagga-users [at] lists
http://lists.quagga.net/mailman/listinfo/quagga-users

Quagga users RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.