Mailing List Archive: Xen: API

XCP BETA BUG: bridge, kernel panic

Index | Next | Previous | View Threaded

aborodin1985 at yandex

Sep 13, 2011, 10:00 AM

Post #1 of 12 (451 views)
Permalink

XCP BETA BUG: bridge, kernel panic

[root [at] localhos xen]# brctl addbr br0

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: Oops: 0000 [#1] SMP

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: last sysfs file: /sys/class/net/lo/carrier

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: Process modprobe (pid: 18990, ti=edfa6000 task=ee9a8030 task.ti=edfa6000)

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: Stack:

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: Call Trace:

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: Code: 00 00 e8 c4 21 00 00 8b 5d f4 31 c0 8b 75 f8 8b 7d fc 89 ec 5d c3 90 8d 74 26 00 ff 24 95 a0 e3 9a f0 f6 41 30 04 75 d3 8b 55 f0 <8b> 42 14 f6 80 b8 00 00 00 01 74 c4 89 d0 e8 0d 47 9d cf 89 f8

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: EIP: [<f09ab050>] br_device_event+0x70/0x150 [bridge] SS:ESP 0069:edfa7f18

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: CR2: 0000000000000014

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

george.shuklin at gmail

Sep 14, 2011, 7:08 PM

Post #2 of 12 (435 views)
Permalink

Re: XCP BETA BUG: bridge, kernel panic [In reply to]

May I ask why you trying to do this? XCP use it onw mechanism to manage
networking (xe vif-create, vif-plug, vif-unplug, network-create and so
on), and this results looks like 'guys, your car broken - when I've
insert a long rope into the engine it starts making strange sounds'.

On Ð’Ñ‚., 2011-09-13 at 21:00 +0400, Breaker wrote:
> [root [at] localhos xen]# brctl addbr br0
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Oops: 0000 [#1] SMP
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: last sysfs file: /sys/class/net/lo/carrier
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Process modprobe (pid: 18990, ti=edfa6000 task=ee9a8030 task.ti=edfa6000)
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Stack:
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Call Trace:
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Code: 00 00 e8 c4 21 00 00 8b 5d f4 31 c0 8b 75 f8 8b 7d fc 89 ec 5d c3 90 8d 74 26 00 ff 24 95 a0 e3 9a f0 f6 41 30 04 75 d3 8b 55 f0 <8b> 42 14 f6 80 b8 00 00 00 01 74 c4 89 d0 e8 0d 47 9d cf 89 f8
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: EIP: [<f09ab050>] br_device_event+0x70/0x150 [bridge] SS:ESP 0069:edfa7f18
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: CR2: 0000000000000014
>
> _______________________________________________
> xen-api mailing list
> xen-api [at] lists
> http://lists.xensource.com/mailman/listinfo/xen-api

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

sr at swisscenter

Sep 14, 2011, 7:41 PM

Post #3 of 12 (430 views)
Permalink

Re: XCP BETA BUG: bridge, kernel panic [In reply to]

Hi,

Is your XCP running openvswitch or bridge mode ?

You can cat /etc/xensource/network.conf to check it out.

If it's running in openvswitch mode, don't use brctl to manually play
with the bridges,
that could be the reason it's panicing.

Use ovs-vsctl instead, or even better use the xapi xe network commands,
like told in a
previous reply.

Kind regards,
Sébastien

On 13.09.2011 19:00, Breaker wrote:
> [root [at] localhos xen]# brctl addbr br0
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Oops: 0000 [#1] SMP
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: last sysfs file: /sys/class/net/lo/carrier
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Process modprobe (pid: 18990, ti=edfa6000 task=ee9a8030 task.ti=edfa6000)
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Stack:
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Call Trace:
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: Code: 00 00 e8 c4 21 00 00 8b 5d f4 31 c0 8b 75 f8 8b 7d fc 89 ec 5d c3 90 8d 74 26 00 ff 24 95 a0 e3 9a f0 f6 41 30 04 75 d3 8b 55 f0<8b> 42 14 f6 80 b8 00 00 00 01 74 c4 89 d0 e8 0d 47 9d cf 89 f8
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: EIP: [<f09ab050>] br_device_event+0x70/0x150 [bridge] SS:ESP 0069:edfa7f18
>
> Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
> localhost kernel: CR2: 0000000000000014
>
> _______________________________________________
> xen-api mailing list
> xen-api [at] lists
> http://lists.xensource.com/mailman/listinfo/xen-api
>

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

blp at nicira

Sep 14, 2011, 10:37 PM

Post #4 of 12 (436 views)
Permalink

Re: XCP BETA BUG: bridge, kernel panic [In reply to]

SÃ©bastien Riccio <sr-dWg6jWm8wxMIjDr1QQGPvw [at] public> writes:

> Is your XCP running openvswitch or bridge mode ?
>
> You can cat /etc/xensource/network.conf to check it out.
>
> If it's running in openvswitch mode, don't use brctl to manually play
> with the bridges,
> that could be the reason it's panicing.

Using brctl in openvswitch mode isn't usually the right thing to
do, but it shouldn't cause a panic. If it does, then that's a
bug that we, meaning the Open vSwitch developers, need to fix.
(But this is the first I've heard of such a problem.)

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

sr at swisscenter

Sep 14, 2011, 11:10 PM

Post #5 of 12 (434 views)
Permalink

Re: XCP BETA BUG: bridge, kernel panic [In reply to]

On 15.09.2011 07:37, Ben Pfaff wrote:
>
> SÃ©bastien Riccio<sr-dWg6jWm8wxMIjDr1QQGPvw [at] public> writes:
>
>> Is your XCP running openvswitch or bridge mode ?
>>
>> You can cat /etc/xensource/network.conf to check it out.
>>
>> If it's running in openvswitch mode, don't use brctl to manually play
>> with the bridges,
>> that could be the reason it's panicing.
> Using brctl in openvswitch mode isn't usually the right thing to
> do, but it shouldn't cause a panic. If it does, then that's a
> bug that we, meaning the Open vSwitch developers, need to fix.
> (But this is the first I've heard of such a problem.)
>
Hi Ben,

That was just a supposition, I don't remember which version of
openvswitch is running on XCP 1.1 beta,
and my sandbox is down so I can't try to reproduce it at the moment.

I'm not an expert, but regardning the panic messages, for me it looks
like it's trying to load the bridging module
(modprobe, br_device_event, etc).

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: Process modprobe (pid: 18990, ti=edfa6000
task=ee9a8030 task.ti=edfa6000)

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: Code: 00 00 e8 c4 21 00 00 8b 5d f4 31 c0 8b 75 f8 8b
7d fc 89 ec 5d c3 90 8d 74 26 00 ff 24 95 a0 e3 9a f0 f6 41 30 04 75 d3
8b 55 f0<8b> 42 14 f6 80 b8 00 00 00 01 74 c4 89 d0 e8 0d 47 9d cf 89 f8

Message from syslogd@ at Tue Sep 13 20:54:19 2011 ...
localhost kernel: EIP: [<f09ab050>] br_device_event+0x70/0x150 [bridge]
SS:ESP 0069:edfa7f18

So that's why I thought it could be the problem. Something like
openvswitch having the hook for bridge functions
and the kernel panicing when it try to loads the linux bridge module.

Again it was only a supposition, I can be totally wrong. So pardon me
if I'm completly out of the subject.
I just don't see what else could be confusing the kernel at this point.

Cheers,
SÃ©bastien

ps: It looks like to me that your reply didn't make it to the list

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

blp at nicira

Sep 15, 2011, 9:24 AM

Post #6 of 12 (430 views)
Permalink

Re: XCP BETA BUG: bridge, kernel panic [In reply to]

On Thu, Sep 15, 2011 at 08:10:23AM +0200, S??bastien Riccio wrote:
> On 15.09.2011 07:37, Ben Pfaff wrote:
> >
> >S??bastien Riccio<sr-dWg6jWm8wxMIjDr1QQGPvw [at] public> writes:
> >
> >>Is your XCP running openvswitch or bridge mode ?
> >>
> >>You can cat /etc/xensource/network.conf to check it out.
> >>
> >>If it's running in openvswitch mode, don't use brctl to manually play
> >>with the bridges,
> >>that could be the reason it's panicing.
> >Using brctl in openvswitch mode isn't usually the right thing to
> >do, but it shouldn't cause a panic. If it does, then that's a
> >bug that we, meaning the Open vSwitch developers, need to fix.
> >(But this is the first I've heard of such a problem.)
> >
> That was just a supposition, I don't remember which version of
> openvswitch is running on XCP 1.1 beta,
> and my sandbox is down so I can't try to reproduce it at the moment.

I agree. That's what the OOPS looks like to me, too, at first glance.
The goal of my reply is to make it clear that that would be a bug in
itself. It's not just user error, even though the user may not be
doing what would best achieve his goal.

> ps: It looks like to me that your reply didn't make it to the list

My previous replies via gmane.org made it OK, it just took a while. I
assume that this one will be the same way.

Thanks,

Ben.

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

sr at swisscenter

Sep 15, 2011, 10:21 AM

Post #7 of 12 (427 views)
Permalink

Re: XCP BETA BUG: bridge, kernel panic [In reply to]

On 15.09.2011 18:24, Ben Pfaff wrote:
> I agree. That's what the OOPS looks like to me, too, at first glance.
> The goal of my reply is to make it clear that that would be a bug in
> itself. It's not just user error, even though the user may not be
> doing what would best achieve his goal.
>> ps: It looks like to me that your reply didn't make it to the list
> My previous replies via gmane.org made it OK, it just took a while. I
> assume that this one will be the same way.
>
> Thanks,
>
> Ben.
>
Hi Ben,

I'm upgrading my xcp sandbox to 1.1 beta and will try if I can reproduce
breaker's problem playing with brctl. If I'm able, I will let you know
which version of openvswitch is used and how I was able to reproduce it.

As for your previous reply, sorry but I don't have it on my xen-api list
folder here and it's not here too:
http://lists.xensource.com/archives/html/xen-api/2011-09/threads.html
So that's why I thought it would be good to let you know...

Cheers,
Sébastien

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

blp at nicira

Sep 15, 2011, 10:32 AM

Post #8 of 12 (427 views)
Permalink

Re: XCP BETA BUG: bridge, kernel panic [In reply to]

On Thu, Sep 15, 2011 at 07:21:15PM +0200, S?bastien Riccio wrote:
> I'm upgrading my xcp sandbox to 1.1 beta and will try if I can
> reproduce breaker's problem playing with brctl. If I'm able, I will
> let you know which version of openvswitch is used and how I was able
> to reproduce it.

Thank you.

> As for your previous reply, sorry but I don't have it on my xen-api
> list folder here and it's not here too:
> http://lists.xensource.com/archives/html/xen-api/2011-09/threads.html

Yes, in the past it took a day or two to make it. You can see earlier
emails that I sent via gmane there, e.g.
http://lists.xensource.com/archives/html/xen-api/2011-09/msg00020.html
I assume that there is some kind of manual moderation step along the
way.

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

sr at swisscenter

Sep 15, 2011, 10:53 AM

Post #9 of 12 (428 views)
Permalink

Re: Re: XCP BETA BUG: bridge, kernel panic [In reply to]

Hi,

[root [at] xcp1 ~]# cat /etc/xensource/network.conf
openvswitch

[root [at] xcp1 ~]# ovs-vsctl --version
ovs-vsctl (Open vSwitch) 1.0.2
Compiled Feb 7 2011 17:28:47

[root [at] xcp1 ~]# brctl show
bridge name bridge id STP enabled interfaces
xapi1 0000.bc305b3883c8 no bond0
eth5
eth4
xenbr0 0000.bc305b3883c0 no eth0
xenbr1 0000.bc305b3883c2 no eth1
xenbr2 0000.bc305b3883c4 no eth2
xenbr3 0000.bc305b3883c6 no xapi7

[root [at] xcp1 ~]# brctl addbr test

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: Oops: 0000 [#1] SMP

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: last sysfs file: /sys/class/net/lo/carrier

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: Process modprobe (pid: 9791, ti=ee3c2000 task=ece757f0
task.ti=ee3c2000)

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: Stack:

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: Call Trace:

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: Code: 00 00 e8 c4 21 00 00 8b 5d f4 31 c0 8b 75 f8 8b 7d
fc 89 ec 5d c3 90 8d 74 26 00 ff 24 95 a0 73 fa f0 f6 41 30 04 75 d3 8b
55 f0 <8b> 42 14 f6 80 b8 00 00 00 01 74 c4 89 d0 e8 0d b7 3d cf 89 f8

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: EIP: [<f0fa4050>] br_device_event+0x70/0x150 [bridge]
SS:ESP 0069:ee3c3f18

Message from syslogd@ at Thu Sep 15 19:47:37 2011 ...
xcp12 kernel: CR2: 0000000000000014

That was kinda trivial to reproduce it. If it's a bug of version 1.0.2
and as they are currently working hard to release the next XCP version,
it could be a good thing to have it upgraded to a recent version like
1.1.2 or 1.2.1.

ps: cc'ing mike McClurg who is in charge of XCP

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

blp at nicira

Sep 15, 2011, 11:00 AM

Post #10 of 12 (431 views)
Permalink

Re: Re: XCP BETA BUG: bridge, kernel panic [In reply to]

On Thu, Sep 15, 2011 at 07:53:44PM +0200, S?bastien Riccio wrote:
> [demonstration of trivial OOPS on "brctl addbr" with OVS 1.0.2]
>
> That was kinda trivial to reproduce it. If it's a bug of version
> 1.0.2 and as they are currently working hard to release the next XCP
> version, it could be a good thing to have it upgraded to a recent
> version like 1.1.2 or 1.2.1.

I'm confused about why 1.0.2 is (still?) in XCP. Open vSwitch has a
special branch for Citrix, which we created at request from Citrix,
that is much closer to 1.1 than to 1.0. It is named "vlan-maint" and
available from the regular Open vSwitch repository. It reports
version 1.0.99. If Citrix isn't using it, then I don't know why it is
there.

Mike, do I misunderstand what's going on?

Thanks,

Ben.

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

sr at swisscenter

Sep 15, 2011, 11:07 AM

Post #11 of 12 (429 views)
Permalink

Re: Re: XCP BETA BUG: bridge, kernel panic [In reply to]

On 15.09.2011 20:00, Ben Pfaff wrote:
> I'm confused about why 1.0.2 is (still?) in XCP. Open vSwitch has a
> special branch for Citrix, which we created at request from Citrix,
> that is much closer to 1.1 than to 1.0. It is named "vlan-maint" and
> available from the regular Open vSwitch repository. It reports version
> 1.0.99. If Citrix isn't using it, then I don't know why it is there.
> Mike, do I misunderstand what's going on? Thanks, Ben.

I've checked the version on XenServer 5.6 fp2 in case it was only a XCP
problem, but looks like I might be able to reproduce it on this host
too. But I won't try, it's in production.

xen-blade03 # ovs-vsctl --version
ovs-vsctl (Open vSwitch) 1.0.2
Compiled Oct 26 2010 05:25:05

Sébastien

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

Jonathan.Ludlam at eu

Sep 20, 2011, 9:27 AM

Post #12 of 12 (423 views)
Permalink

Re: Re: XCP BETA BUG: bridge, kernel panic [In reply to]

XCP-1.1 is most similar to XenServer 5.6 fp2. We're planning on releasing something based on 6.0 as soon as we can.

Jon

On 15 Sep 2011, at 19:07, Sébastien Riccio wrote:

> On 15.09.2011 20:00, Ben Pfaff wrote:
>> I'm confused about why 1.0.2 is (still?) in XCP. Open vSwitch has a
>> special branch for Citrix, which we created at request from Citrix,
>> that is much closer to 1.1 than to 1.0. It is named "vlan-maint" and
>> available from the regular Open vSwitch repository. It reports version
>> 1.0.99. If Citrix isn't using it, then I don't know why it is there.
>> Mike, do I misunderstand what's going on? Thanks, Ben.
>
> I've checked the version on XenServer 5.6 fp2 in case it was only a XCP
> problem, but looks like I might be able to reproduce it on this host
> too. But I won't try, it's in production.
>
> xen-blade03 # ovs-vsctl --version
> ovs-vsctl (Open vSwitch) 1.0.2
> Compiled Oct 26 2010 05:25:05
>
> Sébastien
>
> _______________________________________________
> xen-api mailing list
> xen-api [at] lists
> http://lists.xensource.com/mailman/listinfo/xen-api

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads