Mailing List Archive: Xen: API

XCP 1.1 DDK for OVS Build

Index | Next | Previous | View Threaded

brooks at netgate

Jan 23, 2012, 8:18 AM

Post #1 of 13 (1885 views)
Permalink

XCP 1.1 DDK for OVS Build

I need to build/install a newer version of OVS and the instructions:

http://openvswitch.org/cgi-bin/gitweb.cgi?p=openvswitch;a=blob_plain;f=INSTALL.XenServer;hb=HEAD

indicate the use the DDK VM to make that happen. I scoured the mailing
lists, wiki, and docs and can't find any reference to the DDK for XCP 1.1.

On Mon, Mar 7, 2011 at 6:25 PM, Xole <xo...@clandestine.se> wrote:
-------------------------------------------------------------------------
I can't be the only one waiting for the DDK, is there any information
regarding its release?

Todd answered:
-------------------------------------------------------------------------
For now you can use the XenServer 5.6 FP 1 ddk.

We are working on the XCP 1.0 DDK.

Thanks,
Todd
-------------------------------------------------------------------------

Does this hold true for XCP 1.1, with the difference being that we should
use the 5.6 FP2 DDK from:

http://support.citrix.com/article/CTX130729

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

brooks at netgate

Jan 23, 2012, 11:02 PM

Post #2 of 13 (1816 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

I was able to get the 5.6 SP2 DDK VM installed and build OVS 1.3.0 without
any problems. Unfortunately the kernel name used for 5.6 SP2 isn't the
same as for XCP 1.1 so I'm not going to be able to just install the new
OVS 1.3 based kernel module into XCP, at least not cleanly.

XenServer 5.6 SP2:

/lib/modules/2.6.32.12-0.7.1.xs5.6.100.327.170613xen/extra/openvswitch/openvswitch_mod.ko

XCP 1.1:

/lib/modules/2.6.32.12-0.7.1.xs1.1.0.327.170596xen/kernel/net/openvswitch/openvswitch_mod.ko

Does anyone know the easiest path forward? My plan is to install the XCP
kernel source into the 5.6 SP2 DDK VM, compile and install it and then
recompile OVS 1.3. Does that sound reasonable?

It's a bit crazy that we don't have a DDK VM for XCP. If there's a
design or build doc somewhere someone could pass on to me I'd be happy to
build the DDK VM and make it available to the community. Given the number
of requests there seems to be a need.

On Mon, 23 Jan 2012, brooks [at] netgate wrote:

>
> I need to build/install a newer version of OVS and the instructions:
>
> http://openvswitch.org/cgi-bin/gitweb.cgi?p=openvswitch;a=blob_plain;f=INSTALL.XenServer;hb=HEAD
>
> indicate the use the DDK VM to make that happen. I scoured the mailing
> lists, wiki, and docs and can't find any reference to the DDK for XCP 1.1.
>
> On Mon, Mar 7, 2011 at 6:25 PM, Xole <xo...@clandestine.se> wrote:
> -------------------------------------------------------------------------
> I can't be the only one waiting for the DDK, is there any information
> regarding its release?
>
> Todd answered:
> -------------------------------------------------------------------------
> For now you can use the XenServer 5.6 FP 1 ddk.
>
> We are working on the XCP 1.0 DDK.
>
> Thanks,
> Todd
> -------------------------------------------------------------------------
>
> Does this hold true for XCP 1.1, with the difference being that we should use
> the 5.6 FP2 DDK from:
>
> http://support.citrix.com/article/CTX130729

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

admin at xenhive

Jan 24, 2012, 10:45 AM

Post #3 of 13 (1847 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

I agree. It would be fantastic if there was a DDK for XCP. That issue is
annoying when trying to use the XenServer DDK with XCP. I've been trying to
do some work with the OFED and XCP. It is bad enough that the OFED is not
included in XCP in first place, but being forced to use the XenServer DDK
instead of a XCP DDK is a bit much. I love XCP, but this is a bit silly.

-----Original Message-----
From: xen-api-bounces [at] lists
[mailto:xen-api-bounces [at] lists] On Behalf Of brooks [at] netgate
Sent: Tuesday, January 24, 2012 1:03 AM
To: xen-api [at] lists
Subject: Re: [Xen-API] XCP 1.1 DDK for OVS Build

I was able to get the 5.6 SP2 DDK VM installed and build OVS 1.3.0 without
any problems. Unfortunately the kernel name used for 5.6 SP2 isn't the
same as for XCP 1.1 so I'm not going to be able to just install the new
OVS 1.3 based kernel module into XCP, at least not cleanly.

XenServer 5.6 SP2:

/lib/modules/2.6.32.12-0.7.1.xs5.6.100.327.170613xen/extra/openvswitch/openv
switch_mod.ko

XCP 1.1:

/lib/modules/2.6.32.12-0.7.1.xs1.1.0.327.170596xen/kernel/net/openvswitch/op
envswitch_mod.ko

Does anyone know the easiest path forward? My plan is to install the XCP
kernel source into the 5.6 SP2 DDK VM, compile and install it and then
recompile OVS 1.3. Does that sound reasonable?

It's a bit crazy that we don't have a DDK VM for XCP. If there's a
design or build doc somewhere someone could pass on to me I'd be happy to
build the DDK VM and make it available to the community. Given the number
of requests there seems to be a need.

On Mon, 23 Jan 2012, brooks [at] netgate wrote:

>
> I need to build/install a newer version of OVS and the instructions:
>
>
http://openvswitch.org/cgi-bin/gitweb.cgi?p=openvswitch;a=blob_plain;f=INSTA
LL.XenServer;hb=HEAD
>
> indicate the use the DDK VM to make that happen. I scoured the mailing
> lists, wiki, and docs and can't find any reference to the DDK for XCP 1.1.
>
> On Mon, Mar 7, 2011 at 6:25 PM, Xole <xo...@clandestine.se> wrote:
> -------------------------------------------------------------------------
> I can't be the only one waiting for the DDK, is there any information
> regarding its release?
>
> Todd answered:
> -------------------------------------------------------------------------
> For now you can use the XenServer 5.6 FP 1 ddk.
>
> We are working on the XCP 1.0 DDK.
>
> Thanks,
> Todd
> -------------------------------------------------------------------------
>
> Does this hold true for XCP 1.1, with the difference being that we should
use
> the 5.6 FP2 DDK from:
>
> http://support.citrix.com/article/CTX130729

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

Jonathan.Ludlam at eu

Jan 25, 2012, 5:57 PM

Post #4 of 13 (1828 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

Agreed, the lack of a DDK does suck.

It's possible we might be able to sort out one for XCP 1.5, and likely that the XCP after 1.5 will share a DDK with XenServer.

Incidentally on the 1.5 front, we should have a beta by the end of the week, if all goes well.

Jon

On 23 Jan 2012, at 16:18, <brooks [at] netgate> <brooks [at] netgate> wrote:

>
> I need to build/install a newer version of OVS and the instructions:
>
> http://openvswitch.org/cgi-bin/gitweb.cgi?p=openvswitch;a=blob_plain;f=INSTALL.XenServer;hb=HEAD
>
> indicate the use the DDK VM to make that happen. I scoured the mailing
> lists, wiki, and docs and can't find any reference to the DDK for XCP 1.1.
>
> On Mon, Mar 7, 2011 at 6:25 PM, Xole <xo...@clandestine.se> wrote:
> -------------------------------------------------------------------------
> I can't be the only one waiting for the DDK, is there any information
> regarding its release?
>
> Todd answered:
> -------------------------------------------------------------------------
> For now you can use the XenServer 5.6 FP 1 ddk.
>
> We are working on the XCP 1.0 DDK.
>
> Thanks,
> Todd
> -------------------------------------------------------------------------
>
> Does this hold true for XCP 1.1, with the difference being that we should
> use the 5.6 FP2 DDK from:
>
> http://support.citrix.com/article/CTX130729
>
>
>
>
> _______________________________________________
> xen-api mailing list
> xen-api [at] lists
> http://lists.xensource.com/mailman/listinfo/xen-api

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

brooks at netgate

Jan 25, 2012, 6:15 PM

Post #5 of 13 (1841 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

Great news on the 1.5 beta!

I was able to hobble together an XCP 1.1 DDK VM based on the 5.6 SP2 DDK
VM image. Updating that VM to use the XCP 1.1 kernel wasn't too difficult
and once I got that completed recompiling OVS was easy. What was worse
was finding out that you guys bundled the OVS kernel module into the
kernel RPM itself. So to get OVS 1.3 installed I had to rip out the OVS
code from the XCP 1.1 kernel. The nice thing is that I now have an XCP
1.1 DDK VM that can be used to update the kernel, drivers, etc. And I
also have the ability to easily update OVS if needed, now that it's kernel
module component is built as a separate RPM.

If anyone else wants to run newer OVS code shoot me an email I'm happy to
share the path I used, or RPMs themselves.

So far everything seems to be working great with XCP 1.1 and OVS 1.3.

Kevin

On Thu, 26 Jan 2012, Jonathan Ludlam wrote:

> Agreed, the lack of a DDK does suck.
>
> It's possible we might be able to sort out one for XCP 1.5, and likely that the XCP after 1.5 will share a DDK with XenServer.
>
> Incidentally on the 1.5 front, we should have a beta by the end of the week, if all goes well.
>
> Jon
>
> On 23 Jan 2012, at 16:18, <brooks [at] netgate> <brooks [at] netgate> wrote:
>
>>
>> I need to build/install a newer version of OVS and the instructions:
>>
>> http://openvswitch.org/cgi-bin/gitweb.cgi?p=openvswitch;a=blob_plain;f=INSTALL.XenServer;hb=HEAD
>>
>> indicate the use the DDK VM to make that happen. I scoured the mailing
>> lists, wiki, and docs and can't find any reference to the DDK for XCP 1.1.
>>
>> On Mon, Mar 7, 2011 at 6:25 PM, Xole <xo...@clandestine.se> wrote:
>> -------------------------------------------------------------------------
>> I can't be the only one waiting for the DDK, is there any information
>> regarding its release?
>>
>> Todd answered:
>> -------------------------------------------------------------------------
>> For now you can use the XenServer 5.6 FP 1 ddk.
>>
>> We are working on the XCP 1.0 DDK.
>>
>> Thanks,
>> Todd
>> -------------------------------------------------------------------------
>>
>> Does this hold true for XCP 1.1, with the difference being that we should
>> use the 5.6 FP2 DDK from:
>>
>> http://support.citrix.com/article/CTX130729

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

outbackdingo at gmail

Jan 25, 2012, 6:20 PM

Post #6 of 13 (1820 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

On Wed, Jan 25, 2012 at 9:15 PM, <brooks [at] netgate> wrote:
>
> Great news on the 1.5 beta!
>
> I was able to hobble together an XCP 1.1 DDK VM based on the 5.6 SP2 DDK VM
> image. �Updating that VM to use the XCP 1.1 kernel wasn't too difficult and
> once I got that completed recompiling OVS was easy. �What was worse was
> finding out that you guys bundled the OVS kernel module into the kernel RPM
> itself. �So to get OVS 1.3 installed I had to rip out the OVS code from the
> XCP 1.1 kernel. �The nice thing is that I now have an XCP 1.1 DDK VM that
> can be used to update the kernel, drivers, etc. �And I also have the ability
> to easily update OVS if needed, now that it's kernel module component is
> built as a separate RPM.
>
> If anyone else wants to run newer OVS code shoot me an email I'm happy to
> share the path I used, or RPMs themselves.
>
> So far everything seems to be working great with XCP 1.1 and OVS 1.3.

id be interested in it, and the src rpm if possible .... ive got a
test bed that id like to run it in

>
> Kevin
>
>
> On Thu, 26 Jan 2012, Jonathan Ludlam wrote:
>
>> Agreed, the lack of a DDK does suck.
>>
>> It's possible we might be able to sort out one for XCP 1.5, and likely
>> that the XCP after 1.5 will share a DDK with XenServer.
>>
>> Incidentally on the 1.5 front, we should have a beta by the end of the
>> week, if all goes well.
>>
>> Jon
>>
>> On 23 Jan 2012, at 16:18, <brooks [at] netgate> <brooks [at] netgate> wrote:
>>
>>>
>>> I need to build/install a newer version of OVS and the instructions:
>>>
>>>
>>> http://openvswitch.org/cgi-bin/gitweb.cgi?p=openvswitch;a=blob_plain;f=INSTALL.XenServer;hb=HEAD
>>>
>>> indicate the use the DDK VM to make that happen. �I scoured the mailing
>>> lists, wiki, and docs and can't find any reference to the DDK for XCP
>>> 1.1.
>>>
>>> On Mon, Mar 7, 2011 at 6:25 PM, Xole <xo...@clandestine.se> wrote:
>>> -------------------------------------------------------------------------
>>> I can't be the only one waiting for the DDK, is there any information
>>> regarding its release?
>>>
>>> Todd answered:
>>> -------------------------------------------------------------------------
>>> For now you can use the XenServer 5.6 FP 1 ddk.
>>>
>>> We are working on the XCP 1.0 DDK.
>>>
>>> Thanks,
>>> Todd
>>> -------------------------------------------------------------------------
>>>
>>> Does this hold true for XCP 1.1, with the difference being that we should
>>> use the 5.6 FP2 DDK from:
>>>
>>> � � � �http://support.citrix.com/article/CTX130729
>
>
> _______________________________________________
> xen-api mailing list
> xen-api [at] lists
> http://lists.xensource.com/mailman/listinfo/xen-api

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

blp at cs

Jan 25, 2012, 8:59 PM

Post #7 of 13 (1828 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

brooks [at] netgate writes:

> I was able to hobble together an XCP 1.1 DDK VM based on the 5.6 SP2
> DDK VM image. Updating that VM to use the XCP 1.1 kernel wasn't too
> difficult and once I got that completed recompiling OVS was easy.
> What was worse was finding out that you guys bundled the OVS kernel
> module into the kernel RPM itself. So to get OVS 1.3 installed I had
> to rip out the OVS code from the XCP 1.1 kernel. The nice thing is
> that I now have an XCP 1.1 DDK VM that can be used to update the
> kernel, drivers, etc. And I also have the ability to easily update
> OVS if needed, now that it's kernel module component is built as a
> separate RPM.

It doesn't make sense that you had to rip anything out. The OVS
RPMs should override the modules shipped with XenServer. We rely
on this routinely at Nicira.
--
Ben Pfaff
http://benpfaff.org

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

brooks at netgate

Jan 25, 2012, 9:27 PM

Post #8 of 13 (1837 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

On Wed, 25 Jan 2012, Ben Pfaff wrote:

> brooks [at] netgate writes:
>
>> I was able to hobble together an XCP 1.1 DDK VM based on the 5.6 SP2
>> DDK VM image. Updating that VM to use the XCP 1.1 kernel wasn't too
>> difficult and once I got that completed recompiling OVS was easy.
>> What was worse was finding out that you guys bundled the OVS kernel
>> module into the kernel RPM itself. So to get OVS 1.3 installed I had
>> to rip out the OVS code from the XCP 1.1 kernel. The nice thing is
>> that I now have an XCP 1.1 DDK VM that can be used to update the
>> kernel, drivers, etc. And I also have the ability to easily update
>> OVS if needed, now that it's kernel module component is built as a
>> separate RPM.
>
> It doesn't make sense that you had to rip anything out. The OVS
> RPMs should override the modules shipped with XenServer. We rely
> on this routinely at Nicira.

Thank you. Honestly, I didn't try installing the 1.3 RPMs over the kernel
installed OVS modules. Once I determined that Citrix bundled the module
with the kernel RPM I didn't think the OVS kernel module RPM would
replace/remove (it doesn't) or override them. It just seemed safer to
remove it from the kernel altogether. I'll rebuild against the unmodified
kernel and give it a try.

We should add a note about this to the BUILD document.

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

brooks at netgate

Jan 25, 2012, 9:56 PM

Post #9 of 13 (1814 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

On Wed, 25 Jan 2012, brooks [at] netgate wrote:

> kernel altogether. I'll rebuild against the unmodified kernel and give it a
> try.

Worked perfectly. The rpms are available on my ftp site if anyone else
would like to give OVS 1.3 a spin:

ftp://bytecode.com/pub/xcp1.1

To install copy openvswitch-1.3.0-1.i386.rpm and
openvswitch-modules-xen-2.6.32.12-0.7.1.xs1.1.0.327.170596-1.3.0-1.i386.rpm
to your XCP 1.1 compute node and install them using:

rpm -Uvh openvswitch-1.3.0-1.i386.rpm
openvswitch-modules-xen-2.6.32.12-0.7.1.xs1.1.0.327.170596-1.3.0-1.i386.rpm

Kevin

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

outbackdingo at gmail

Jan 30, 2012, 12:16 PM

Post #10 of 13 (1789 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

On Wed, Jan 25, 2012 at 8:57 PM, Jonathan Ludlam
<Jonathan.Ludlam [at] eu> wrote:
> Agreed, the lack of a DDK does suck.
>
> It's possible we might be able to sort out one for XCP 1.5, and likely that the XCP after 1.5 will share a DDK with XenServer.
>
> Incidentally on the 1.5 front, we should have a beta by the end of the week, if all goes well.
>
> Jon

We can guess all is not going well ??? Will we maybe see it this week ?

>
> On 23 Jan 2012, at 16:18, <brooks [at] netgate> <brooks [at] netgate> wrote:
>
>>
>> I need to build/install a newer version of OVS and the instructions:
>>
>> http://openvswitch.org/cgi-bin/gitweb.cgi?p=openvswitch;a=blob_plain;f=INSTALL.XenServer;hb=HEAD
>>
>> indicate the use the DDK VM to make that happen. �I scoured the mailing
>> lists, wiki, and docs and can't find any reference to the DDK for XCP 1.1.
>>
>> On Mon, Mar 7, 2011 at 6:25 PM, Xole <xo...@clandestine.se> wrote:
>> -------------------------------------------------------------------------
>> I can't be the only one waiting for the DDK, is there any information
>> regarding its release?
>>
>> Todd answered:
>> -------------------------------------------------------------------------
>> For now you can use the XenServer 5.6 FP 1 ddk.
>>
>> We are working on the XCP 1.0 DDK.
>>
>> Thanks,
>> Todd
>> -------------------------------------------------------------------------
>>
>> Does this hold true for XCP 1.1, with the difference being that we should
>> use the 5.6 FP2 DDK from:
>>
>> � � � http://support.citrix.com/article/CTX130729
>>
>>
>>
>>
>> _______________________________________________
>> xen-api mailing list
>> xen-api [at] lists
>> http://lists.xensource.com/mailman/listinfo/xen-api
>
>
> _______________________________________________
> xen-api mailing list
> xen-api [at] lists
> http://lists.xensource.com/mailman/listinfo/xen-api

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

brooks at netgate

Feb 2, 2012, 10:24 AM

Post #11 of 13 (1771 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

So many threads never get closure I wanted to send a quick follow up.

OVS 1.3 compiled, installed and functions as advertised. If the bond is
put into active-backup it will only listen on one interface. That helped
us track down another issue we were seeing where the VM VLAN traffic
wasn't being passed to the VMs. That turned out to be a problem with the
BMC sharing one of the Ethernet ports. For some reason the driver for the
BMC or for the Broadcom chipset is munging the VLAN packets, untagged
packets are passed up the stack without any issue, but tagged packets are
being munged. Since I have a working XCP 1.1 DDK I was able to download
the latest Broadcom driver and compile and install it. Unfortunately it
didn't help. The only resolution was to install a PCIe card and move the
VM VLAN traffic. OVS 1.3 also allowed us to track down and resolve a
problem we were seeing with ARP/MAC table convergence which was causing us
to see traffic instability for a long period of time (~5 minutes) when
moving a VM from one compute node to another, or when the switching the
active interface on the bond associated with VM traffic. OVS 1.3 is a
nice improvement to the 1.0.2 code shipped with XCP 1.1 and I would highly
recommend it if you're seeing any strange behavior with your active-backup
bonds in XCP 1.1.

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

blp at cs

Feb 2, 2012, 11:14 AM

Post #12 of 13 (1789 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

brooks [at] netgate writes:

> That helped us track down another issue we were seeing where
> the VM VLAN traffic wasn't being passed to the VMs. That
> turned out to be a problem with the BMC sharing one of the
> Ethernet ports. For some reason the driver for the BMC or for
> the Broadcom chipset is munging the VLAN packets, untagged
> packets are passed up the stack without any issue, but tagged
> packets are being munged. Since I have a working XCP 1.1 DDK I
> was able to download the latest Broadcom driver and compile and
> install it. Unfortunately it didn't help. The only resolution
> was to install a PCIe card and move the VM VLAN traffic.

OVS 1.4 adds a feature called "VLAN splinters" that, if you
enable it on the problematic NIC, may allow you to use it with
Open vSwitch.
--
Ben Pfaff
http://benpfaff.org

_______________________________________________
xen-api mailing list
xen-api [at] lists
http://lists.xensource.com/mailman/listinfo/xen-api

spankthespam at gmail

Aug 16, 2012, 2:37 AM

Post #13 of 13 (1225 views)
Permalink

Re: XCP 1.1 DDK for OVS Build [In reply to]

> On Wed, 25 Jan 2012, brooks [at] xxxxxxxxxx wrote:
>
> kernel altogether. I'll rebuild against the unmodified kernel and give it a try.
>
> Worked perfectly. The rpms are available on my ftp site if anyone else would like to give OVS 1.3 a spin:
>
> ftp://bytecode.com/pub/xcp1.1
>
> To install copy openvswitch-1.3.0-1.i386.rpm and openvswitch-modules-xen-2.6.32.12-0.7.1.xs1.1.0.327.170596-1.3.0-1.i386.rpm to your XCP 1.1 compute node and install them using:
>
> rpm -Uvh openvswitch-1.3.0-1.i386.rpm openvswitch-modules-xen-2.6.32.12-0.7.1.xs1.1.0.327.170596-1.3.0-1.i386.rpm
>
> Kevin

Hi everyone,

Did anybody had a luck in developing such DDK for XCP 1.1 and could
share either the vm either some instructions on how to do it? I've
tried to mail Kevin directly, but so far without luck, and I need to
compile new r8169 kernel module, as I am seeing some really poor
performance on the stock one.

Regards,
S.

_______________________________________________
Xen-api mailing list
Xen-api [at] lists
http://lists.xen.org/cgi-bin/mailman/listinfo/xen-api

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads