OpenStack without Floating IPs in Multi Host Setup

hi Vogl,

Are you planning to use nova-network or quantum?


On Fri, Aug 9, 2013 at 3:09 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
I'm currently wondering how to setup OpenStack without floating ips in a multi host setup.
Like outlined in the Operations Manual, Chapter 6. Network Design, „Fixed IP addresses can be private for private clouds, or public for public clouds.“ [1]
So you can easily create a publicly routable network and have VMs automatically allocate a single address from within this range. If you have more than one compute node they need to be within the same physical network - regardless of wether you are using multi host or a single networking node (nova-network or quantum).
If you define more than one fixed network, you'll end up with „multinic“ [2]. So it seems that's not possible to bind a specific fixed network to a compute node.

My question is… how do you avoid activating multinic and associate a fixed network with a specific compute node?



[1] http://docs.openstack.org/trunk/openstack-ops/content/network_design.html"]http://docs.openstack.org/trunk/openstack-ops/content/network_design.html [2] http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html"]http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html
--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832






_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack [at] lists
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

To use the network already there in your datacenter rather than creating a private network. You can trunk the vlans(you would like to use) on the switch port and connect it to the compute nodes. then defining the
vlan in openstack by nova network create --vlan id=(vlan id of the vlan on the switch)

And then they would be publiclly routable without any need for floating ips.

In this way you can horizontally scale up your compute nodes , just by adding a new port in switch in trunk mode for the vlans you would like.

Hope i am clear.


On Fri, Aug 9, 2013 at 3:29 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
I'm using nova-network due to the lack of multi host support in quantum.


--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832





On 09.08.2013, at 11:55, Ritesh Nanda <riteshnanda09 [at] gmail> wrote:

hi Vogl,

Are you planning to use nova-network or quantum?


On Fri, Aug 9, 2013 at 3:09 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
I'm currently wondering how to setup OpenStack without floating ips in a multi host setup.
Like outlined in the Operations Manual, Chapter 6. Network Design, „Fixed IP addresses can be private for private clouds, or public for public clouds.“ [1]
So you can easily create a publicly routable network and have VMs automatically allocate a single address from within this range. If you have more than one compute node they need to be within the same physical network - regardless of wether you are using multi host or a single networking node (nova-network or quantum).
If you define more than one fixed network, you'll end up with „multinic“ [2]. So it seems that's not possible to bind a specific fixed network to a compute node.

My question is… how do you avoid activating multinic and associate a fixed network with a specific compute node?



[1] http://docs.openstack.org/trunk/openstack-ops/content/network_design.html"]http://docs.openstack.org/trunk/openstack-ops/content/network_design.html [2] http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html"]http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html
--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832






_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack [at] lists
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

Hello ,

That is a interesting requirement i never encountered this type of requirement , I will try to create this type of network environment and try to find out solution , but setup you did till now, and create different projects with different networks using

nova network create --project-id might give you the solution but not complete according to your requirement.

So you will have one network in one tenant , and another in other tenant.


On Fri, Aug 9, 2013 at 7:21 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
thanks for your answer. But that does not solve my problem when I'm in different data centers.

Here's an example:

1. Compute Node A (Germany) Public Network for VMs: http://12.34.100.240/28"]12.34.100.240/28
# nova-manage network create --label node-A --fixed_range_v4 http://12.34.100.240/28"]12.34.100.240/28 --num_networks 1 --network_size 16 --vlan 100 --bridge br100 --bridge_interface eth0 --multi_host T

2. Compute Node B (USA) Public Network for VMs: http://88.99.155.240/28"]88.99.155.240/28
# nova-manage network create --label node-B --fixed_range_v4 http://88.99.155.240/28"] 88.99.155.240/28 --num_networks 1 --network_size 16 --vlan 101 --bridge br101 --bridge_interface eth0 --multi_host T


Alright… now I've two networks defined:
# nova-manage network list id IPv4 IPv6 start address DNS1 DNS2 VlanID project uuid 15 http://12.34.100.240/28"]12.34.100.240/28 None 12.34.100.243 8.8.4.4 None 100 260084798c454b7e9957c388ea06aea2 f340d99c-6319-4b20-93fa-19304125bc6f 21 http://88.99.155.240/28"]88.99.155.240/28 None 88.99.155.243 8.8.4.4 None 101 260084798c454b7e9957c388ea06aea2 d068ac21-61ad-4ecc-8eb8-ba1e110e046f


Now I want to start a VM on Compute Node A in Germany – but I gets two ip addresses. One of each network. That's not what I want.
So I tried assigning a network to a specific host:
# nova-manage network modify --host=node-A http://12.34.100.240/28"]12.34.100.240/28 # nova-manage network modify --host=node-B http://88.99.155.240/28"]88.99.155.240/28

But that has no effect...

Here's my config:
# Network
network_manager=nova.network.manager.VlanManager
firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver
multi_host=True

dhcpbridge=/usr/bin/nova-dhcpbridge
dhcpbridge_flagfile=/etc/nova/nova.conf
force_dhcp_release=True



--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832





On 09.08.2013, at 12:09, Ritesh Nanda <riteshnanda09 [at] gmail> wrote:

To use the network already there in your datacenter rather than creating a private network. You can trunk the vlans(you would like to use) on the switch port and connect it to the compute nodes. then defining the
vlan in openstack by nova network create --vlan id=(vlan id of the vlan on the switch)

And then they would be publiclly routable without any need for floating ips.

In this way you can horizontally scale up your compute nodes , just by adding a new port in switch in trunk mode for the vlans you would like.

Hope i am clear.


On Fri, Aug 9, 2013 at 3:29 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
I'm using nova-network due to the lack of multi host support in quantum.


--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832





On 09.08.2013, at 11:55, Ritesh Nanda <riteshnanda09 [at] gmail> wrote:

hi Vogl,

Are you planning to use nova-network or quantum?


On Fri, Aug 9, 2013 at 3:09 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
I'm currently wondering how to setup OpenStack without floating ips in a multi host setup.
Like outlined in the Operations Manual, Chapter 6. Network Design, „Fixed IP addresses can be private for private clouds, or public for public clouds.“ [1]
So you can easily create a publicly routable network and have VMs automatically allocate a single address from within this range. If you have more than one compute node they need to be within the same physical network - regardless of wether you are using multi host or a single networking node (nova-network or quantum).
If you define more than one fixed network, you'll end up with „multinic“ [2]. So it seems that's not possible to bind a specific fixed network to a compute node.

My question is… how do you avoid activating multinic and associate a fixed network with a specific compute node?



[1] http://docs.openstack.org/trunk/openstack-ops/content/network_design.html"]http://docs.openstack.org/trunk/openstack-ops/content/network_design.html [2] http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html"]http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html
--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832






_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack [at] lists
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

Got your question , I will give it a try today. Lets wait if someone else in community has tried this before.


On Fri, Aug 9, 2013 at 7:41 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
thanks for your answer. That won't work because this way a project may only have one compute node. As far as I understood you are suggesting to setup a 1:1 relation indirectively through a project grouping.
Let me ask my question in a different way:
How do I specify a specific fixed_range for a compute node to make sure that this range is only used on that node?

--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832





On 09.08.2013, at 16:08, Ritesh Nanda <riteshnanda09 [at] gmail> wrote:

Hello ,

That is a interesting requirement i never encountered this type of requirement , I will try to create this type of network environment and try to find out solution , but setup you did till now, and create different projects with different networks using

nova network create --project-id might give you the solution but not complete according to your requirement.

So you will have one network in one tenant , and another in other tenant.


On Fri, Aug 9, 2013 at 7:21 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
thanks for your answer. But that does not solve my problem when I'm in different data centers.

Here's an example:

1. Compute Node A (Germany) Public Network for VMs: http://12.34.100.240/28"]12.34.100.240/28
# nova-manage network create --label node-A --fixed_range_v4 http://12.34.100.240/28"]12.34.100.240/28 --num_networks 1 --network_size 16 --vlan 100 --bridge br100 --bridge_interface eth0 --multi_host T

2. Compute Node B (USA) Public Network for VMs: http://88.99.155.240/28"]88.99.155.240/28
# nova-manage network create --label node-B --fixed_range_v4 http://88.99.155.240/28"] 88.99.155.240/28 --num_networks 1 --network_size 16 --vlan 101 --bridge br101 --bridge_interface eth0 --multi_host T


Alright… now I've two networks defined:
# nova-manage network list id IPv4 IPv6 start address DNS1 DNS2 VlanID project uuid 15 http://12.34.100.240/28"]12.34.100.240/28 None 12.34.100.243 8.8.4.4 None 100 260084798c454b7e9957c388ea06aea2 f340d99c-6319-4b20-93fa-19304125bc6f 21 http://88.99.155.240/28"]88.99.155.240/28 None 88.99.155.243 8.8.4.4 None 101 260084798c454b7e9957c388ea06aea2 d068ac21-61ad-4ecc-8eb8-ba1e110e046f


Now I want to start a VM on Compute Node A in Germany – but I gets two ip addresses. One of each network. That's not what I want.
So I tried assigning a network to a specific host:
# nova-manage network modify --host=node-A http://12.34.100.240/28"]12.34.100.240/28 # nova-manage network modify --host=node-B http://88.99.155.240/28"]88.99.155.240/28

But that has no effect...

Here's my config:
# Network
network_manager=nova.network.manager.VlanManager
firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver
multi_host=True

dhcpbridge=/usr/bin/nova-dhcpbridge
dhcpbridge_flagfile=/etc/nova/nova.conf
force_dhcp_release=True



--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832





On 09.08.2013, at 12:09, Ritesh Nanda <riteshnanda09 [at] gmail> wrote:

To use the network already there in your datacenter rather than creating a private network. You can trunk the vlans(you would like to use) on the switch port and connect it to the compute nodes. then defining the
vlan in openstack by nova network create --vlan id=(vlan id of the vlan on the switch)

And then they would be publiclly routable without any need for floating ips.

In this way you can horizontally scale up your compute nodes , just by adding a new port in switch in trunk mode for the vlans you would like.

Hope i am clear.


On Fri, Aug 9, 2013 at 3:29 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
I'm using nova-network due to the lack of multi host support in quantum.


--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832





On 09.08.2013, at 11:55, Ritesh Nanda <riteshnanda09 [at] gmail> wrote:

hi Vogl,

Are you planning to use nova-network or quantum?


On Fri, Aug 9, 2013 at 3:09 PM, Vogl, Yves <vogl [at] adesso-mobile> wrote:

Hi,
I'm currently wondering how to setup OpenStack without floating ips in a multi host setup.
Like outlined in the Operations Manual, Chapter 6. Network Design, „Fixed IP addresses can be private for private clouds, or public for public clouds.“ [1]
So you can easily create a publicly routable network and have VMs automatically allocate a single address from within this range. If you have more than one compute node they need to be within the same physical network - regardless of wether you are using multi host or a single networking node (nova-network or quantum).
If you define more than one fixed network, you'll end up with „multinic“ [2]. So it seems that's not possible to bind a specific fixed network to a compute node.

My question is… how do you avoid activating multinic and associate a fixed network with a specific compute node?



[1] http://docs.openstack.org/trunk/openstack-ops/content/network_design.html"]http://docs.openstack.org/trunk/openstack-ops/content/network_design.html [2] http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html"]http://docs.openstack.org/trunk/openstack-compute/admin/content/using-multi-nics.html
--
Mit freundlichen Grüßen
Yves Vogl

<banner_signatur_dmexco2013_625x77.jpg>

adesso mobile solutions GmbH Yves Vogl
Leiter IT Operations Freie-Vogel-Str. 391 | 44269 Dortmund T &#43;49 231 930 9379 | F &#43;49 231 930 9317 | Mail: vogl [at] adesso-mobile | Web: http://www.adesso-mobile.de/"]www.adesso-mobile.de | Mobil-Web: http://adesso-mobile.mobi/"]adesso-mobile.mobi
Vertretungsberechtigte Geschäftsführer: Dr. Josef Brewing, Frank Dobelmann Registergericht: Amtsgericht Dortmund Registernummer: HRB 13763 Umsatzsteuer-Identifikationsnummer gemäß § 27 a Umsatzsteuergesetz: DE201541832






_______________________________________________
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack [at] lists
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack"] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]

--
With Regards
Ritesh Nanda



http://www.ericsson.com/"]