Mailing List Archive: Linux Virtual Server: Users

[lvs-users] LVS-DR capacity planning

Index | Next | Previous | View Threaded

lvslist at gmail

Jan 24, 2011, 2:41 PM

Post #1 of 15 (1767 views)
Permalink

[lvs-users] LVS-DR capacity planning

Hey Guys -

I am working on some capacity planning for our organization and am having a
little trouble finding information on how well LVS scales. We are currently
running multiple lvs lbs pairs all running keepalived . On our bigger
clusters we are currently doing about 750m queries a day and we are trying
to get a handle on how much more growth we can expect them to handle. Does
anyone know where I can find some information on capacity planning with
regards to LVS? How much traffic/connections can we expect to push through
a single load balancer? We are running everything in DR mode. I have read
the howto but the latest information is in the performance section seems a
bit dated. Are any of you currently running lvs in this type of
environment? If so how did you estimate the load balancers capacity?

Thanks

Micah
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

malcolm at loadbalancer

Jan 25, 2011, 9:51 AM

Post #2 of 15 (1713 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

Micah,

No one seems to have answered this so I'll go with:

"Saturating a gigabit pipe is pretty easy for any recent
CPU/Motherboard when in DR mode."

So I don't see you hitting any problems.

On 24 January 2011 22:41, lvs list <lvslist [at] gmail> wrote:
>
> Hey Guys -
>

>
> We are running everything in DR mode. I have read
> the howto but the latest information is in the performance section seems a
> bit dated. Are any of you currently running lvs in this type of
> environment? If so how did you estimate the load balancers capacity?
>
> Thanks
>
> Micah

--

Regards,

Malcolm Turnbull.

Loadbalancer.org Ltd.
Phone: +44 (0)870 443 8779
http://www.loadbalancer.org/

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

horms at verge

Jan 25, 2011, 4:13 PM

Post #3 of 15 (1696 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Tue, Jan 25, 2011 at 05:51:21PM +0000, Malcolm Turnbull wrote:
> Micah,
>
> No one seems to have answered this so I'll go with:
>
> "Saturating a gigabit pipe is pretty easy for any recent
> CPU/Motherboard when in DR mode."
>
> So I don't see you hitting any problems.

I am also not aware of any recent numbers.
But it would be nice if we could get some numbers, somehow.

Perhaps someone could donate some time and/or time on some equipment
to come up with some numbers.

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

jmack at wm7d

Jan 25, 2011, 5:39 PM

Post #4 of 15 (1693 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Wed, 26 Jan 2011, Simon Horman wrote:

> I am also not aware of any recent numbers. But it would be
> nice if we could get some numbers, somehow.

I expect it's the same as it was with 100MBps; you can't
measure any slowdown by LVS relative to the director as a
regular router. All the buses have increased in speed by
about the same amount, so all hardware has kept
approximately in step. So I expect you'll still get the same
speed as the director acting as a router.

Joe

--
Joseph Mack NA3T EME(B,D), FM05lw North Carolina
jmack (at) wm7d (dot) net - azimuthal equidistant map
generator at http://www.wm7d.net/azproj.shtml
Homepage http://www.austintek.com/ It's GNU/Linux!

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

horms at verge

Jan 25, 2011, 6:07 PM

Post #5 of 15 (1696 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Tue, Jan 25, 2011 at 05:39:50PM -0800, Joseph Mack NA3T wrote:
> On Wed, 26 Jan 2011, Simon Horman wrote:
>
> > I am also not aware of any recent numbers. But it would be
> > nice if we could get some numbers, somehow.
>
> I expect it's the same as it was with 100MBps; you can't
> measure any slowdown by LVS relative to the director as a
> regular router. All the buses have increased in speed by
> about the same amount, so all hardware has kept
> approximately in step. So I expect you'll still get the same
> speed as the director acting as a router.

That sounds like a good first approximation.
But it would still be nice to get some numbers... someehow...

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

lvslist at gmail

Jan 26, 2011, 12:05 PM

Post #6 of 15 (1687 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

Thanks for all the input guys..

are there any factors limiting connections per second, active connections
etc..? On a newer multi-core box with 4gb ram and 32bit os for example how
many connections per second, packets per second etc.. could one expect?
What are the factors used to determine these values?

Micah

On Tue, Jan 25, 2011 at 6:39 PM, Joseph Mack NA3T <jmack [at] wm7d> wrote:

> On Wed, 26 Jan 2011, Simon Horman wrote:
>
> > I am also not aware of any recent numbers. But it would be
> > nice if we could get some numbers, somehow.
>
> I expect it's the same as it was with 100MBps; you can't
> measure any slowdown by LVS relative to the director as a
> regular router. All the buses have increased in speed by
> about the same amount, so all hardware has kept
> approximately in step. So I expect you'll still get the same
> speed as the director acting as a router.
>
> Joe
>
> --
> Joseph Mack NA3T EME(B,D), FM05lw North Carolina
> jmack (at) wm7d (dot) net - azimuthal equidistant map
> generator at http://www.wm7d.net/azproj.shtml
> Homepage http://www.austintek.com/ It's GNU/Linux!
>
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
> Send requests to lvs-users-request [at] LinuxVirtualServer
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

michael at epoch

Jan 26, 2011, 11:37 PM

Post #7 of 15 (1682 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

My wild guess is that a quad CPU server with LVS will drop to their knees 10
http servers before you'll even notice of any load on the LVS :)

--------------------------------------------------
Michael Ben-Nes - Internet Consultant and Director.
http://www.epoch.co.il - weaving the Net.
Cellular: 054-4848113
--------------------------------------------------

On Wed, Jan 26, 2011 at 10:05 PM, lvs list <lvslist [at] gmail> wrote:

> Thanks for all the input guys..
>
> are there any factors limiting connections per second, active connections
> etc..? On a newer multi-core box with 4gb ram and 32bit os for example how
> many connections per second, packets per second etc.. could one expect?
> What are the factors used to determine these values?
>
> Micah
>
>
> On Tue, Jan 25, 2011 at 6:39 PM, Joseph Mack NA3T <jmack [at] wm7d> wrote:
>
> > On Wed, 26 Jan 2011, Simon Horman wrote:
> >
> > > I am also not aware of any recent numbers. But it would be
> > > nice if we could get some numbers, somehow.
> >
> > I expect it's the same as it was with 100MBps; you can't
> > measure any slowdown by LVS relative to the director as a
> > regular router. All the buses have increased in speed by
> > about the same amount, so all hardware has kept
> > approximately in step. So I expect you'll still get the same
> > speed as the director acting as a router.
> >
> > Joe
> >
> > --
> > Joseph Mack NA3T EME(B,D), FM05lw North Carolina
> > jmack (at) wm7d (dot) net - azimuthal equidistant map
> > generator at http://www.wm7d.net/azproj.shtml
> > Homepage http://www.austintek.com/ It's GNU/Linux!
> >
> > _______________________________________________
> > Please read the documentation before posting - it's available at:
> > http://www.linuxvirtualserver.org/
> >
> > LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
> > Send requests to lvs-users-request [at] LinuxVirtualServer
> > or go to http://lists.graemef.net/mailman/listinfo/lvs-users
> >
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
> Send requests to lvs-users-request [at] LinuxVirtualServer
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

malcolm at loadbalancer

Jan 27, 2011, 2:47 AM

Post #8 of 15 (1669 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

Simon,

We've just ordered 4 servers and a gigabit switch to try and do exctly
this kind of testing.
If anyone has sugestions about a good/simple way of generating the
load and graphing it that would be appreciated.

We did use Avalanche/reflector setup a while back on LVS with a 2.8GHz
Celeron and we got:
840MB throughput on large packets
50,000 TPS on small packets
It was using a small amount of keepalive (we were mimicking a
documented coyote point/F5 test).

On 26 January 2011 00:13, Simon Horman <horms [at] verge> wrote:
>
> On Tue, Jan 25, 2011 at 05:51:21PM +0000, Malcolm Turnbull wrote:
> > Micah,
> >
> > No one seems to have answered this so I'll go with:
> >
> > "Saturating a gigabit pipe is pretty easy for any recent
> > CPU/Motherboard when in DR mode."
> >
> > So I don't see you hitting any problems.
>
> I am also not aware of any recent numbers.
> But it would be nice if we could get some numbers, somehow.
>
> Perhaps someone could donate some time and/or time on some equipment
> to come up with some numbers.
>

--
Regards,

Malcolm Turnbull.

Loadbalancer.org Ltd.
Phone: +44 (0)870 443 8779
http://www.loadbalancer.org/

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

misch at clusterbau

Jan 27, 2011, 3:13 AM

Post #9 of 15 (1677 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Thursday 27 January 2011 11:47:07 Malcolm Turnbull wrote:
> Simon,
>
> We've just ordered 4 servers and a gigabit switch to try and do exctly
> this kind of testing.
> If anyone has sugestions about a good/simple way of generating the
> load and graphing it that would be appreciated.

Hi,

perhaps the test would make more sense with a 10 GBit switch if you can
saturate a 1 GBit switch with the old Celeron.

--
Dr. Michael Schwartzkopff
Guardinistr. 63
81375 München

Tel: (0163) 172 50 98

Attachments:

signature.asc (0.19 KB)

sagar3march at gmail

Jan 27, 2011, 4:21 AM

Post #10 of 15 (1670 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

Respected Sir,
I have configured the ktcpvs according to the instruction given
in README file for html and images but it is not working..
Please give me your guiide.

On Thu, Jan 27, 2011 at 4:43 PM, Michael Schwartzkopff <misch [at] clusterbau
> wrote:

> On Thursday 27 January 2011 11:47:07 Malcolm Turnbull wrote:
> > Simon,
> >
> > We've just ordered 4 servers and a gigabit switch to try and do exctly
> > this kind of testing.
> > If anyone has sugestions about a good/simple way of generating the
> > load and graphing it that would be appreciated.
>
> Hi,
>
> perhaps the test would make more sense with a 10 GBit switch if you can
> saturate a 1 GBit switch with the old Celeron.
>
> --
> Dr. Michael Schwartzkopff
> Guardinistr. 63
> 81375 München
>
> Tel: (0163) 172 50 98
>
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
> Send requests to lvs-users-request [at] LinuxVirtualServer
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users
>
_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

jmack at wm7d

Jan 27, 2011, 4:22 AM

Post #11 of 15 (1667 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Thu, 27 Jan 2011, Malcolm Turnbull wrote:

> Simon,
>
> We've just ordered 4 servers and a gigabit switch to try and do exctly
> this kind of testing.
> If anyone has sugestions about a good/simple way of generating the
> load and graphing it that would be appreciated.

I used netpipe back in 2000

http://www.austintek.com/LVS/performance/

The only problem with netpipe is that you can only setup one
connection at a time. This was fine to test the
director/realserver to its network limit, but you can't test
LVS running multiple connections

Joe

--
Joseph Mack NA3T EME(B,D), FM05lw North Carolina
jmack (at) wm7d (dot) net - azimuthal equidistant map
generator at http://www.wm7d.net/azproj.shtml
Homepage http://www.austintek.com/ It's GNU/Linux!

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

misch at clusterbau

Jan 27, 2011, 4:28 AM

Post #12 of 15 (1675 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Thursday 27 January 2011 13:21:41 sagar patil wrote:
> Respected Sir,
> I have configured the ktcpvs according to the instruction given
> in README file for html and images but it is not working..
> Please give me your guiide.

DO NOT hijack this tread. Open a new one.

--
Dr. Michael Schwartzkopff
Guardinistr. 63
81375 München

Tel: (0163) 172 50 98

Attachments:

signature.asc (0.19 KB)

horms at verge

Jan 27, 2011, 6:41 AM

Post #13 of 15 (1666 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Thu, Jan 27, 2011 at 04:22:49AM -0800, Joseph Mack NA3T wrote:
> On Thu, 27 Jan 2011, Malcolm Turnbull wrote:
>
> > Simon,
> >
> > We've just ordered 4 servers and a gigabit switch to try and do exctly
> > this kind of testing.
> > If anyone has sugestions about a good/simple way of generating the
> > load and graphing it that would be appreciated.
>
> I used netpipe back in 2000
>
> http://www.austintek.com/LVS/performance/
>
> The only problem with netpipe is that you can only setup one
> connection at a time. This was fine to test the
> director/realserver to its network limit, but you can't test
> LVS running multiple connections

Hi Malcolm, Hi Joe,

The last time that I did some micro-benchmarking of LVS I found Julian's
lvs-test to be of use. http://www.ssi.bg/~ja/

More generally, when doing network benchmarking I find netperf to be very
useful. Though most of my work using netperf has been for single streams,
which is not particularly exciting in the context of LVS.

The in-kernel packet generator is also interesting, though I don't recall
ever getting particularly useful benchmarks out of using it.

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

jmack at wm7d

Jan 27, 2011, 7:06 AM

Post #14 of 15 (1661 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Fri, 28 Jan 2011, Simon Horman wrote:

> The last time that I did some micro-benchmarking of LVS I
> found Julian's lvs-test to be of use.
> http://www.ssi.bg/~ja/

I didn't understand how this works. It fires small packets
(0?, 1?) bytes and doesn't listen for a reply. I got
enormous numbers for the throughput, more that I could
account for being allowed over a 100Mbps link.

> More generally, when doing network benchmarking I find
> netperf to be very useful.

have never used it. I should go figure out what it does

Joe

--
Joseph Mack NA3T EME(B,D), FM05lw North Carolina
jmack (at) wm7d (dot) net - azimuthal equidistant map
generator at http://www.wm7d.net/azproj.shtml
Homepage http://www.austintek.com/ It's GNU/Linux!

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

graeme at graemef

Jan 27, 2011, 7:06 AM

Post #15 of 15 (1666 views)
Permalink

Re: [lvs-users] LVS-DR capacity planning [In reply to]

On Thu, 2011-01-27 at 10:47 +0000, Malcolm Turnbull wrote:
> We've just ordered 4 servers and a gigabit switch to try and do exctly
> this kind of testing.
> If anyone has sugestions about a good/simple way of generating the
> load and graphing it that would be appreciated.

http://www.opensourcetesting.org/performance.php

I would suggest that http://curl-loader.sourceforge.net/ would be a good
one to start with. I was going to suggest Ixia's IxLoad, but that
requires Very Expensive Hardware from Ixia themselves. It's very good
(it should be at what they charge!) but the cost for a small test of
this type is likely prohibitive.

curl-loader actually positions itself as an alternative to IxLoad,
anyway.

Graeme

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads