Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Linux Virtual Server: Users

[lvs-users] Fully disabling UDP "persistence"

 

 

Linux Virtual Server users RSS feed   Index | Next | Previous | View Threaded


chibi at gol

Apr 3, 2009, 12:12 AM

Post #1 of 3 (697 views)
Permalink
[lvs-users] Fully disabling UDP "persistence"

Hello,

LVS defines a UDP connection as packets coming from the same source IP
within a 5 minute window. Which I guess for services like NTP would be a
good thing[TM].
One can tune that down to 1 second with "ipvsadmin --set" and while this
will give a much better spread (or any spread at all, since with a packet
every 2 seconds on average here it never changed realservers with the
default) it still will stick with one realserver EXACTLY when you want it
to balance things most, at the most busy times.
This is for radius and if our last mile provider drops all of Tokyo in a
maintenance we get greeted with several 10000 auth-requests at the same
time. Precisely the time when sticking with one server is not what we
want.
So I presume the (in 2000) suggested UDP timeout=0 option never got
implemented, right?
And I guess using the NQ scheduler would not help in this situation either,
since the persistence happens before it can decide to route this to an
unused realserver, correct?

I guess an idea for the future would be a scheduler that is not connection
but packet oriented, this would provide me exactly with what I need for
this (admittedly special) case.

Oh and is there any other way than calling "ipvsadmin --set" to set those
timeout values in a persistent way? Feels a bit silly to write an
initscript just for this, but since these don't seem to be sysctl
variables...

Regards,

Christian
--
Christian Balzer Network/Systems Engineer NOC
chibi [at] gol Global OnLine Japan/Fusion Network Services
http://www.gol.com/
https://secure3.gol.com/mod-pl/ols/index.cgi/?intr_id=F-2ECXvzcr6656

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users


malcolm at loadbalancer

Apr 3, 2009, 1:26 AM

Post #2 of 3 (631 views)
Permalink
Re: [lvs-users] Fully disabling UDP "persistence" [In reply to]

Christian,

We use the OPS one packet scheduling patch for this....for people
using UDP SIP gateways.
can't remember where it is off the top of my head though.
give me a shout if you can't find it.




2009/4/3 Christian Balzer <chibi [at] gol>
>
> Hello,
>
> LVS defines a UDP connection as packets coming from the same source IP
> within a 5 minute window. Which I guess for services like NTP would be a
> good thing[TM].
> One can tune that down to 1 second with "ipvsadmin --set" and while this
> will give a much better spread (or any spread at all, since with a packet
> every 2 seconds on average here it never changed realservers with the
> default) it still will stick with one realserver EXACTLY when you want it
> to balance things most, at the most busy times.
> This is for radius and if our last mile provider drops all of Tokyo in a
> maintenance we get greeted with several 10000 auth-requests at the same
> time. Precisely the time when sticking with one server is not what we
> want.
> So I presume the (in 2000) suggested UDP timeout=0 option never got
> implemented, right?
> And I guess using the NQ scheduler would not help in this situation either,
> since the persistence happens before it can decide to route this to an
> unused realserver, correct?
>
> I guess an idea for the future would be a scheduler that is not connection
> but packet oriented, this would provide me exactly with what I need for
> this (admittedly special) case.
>
> Oh and is there any other way than calling "ipvsadmin --set" to set those
> timeout values in a persistent way? Feels a bit silly to write an
> initscript just for this, but since these don't seem to be sysctl
> variables...
>
> Regards,
>
> Christian
> --
> Christian Balzer        Network/Systems Engineer                NOC
> chibi [at] gol           Global OnLine Japan/Fusion Network Services
> http://www.gol.com/
> https://secure3.gol.com/mod-pl/ols/index.cgi/?intr_id=F-2ECXvzcr6656
>
> _______________________________________________
> Please read the documentation before posting - it's available at:
> http://www.linuxvirtualserver.org/
>
> LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
> Send requests to lvs-users-request [at] LinuxVirtualServer
> or go to http://lists.graemef.net/mailman/listinfo/lvs-users



--
Regards,

Malcolm Turnbull.

Loadbalancer.org Ltd.
Phone: +44 (0)870 443 8779
http://www.loadbalancer.org/

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users


chibi at gol

Apr 3, 2009, 2:36 AM

Post #3 of 3 (640 views)
Permalink
Re: [lvs-users] Fully disabling UDP "persistence" [In reply to]

Hello Malcom,

On Fri, 3 Apr 2009 09:26:10 +0100 Malcolm Turnbull wrote:
>
> We use the OPS one packet scheduling patch for this....for people
> using UDP SIP gateways.
> can't remember where it is off the top of my head though.
> give me a shout if you can't find it.
>

Ah yes, found it at:
http://www.austintek.com/LVS/LVS-HOWTO/HOWTO/LVS-HOWTO.UDP.html

Funnily enough the section:
22.4. Julian's One Packet Scheduler (OPS) forUDP, timeouts for DNS

starts with this sentence:
"Although UDP packets are connectionless and independant of each other, in
an LVS, consecutive packets from a client are sent to the same realserver, at least till a timeout or a packet count has been reached."
^^^^^^^^^^^^
Never read anything about a packet count based scheduler, could somebody
clue me in here or was that wishful thinking by the author? ^o^

The section goes on about how OPS could break RADIUS reply packets, but
since I'm using a DR based setup this should be a non-issue.

Regards,

Christian
--
Christian Balzer Network/Systems Engineer NOC
chibi [at] gol Global OnLine Japan/Fusion Network Services
http://www.gol.com/
https://secure3.gol.com/mod-pl/ols/index.cgi/?intr_id=F-2ECXvzcr6656

_______________________________________________
Please read the documentation before posting - it's available at:
http://www.linuxvirtualserver.org/

LinuxVirtualServer.org mailing list - lvs-users [at] LinuxVirtualServer
Send requests to lvs-users-request [at] LinuxVirtualServer
or go to http://lists.graemef.net/mailman/listinfo/lvs-users

Linux Virtual Server users RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.