Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Netapp: toasters

Throttling

 

 

Netapp toasters RSS feed   Index | Next | Previous | View Threaded


David.Ashton at rullion

Mar 30, 2009, 7:45 AM

Post #1 of 5 (1993 views)
Permalink
Throttling

Hi Toasters

We run our snapmirrors overnight mostly, to a DR site which just happens
to be a working office. Sometimes they're still running in the morning,
and they eat all the bandwidth. We throttle them in the snapmirror
management. We do this manually and its a pain and sometime we forget
etc.

What I'd like to do is (probably) script and schedule some SSH commands to
set the bandwidth throttle on the volumes so that they are restricted
during working hours, but open out of hours. Is there a global method of
doing this, or do I have configure each of my snapmirror vols separately?

Also, never actually scripted SSH before, I cant find any decent pointers,
is this a regular thing to do with filers?

Thanks
Dave Ashton

**********************************************************************
The information contained in this e-mail and any attachments are intended for the named recipient(s) only. It may also be privileged and confidential. If you are not an intended recipient, you must take no action as a result of receiving it, including, but not limited to copying, distributing and amending it. If this communication has been sent to you in error, please contact us immediately and do not show the communication to any other party.

Rullion shall have no liability whatsoever in respect of the content of the communication and makes no warranty as to accuracy. Any views or opinions presented are solely those of the author.

Viruses:- Although we have taken steps to ensure that this e-mail and attachments are free from viruses, we advise that in keeping with good computing practice, the recipient should ensure they are actually virus free.

**********************************************************************



________________________________________________________________________
This e-mail has been scanned for all viruses by Star. The
service is powered by MessageLabs. For more information on a proactive
anti-virus service working around the clock, around the globe, visit:
http://www.star.net.uk
________________________________________________________________________


romeotheriault at gmail

Mar 30, 2009, 8:31 AM

Post #2 of 5 (1893 views)
Permalink
Re: Throttling [In reply to]

>
> Is there a global method of doing this, or do I have configure each of my
> snapmirror vols separately?
>

According to the man page anyway, the snapmirror throttle command is on a
per volume basis.

Also, never actually scripted SSH before, I cant find any decent pointers,
> is this a regular thing to do with filers?
>

Yup, this is a standard thing for me anyway. Setting up ssh keys to gain
passwordless logins to the filers for scripting is also really useful. You
could also probably use the Netapp API to do this type of thing.

Another alternative that I though of after reading this tidbit of the
snapmirror throttle man page:


The new value will be used only for the current
> transfer. The next scheduled transfer will use the
> kbs value specified in the snapmirror.conf file. If
> the value for the kbs option in the snapmirror.conf
> is changed while transfer is going on, then the new
> value will take effect within two minutes.


Is that you could have a simple script which just changes all the throttle
values in the snapmirror.conf file at the time you want the values throttled
and sets them back when that timeframe is over.

Good luck,
Romeo


On Mon, Mar 30, 2009 at 11:45 PM, <David.Ashton [at] rullion> wrote:

>
> Hi Toasters
>
> We run our snapmirrors overnight mostly, to a DR site which just happens to
> be a working office. Sometimes they're still running in the morning, and
> they eat all the bandwidth. We throttle them in the snapmirror management.
> We do this manually and its a pain and sometime we forget etc.
>
> What I'd like to do is (probably) script and schedule some SSH commands to
> set the bandwidth throttle on the volumes so that they are restricted during
> working hours, but open out of hours. Is there a global method of doing
> this, or do I have configure each of my snapmirror vols separately?
>
> Also, never actually scripted SSH before, I cant find any decent pointers,
> is this a regular thing to do with filers?
>
> Thanks
> Dave Ashton
>
> **********************************************************************
>
> The information contained in this e-mail and any attachments are intended
> for the named recipient(s) only. It may also be privileged and confidential.
> If you are not an intended recipient, you must take no action as a result of
> receiving it, including, but not limited to copying, distributing and
> amending it. If this communication has been sent to you in error, please
> contact us immediately and do not show the communication to any other party.
>
>
>
>
> Rullion shall have no liability whatsoever in respect of the content of the
> communication and makes no warranty as to accuracy. Any views or opinions
> presented are solely those of the author.
>
>
>
> Viruses:- Although we have taken steps to ensure that this e-mail and
> attachments are free from viruses, we advise that in keeping with good
> computing practice, the recipient should ensure they are actually virus
> free.
>
>
>
> **********************************************************************
>
>
>
> ________________________________________________________________________
> This e-mail has been scanned for all viruses by Star. The
> service is powered by MessageLabs. For more information on a proactive
> anti-virus service working around the clock, around the globe, visit:
> http://www.star.net.uk
> ________________________________________________________________________
>



--
Romeo Theriault
System Administrator
Information Technology Services


jeremy.page at gilbarco

Mar 30, 2009, 8:53 AM

Post #3 of 5 (1888 views)
Permalink
RE: Throttling [In reply to]

Well you can do it on a per secondary basis as well, but that does not
solve the times. I've always used rsh to do this kind of stuff in the
past but the security implications scare me now.

________________________________

From: owner-toasters [at] mathworks [mailto:owner-toasters [at] mathworks]
On Behalf Of Romeo Theriault
Sent: Monday, March 30, 2009 11:32 AM
To: David.Ashton [at] rullion; toasters [at] mathworks
Subject: Re: Throttling



Is there a global method of doing this, or do I have configure
each of my snapmirror vols separately?


According to the man page anyway, the snapmirror throttle command is on
a per volume basis.

Also, never actually scripted SSH before, I cant find any decent
pointers, is this a regular thing to do with filers?


Yup, this is a standard thing for me anyway. Setting up ssh keys to gain
passwordless logins to the filers for scripting is also really useful.
You could also probably use the Netapp API to do this type of thing.

Another alternative that I though of after reading this tidbit of the
snapmirror throttle man page:



The new value will be used only for the current
transfer. The next scheduled transfer will use the
kbs value specified in the snapmirror.conf file. If
the value for the kbs option in the snapmirror.conf
is changed while transfer is going on, then the new
value will take effect within two minutes.


Is that you could have a simple script which just changes all the
throttle values in the snapmirror.conf file at the time you want the
values throttled and sets them back when that timeframe is over.

Good luck,
Romeo



On Mon, Mar 30, 2009 at 11:45 PM, <David.Ashton [at] rullion> wrote:


Hi Toasters

We run our snapmirrors overnight mostly, to a DR site which just happens
to be a working office. Sometimes they're still running in the morning,
and they eat all the bandwidth. We throttle them in the snapmirror
management. We do this manually and its a pain and sometime we forget
etc.

What I'd like to do is (probably) script and schedule some SSH commands
to set the bandwidth throttle on the volumes so that they are restricted
during working hours, but open out of hours. Is there a global method of
doing this, or do I have configure each of my snapmirror vols
separately?

Also, never actually scripted SSH before, I cant find any decent
pointers, is this a regular thing to do with filers?

Thanks
Dave Ashton

**********************************************************************

The information contained in this e-mail and any attachments are
intended for the named recipient(s) only. It may also be privileged and
confidential. If you are not an intended recipient, you must take no
action as a result of receiving it, including, but not limited to
copying, distributing and amending it. If this communication has been
sent to you in error, please contact us immediately and do not show the
communication to any other party.



Rullion shall have no liability whatsoever in respect of the content of
the communication and makes no warranty as to accuracy. Any views or
opinions presented are solely those of the author.



Viruses:- Although we have taken steps to ensure that this e-mail and
attachments are free from viruses, we advise that in keeping with good
computing practice, the recipient should ensure they are actually virus
free.



**********************************************************************




________________________________________________________________________
This e-mail has been scanned for all viruses by Star. The
service is powered by MessageLabs. For more information on a proactive
anti-virus service working around the clock, around the globe, visit:
http://www.star.net.uk
________________________________________________________________________




--
Romeo Theriault
System Administrator
Information Technology Services



Please be advised that this email may contain confidential information.
If you are not the intended recipient, please do not read, copy or
re-transmit this email. If you have received this email in error,
please notify us by email by replying to the sender and by telephone
(call us collect at +1 202-828-0850) and delete this message and any
attachments. Thank you in advance for your cooperation and assistance.

In addition, Danaher and its subsidiaries disclaim that the content of
this email constitutes an offer to enter into, or the acceptance of,
any
contract or agreement or any amendment thereto; provided that the
foregoing disclaimer does not invalidate the binding effect of any
digital or other electronic reproduction of a manual signature that is
included in any attachment to this email.


Simon.Gales at netapp

Mar 30, 2009, 5:02 PM

Post #4 of 5 (1914 views)
Permalink
RE: Throttling [In reply to]

Run "options replication", note that the values are kiloBYTES/second:

toaster> options replication
replication.throttle.enable off
replication.throttle.incoming.max_kbs unlimited
replication.throttle.outgoing.max_kbs unlimited

replication.throttle.enable
Enables global network throttling of snapmirror and snapvault transfers.
The default value for this options is off.

replication.throttle.incoming.max_kbs
This option specifies the maximum total bandwidth used by all the
incoming (applied at destination) snapmirror and snapvault transfers,
specified in kilobytes/sec. The default value for this option is
unlimited, which means there is no limit on total bandwidth used. This
option is valid only when the option replication.throttle.enable is on.

replication.throttle.outgoing.max_kbs
This option specifies the maximum total bandwidth used by all the
outgoing (applied at source) snapmirror and snapvault transfers
specified in kilobytes/sec. The default value for this option is
unlimited, which means there is no limit on total bandwidth used. This
option is valid only when the option replication.throttle.enable is on.

-Simon

________________________________

From: David.Ashton [at] rullion [mailto:David.Ashton [at] rullion]
Sent: Monday, March 30, 2009 9:46 AM
To: toasters [at] mathworks
Subject: Throttling



Hi Toasters

We run our snapmirrors overnight mostly, to a DR site which just happens
to be a working office. Sometimes they're still running in the morning,
and they eat all the bandwidth. We throttle them in the snapmirror
management. We do this manually and its a pain and sometime we forget
etc.

What I'd like to do is (probably) script and schedule some SSH commands
to set the bandwidth throttle on the volumes so that they are restricted
during working hours, but open out of hours. Is there a global method of
doing this, or do I have configure each of my snapmirror vols
separately?

Also, never actually scripted SSH before, I cant find any decent
pointers, is this a regular thing to do with filers?

Thanks
Dave Ashton


**********************************************************************

The information contained in this e-mail and any attachments are
intended for the named recipient(s) only. It may also be privileged and
confidential. If you are not an intended recipient, you must take no
action as a result of receiving it, including, but not limited to
copying, distributing and amending it. If this communication has been
sent to you in error, please contact us immediately and do not show the
communication to any other party.



Rullion shall have no liability whatsoever in respect of the content of
the communication and makes no warranty as to accuracy. Any views or
opinions presented are solely those of the author.



Viruses:- Although we have taken steps to ensure that this e-mail and
attachments are free from viruses, we advise that in keeping with good
computing practice, the recipient should ensure they are actually virus
free.



**********************************************************************




________________________________________________________________________
This e-mail has been scanned for all viruses by Star. The
service is powered by MessageLabs. For more information on a proactive
anti-virus service working around the clock, around the globe, visit:
http://www.star.net.uk
________________________________________________________________________


Andrey.Borzenkov at fujitsu-siemens

Mar 30, 2009, 10:15 PM

Post #5 of 5 (1870 views)
Permalink
RE: Throttling [In reply to]

Unfortunately there is no way to schedule throttling using NetApp built-in means; and that is what OP asked. And what I’m looking for BTW as well ☺ So far external scripting looks like the only solution; it’s possible that Protection Manager can do it, but it is overkill in my case.


С уважением / With best regards / Mit freundlichen Grüβen

---
Andrey Borzenkov
Senior system engineer

________________________________
From: owner-toasters [at] mathworks [mailto:owner-toasters [at] mathworks] On Behalf Of Gales, Simon
Sent: Tuesday, March 31, 2009 4:03 AM
To: toasters [at] mathworks
Cc: David.Ashton [at] rullion
Subject: RE: Throttling

Run "options replication", note that the values are kiloBYTES/second:

toaster> options replication
replication.throttle.enable off
replication.throttle.incoming.max_kbs unlimited
replication.throttle.outgoing.max_kbs unlimited

replication.throttle.enable
Enables global network throttling of snapmirror and snapvault transfers. The default value for this options is off.

replication.throttle.incoming.max_kbs
This option specifies the maximum total bandwidth used by all the incoming (applied at destination) snapmirror and snapvault transfers, specified in kilobytes/sec. The default value for this option is unlimited, which means there is no limit on total bandwidth used. This option is valid only when the option replication.throttle.enable is on.

replication.throttle.outgoing.max_kbs
This option specifies the maximum total bandwidth used by all the outgoing (applied at source) snapmirror and snapvault transfers specified in kilobytes/sec. The default value for this option is unlimited, which means there is no limit on total bandwidth used. This option is valid only when the option replication.throttle.enable is on.
-Simon

________________________________
From: David.Ashton [at] rullion [mailto:David.Ashton [at] rullion]
Sent: Monday, March 30, 2009 9:46 AM
To: toasters [at] mathworks
Subject: Throttling

Hi Toasters

We run our snapmirrors overnight mostly, to a DR site which just happens to be a working office. Sometimes they're still running in the morning, and they eat all the bandwidth. We throttle them in the snapmirror management. We do this manually and its a pain and sometime we forget etc.

What I'd like to do is (probably) script and schedule some SSH commands to set the bandwidth throttle on the volumes so that they are restricted during working hours, but open out of hours. Is there a global method of doing this, or do I have configure each of my snapmirror vols separately?

Also, never actually scripted SSH before, I cant find any decent pointers, is this a regular thing to do with filers?

Thanks
Dave Ashton

**********************************************************************

The information contained in this e-mail and any attachments are intended for the named recipient(s) only. It may also be privileged and confidential. If you are not an intended recipient, you must take no action as a result of receiving it, including, but not limited to copying, distributing and amending it. If this communication has been sent to you in error, please contact us immediately and do not show the communication to any other party.



Rullion shall have no liability whatsoever in respect of the content of the communication and makes no warranty as to accuracy. Any views or opinions presented are solely those of the author.



Viruses:- Although we have taken steps to ensure that this e-mail and attachments are free from viruses, we advise that in keeping with good computing practice, the recipient should ensure they are actually virus free.



**********************************************************************



________________________________________________________________________
This e-mail has been scanned for all viruses by Star. The
service is powered by MessageLabs. For more information on a proactive
anti-virus service working around the clock, around the globe, visit:
http://www.star.net.uk
________________________________________________________________________

Netapp toasters RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.