Mailing List Archive: Netapp: toasters

Removing a shelf.

Index | Next | Previous | View Threaded

rvandolson at esri

Nov 13, 2008, 12:31 PM

Post #1 of 19 (3773 views)
Permalink

Removing a shelf.

Hi all;

We have a loaner NetApp that has three shelves on it. One of those
shelves needs to be returned to the vendor.

An aggregate spans two shelves, one of which is the shelf that needs to
be returned. This aggregate contains a FlexVol currently in use. I'd
like to preserve the FlexVol but remove the shelf.

What are my options? Doesn't look like I can shrink an aggregate. Is
my best bet to shut down everything usin the FlexVol, then vol copy it
to another aggregate, destroy the original aggregate, remove the shelf
and then recreate the aggregate again?

Thanks in advance!
Ray

bacardicoke at gmail

Nov 13, 2008, 1:16 PM

Post #2 of 19 (3666 views)
Permalink

Re: Removing a shelf. [In reply to]

Hey Ray,

On Thu, Nov 13, 2008 at 9:31 PM, Ray Van Dolson <rvandolson [at] esri> wrote:
>
> An aggregate spans two shelves, one of which is the shelf that needs to
> be returned. This aggregate contains a FlexVol currently in use. I'd
> like to preserve the FlexVol but remove the shelf.

If you can afford the downtime, you could offline the aggregate
concerned, swap the disks into the shelf that can remain, and online
the aggregate again. Should be a few minutes.

Another way, which does take a lot longer, is to use "disk replace" to
copy the used disks from their old position to their new ones. No
downtime, but the disks get copied one at a time, which can be a few
hours.

HTH & HAND

--
Simple guidelines to happiness:
Work like you don't need the money,
Love like your heart has never been broken and
Dance like no one can see you.

nick at nicholasbernstein

Nov 13, 2008, 1:45 PM

Post #3 of 19 (3675 views)
Permalink

Re: Removing a shelf. [In reply to]

On 11/13/08 1:16 PM, "Nils Vogels" <bacardicoke [at] gmail> wrote:

> Hey Ray,
>
> On Thu, Nov 13, 2008 at 9:31 PM, Ray Van Dolson <rvandolson [at] esri> wrote:
>>
>> An aggregate spans two shelves, one of which is the shelf that needs to
>> be returned. This aggregate contains a FlexVol currently in use. I'd
>> like to preserve the FlexVol but remove the shelf.
>
> If you can afford the downtime, you could offline the aggregate
> concerned, swap the disks into the shelf that can remain, and online
> the aggregate again. Should be a few minutes.

"aggr status -r" will show you the disks in the aggregate btw.

--
Nicholas Bernstein
Technologist, Consultant, Instructor
http://nicholasbernstein.com

dleeds at edmunds

Nov 13, 2008, 2:19 PM

Post #4 of 19 (3673 views)
Permalink

RE: Removing a shelf. [In reply to]

we have done the "disk replace" method mentioned and it worked without a flaw. it took a few weeks but we actually were able to remove 6 physical
shelves with no downtime other than a planned cf takeover->uncable loops of unused shelves->cf giveback.

--
Daniel Leeds
Manager, Storage Operations
Edmunds, Inc.
1620 26th Street, Suite 400 South
Santa Monica, CA 90404

310-309-4999 desk
310-430-0536 cell

-----Original Message-----
From: owner-toasters [at] mathworks on behalf of Nils Vogels
Sent: Thu 11/13/2008 1:16 PM
To: Ray Van Dolson
Cc: toasters [at] mathworks
Subject: Re: Removing a shelf.

Hey Ray,

On Thu, Nov 13, 2008 at 9:31 PM, Ray Van Dolson <rvandolson [at] esri> wrote:
>
> An aggregate spans two shelves, one of which is the shelf that needs to
> be returned. This aggregate contains a FlexVol currently in use. I'd
> like to preserve the FlexVol but remove the shelf.

If you can afford the downtime, you could offline the aggregate
concerned, swap the disks into the shelf that can remain, and online
the aggregate again. Should be a few minutes.

Another way, which does take a lot longer, is to use "disk replace" to
copy the used disks from their old position to their new ones. No
downtime, but the disks get copied one at a time, which can be a few
hours.

HTH & HAND

--
Simple guidelines to happiness:
Work like you don't need the money,
Love like your heart has never been broken and
Dance like no one can see you.

dleeds at edmunds

Nov 13, 2008, 3:03 PM

Post #5 of 19 (3673 views)
Permalink

RE: Removing a shelf. [In reply to]

yes, i neglected to mention we did a clean shutdown shortly after. this was coordinated as a way to fix an urgent need which it sounded like the original poster had in regards to sending a loaner shelf back.

it did function fine without any issues until an approved downtime window could be scheduled.

in most of our environments we have zero ability for any downtime scheduled or otherwise which is really killing us with a current shelf bug causing drives to randomly go amber and support recommends power cycling the shelf to correct it + updated firmware--but thats a whole other story.

--daniel

--
Daniel Leeds
Manager, Storage Operations
Edmunds, Inc.
1620 26th Street, Suite 400 South
Santa Monica, CA 90404

310-309-4999 desk
310-430-0536 cell

-----Original Message-----
From: Jeff Mohler [mailto:speedtoys.racing [at] gmail]
Sent: Thu 11/13/2008 3:01 PM
To: Leeds, Daniel
Cc: Nils Vogels; Ray Van Dolson; toasters [at] mathworks
Subject: Re: Removing a shelf.

Daniel:

I would check with support, IIRC, hot removing a shelf is _really_
frowned upon, and can cause mapping issues that can lead to
_requiring_ you to power down all nodes and shelves to correct.

Even in failover mode, shelf mapping is persistent.

https://now.netapp.com/Knowledgebase/solutionarea.asp?id=kb40710

> Daniel Leeds
> Manager, Storage Operations
> Edmunds, Inc.
> 1620 26th Street, Suite 400 South
> Santa Monica, CA 90404
>
> 310-309-4999 desk
> 310-430-0536 cell
>
>
>
> -----Original Message-----
> From: owner-toasters [at] mathworks on behalf of Nils Vogels
> Sent: Thu 11/13/2008 1:16 PM
> To: Ray Van Dolson
> Cc: toasters [at] mathworks
> Subject: Re: Removing a shelf.
>
> Hey Ray,
>
> On Thu, Nov 13, 2008 at 9:31 PM, Ray Van Dolson <rvandolson [at] esri> wrote:
>>
>> An aggregate spans two shelves, one of which is the shelf that needs to
>> be returned. This aggregate contains a FlexVol currently in use. I'd
>> like to preserve the FlexVol but remove the shelf.
>
> If you can afford the downtime, you could offline the aggregate
> concerned, swap the disks into the shelf that can remain, and online
> the aggregate again. Should be a few minutes.
>
> Another way, which does take a lot longer, is to use "disk replace" to
> copy the used disks from their old position to their new ones. No
> downtime, but the disks get copied one at a time, which can be a few
> hours.
>
> HTH & HAND
>
> --
> Simple guidelines to happiness:
> Work like you don't need the money,
> Love like your heart has never been broken and
> Dance like no one can see you.
>
>

dleeds at edmunds

Nov 13, 2008, 3:36 PM

Post #6 of 19 (3678 views)
Permalink

RE: Removing a shelf. [In reply to]

you are 100% correct. the ability to hot-remove shelves that contain no data would be an incredible value gain. we are currently migrating into a multistore scenario in which we can do planned migrations of all data from one filer cluster to another and free up the original filer for maintenance tasks without any extended downtime or change to the clients in our NFS environments.

this is the next best thing while GX merges back into the current 7.x base down the road. we get planned maintenance windows of one hour or less and the ability to run environments without change on a different set of filer heads. ontap upgrades, hardware swaps, environment migrations much less painful and actually doable at this point. we have tons of 72/144gb drives to swap out before their support expiry in 2011 :)

good luck to the OP.

--
Daniel Leeds
Manager, Storage Operations
Edmunds, Inc.
1620 26th Street, Suite 400 South
Santa Monica, CA 90404

310-309-4999 desk
310-430-0536 cell

-----Original Message-----
From: Jeff Mohler [mailto:speedtoys.racing [at] gmail]
Sent: Thu 11/13/2008 3:27 PM
To: Leeds, Daniel
Cc: Nils Vogels; Ray Van Dolson; toasters [at] mathworks
Subject: Re: Removing a shelf.

If youre not so lucky, you can lose visibility to an entire random
shelf on the system, forcing the rebuild of X missing drives.

I have seen this happen, and after a hard shutdown of all devices to
re-map the loops, it all comes back, but you're still stuck rebuilding
missing drives from the unsupported pull.

On Thu, Nov 13, 2008 at 3:03 PM, Leeds, Daniel <dleeds [at] edmunds> wrote:
>
> yes, i neglected to mention we did a clean shutdown shortly after. this was
> coordinated as a way to fix an urgent need which it sounded like the
> original poster had in regards to sending a loaner shelf back.
>
> it did function fine without any issues until an approved downtime window
> could be scheduled.
>
> in most of our environments we have zero ability for any downtime scheduled
> or otherwise which is really killing us with a current shelf bug causing
> drives to randomly go amber and support recommends power cycling the shelf
> to correct it + updated firmware--but thats a whole other story.
>
> --daniel
>
> --
> Daniel Leeds
> Manager, Storage Operations
> Edmunds, Inc.
> 1620 26th Street, Suite 400 South
> Santa Monica, CA 90404
>
> 310-309-4999 desk
> 310-430-0536 cell
>
>
>
> -----Original Message-----
> From: Jeff Mohler [mailto:speedtoys.racing [at] gmail]
> Sent: Thu 11/13/2008 3:01 PM
> To: Leeds, Daniel
> Cc: Nils Vogels; Ray Van Dolson; toasters [at] mathworks
> Subject: Re: Removing a shelf.
>
> Daniel:
>
> I would check with support, IIRC, hot removing a shelf is _really_
> frowned upon, and can cause mapping issues that can lead to
> _requiring_ you to power down all nodes and shelves to correct.
>
> Even in failover mode, shelf mapping is persistent.
>
> https://now.netapp.com/Knowledgebase/solutionarea.asp?id=kb40710
>
>
>
>
>
>
>> Daniel Leeds
>> Manager, Storage Operations
>> Edmunds, Inc.
>> 1620 26th Street, Suite 400 South
>> Santa Monica, CA 90404
>>
>> 310-309-4999 desk
>> 310-430-0536 cell
>>
>>
>>
>> -----Original Message-----
>> From: owner-toasters [at] mathworks on behalf of Nils Vogels
>> Sent: Thu 11/13/2008 1:16 PM
>> To: Ray Van Dolson
>> Cc: toasters [at] mathworks
>> Subject: Re: Removing a shelf.
>>
>> Hey Ray,
>>
>> On Thu, Nov 13, 2008 at 9:31 PM, Ray Van Dolson <rvandolson [at] esri>
>> wrote:
>>>
>>> An aggregate spans two shelves, one of which is the shelf that needs to
>>> be returned. This aggregate contains a FlexVol currently in use. I'd
>>> like to preserve the FlexVol but remove the shelf.
>>
>> If you can afford the downtime, you could offline the aggregate
>> concerned, swap the disks into the shelf that can remain, and online
>> the aggregate again. Should be a few minutes.
>>
>> Another way, which does take a lot longer, is to use "disk replace" to
>> copy the used disks from their old position to their new ones. No
>> downtime, but the disks get copied one at a time, which can be a few
>> hours.
>>
>> HTH & HAND
>>
>> --
>> Simple guidelines to happiness:
>> Work like you don't need the money,
>> Love like your heart has never been broken and
>> Dance like no one can see you.
>>
>>
>
>

rvandolson at esri

Nov 14, 2008, 9:43 AM

Post #7 of 19 (3648 views)
Permalink

Re: Removing a shelf. [In reply to]

On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:
> Hi all;
>
> We have a loaner NetApp that has three shelves on it. One of those
> shelves needs to be returned to the vendor.
>
> An aggregate spans two shelves, one of which is the shelf that needs to
> be returned. This aggregate contains a FlexVol currently in use. I'd
> like to preserve the FlexVol but remove the shelf.
>
> What are my options? Doesn't look like I can shrink an aggregate. Is
> my best bet to shut down everything usin the FlexVol, then vol copy it
> to another aggregate, destroy the original aggregate, remove the shelf
> and then recreate the aggregate again?
>
> Thanks in advance!
> Ray
>

Thanks all for the response.

It's only a 512GB (SIS enabled) volume, so I created a new volume on
the other aggregate and am using vol copy to copy the data over. This
seems incredibly slow (it's estimating two hours to complete) -- I
thought it might be a little quicker since there is only about 130GB of
data on the volume.

Gotta figure out how to up the concurrent login limit on the filer as
well, can't even fire up another console to stop the copy if I wanted
to! :)

Thanks,
Ray

jack1729 at gmail

Nov 14, 2008, 10:33 AM

Post #8 of 19 (3655 views)
Permalink

Re: Removing a shelf. [In reply to]

You can get access to the console through the rlm port.

On 11/14/08, Ray Van Dolson <rvandolson [at] esri> wrote:
> On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:
>> Hi all;
>>
>> We have a loaner NetApp that has three shelves on it. One of those
>> shelves needs to be returned to the vendor.
>>
>> An aggregate spans two shelves, one of which is the shelf that needs to
>> be returned. This aggregate contains a FlexVol currently in use. I'd
>> like to preserve the FlexVol but remove the shelf.
>>
>> What are my options? Doesn't look like I can shrink an aggregate. Is
>> my best bet to shut down everything usin the FlexVol, then vol copy it
>> to another aggregate, destroy the original aggregate, remove the shelf
>> and then recreate the aggregate again?
>>
>> Thanks in advance!
>> Ray
>>
>
> Thanks all for the response.
>
> It's only a 512GB (SIS enabled) volume, so I created a new volume on
> the other aggregate and am using vol copy to copy the data over. This
> seems incredibly slow (it's estimating two hours to complete) -- I
> thought it might be a little quicker since there is only about 130GB of
> data on the volume.
>
> Gotta figure out how to up the concurrent login limit on the filer as
> well, can't even fire up another console to stop the copy if I wanted
> to! :)
>
> Thanks,
> Ray
>

--
Sent from Gmail for mobile | mobile.google.com

romeotheriault at gmail

Nov 14, 2008, 1:20 PM

Post #9 of 19 (3639 views)
Permalink

Re: Removing a shelf. [In reply to]

On Fri, Nov 14, 2008 at 12:43 PM, Ray Van Dolson <rvandolson [at] esri>wrote:

> On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:
> > Hi all;
> >
> > We have a loaner NetApp that has three shelves on it. One of those
> > shelves needs to be returned to the vendor.
> >
> > An aggregate spans two shelves, one of which is the shelf that needs to
> > be returned. This aggregate contains a FlexVol currently in use. I'd
> > like to preserve the FlexVol but remove the shelf.
> >
> > What are my options? Doesn't look like I can shrink an aggregate. Is
> > my best bet to shut down everything usin the FlexVol, then vol copy it
> > to another aggregate, destroy the original aggregate, remove the shelf
> > and then recreate the aggregate again?
> >
> > Thanks in advance!
> > Ray
> >
>
> Thanks all for the response.
>
> It's only a 512GB (SIS enabled) volume, so I created a new volume on
> the other aggregate and am using vol copy to copy the data over. This
> seems incredibly slow (it's estimating two hours to complete) -- I
> thought it might be a little quicker since there is only about 130GB of
> data on the volume.
>
> Gotta figure out how to up the concurrent login limit on the filer as
> well, can't even fire up another console to stop the copy if I wanted
> to! :)
>
> Thanks,
> Ray
>

Remote ssh still works too. You just won't get a full shell.

exp. ssh filername 'aggr show_space -g'

or whatever.

--
Romeo Theriault

rvandolson at esri

Nov 14, 2008, 1:55 PM

Post #10 of 19 (3647 views)
Permalink

Re: Removing a shelf. [In reply to]

On Fri, Nov 14, 2008 at 09:43:49AM -0800, Ray Van Dolson wrote:
> On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:
> > Hi all;
> >
> > We have a loaner NetApp that has three shelves on it. One of those
> > shelves needs to be returned to the vendor.
> >
> > An aggregate spans two shelves, one of which is the shelf that needs to
> > be returned. This aggregate contains a FlexVol currently in use. I'd
> > like to preserve the FlexVol but remove the shelf.
> >
> > What are my options? Doesn't look like I can shrink an aggregate. Is
> > my best bet to shut down everything usin the FlexVol, then vol copy it
> > to another aggregate, destroy the original aggregate, remove the shelf
> > and then recreate the aggregate again?
> >
> > Thanks in advance!
> > Ray
> >
>
> Thanks all for the response.
>
> It's only a 512GB (SIS enabled) volume, so I created a new volume on
> the other aggregate and am using vol copy to copy the data over. This
> seems incredibly slow (it's estimating two hours to complete) -- I
> thought it might be a little quicker since there is only about 130GB of
> data on the volume.
>
> Gotta figure out how to up the concurrent login limit on the filer as
> well, can't even fire up another console to stop the copy if I wanted
> to! :)
>
> Thanks,
> Ray
>

So go the volume all moved. Went well. However, I just realized that
vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the
side-effects though?

Ray

rvandolson at esri

Nov 14, 2008, 2:11 PM

Post #11 of 19 (3647 views)
Permalink

Re: Removing a shelf. [In reply to]

On Fri, Nov 14, 2008 at 02:08:34PM -0800, Jeff Mohler wrote:
> None..just when that is done do:
>
> vol options root vol1new, and reboot.

Nice. Too bad about the reboot being necessary, but makes sense.
Found some KB's on NOW to read regarding this as well.

Learning experience!

Thanks all,
Ray

Stetson.Webster at netapp

Nov 14, 2008, 2:12 PM

Post #12 of 19 (3646 views)
Permalink

RE: Removing a shelf. [In reply to]

How to move or rename the root volume on a filer:
https://now.netapp.com/Knowledgebase/solutionarea.asp?id=kb6360

Stetson M. Webster
Professional Services Engineer
NCIE-SAN, NCIE-B&R, SNIA-SCSE
NetApp Global Services - Southeast District
919.250.0052 Mobile
Stetson.Webster [at] netapp
Learn how: netapp.com/guarantee

-----Original Message-----
From: Ray Van Dolson [mailto:rvandolson [at] esri]
Sent: Friday, November 14, 2008 4:55 PM
To: toasters [at] mathworks
Subject: Re: Removing a shelf.

On Fri, Nov 14, 2008 at 09:43:49AM -0800, Ray Van Dolson wrote:
> On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:
> > Hi all;
> >
> > We have a loaner NetApp that has three shelves on it. One of those
> > shelves needs to be returned to the vendor.
> >
> > An aggregate spans two shelves, one of which is the shelf that needs
to
> > be returned. This aggregate contains a FlexVol currently in use.
I'd
> > like to preserve the FlexVol but remove the shelf.
> >
> > What are my options? Doesn't look like I can shrink an aggregate.
Is
> > my best bet to shut down everything usin the FlexVol, then vol copy
it
> > to another aggregate, destroy the original aggregate, remove the
shelf
> > and then recreate the aggregate again?
> >
> > Thanks in advance!
> > Ray
> >
>
> Thanks all for the response.
>
> It's only a 512GB (SIS enabled) volume, so I created a new volume on
> the other aggregate and am using vol copy to copy the data over. This
> seems incredibly slow (it's estimating two hours to complete) -- I
> thought it might be a little quicker since there is only about 130GB
of
> data on the volume.
>
> Gotta figure out how to up the concurrent login limit on the filer as
> well, can't even fire up another console to stop the copy if I wanted
> to! :)
>
> Thanks,
> Ray
>

So go the volume all moved. Went well. However, I just realized that
vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the
side-effects though?

Ray

dleeds at edmunds

Nov 14, 2008, 2:15 PM

Post #13 of 19 (3638 views)
Permalink

RE: Removing a shelf. [In reply to]

one by one disk replace. if vol0 were a trad volume with 2 disks you would disk replace the first one to a spare disk on the other aggregate. once complete do the same with the other disk. do this *one by one* for all disks that make up your vol0 volume.

--
Daniel Leeds
Manager, Storage Operations
Edmunds, Inc.
1620 26th Street, Suite 400 South
Santa Monica, CA 90404

310-309-4999 desk
310-430-0536 cell

-----Original Message-----
From: owner-toasters [at] mathworks on behalf of Ray Van Dolson
Sent: Fri 11/14/2008 1:55 PM
To: toasters [at] mathworks
Subject: Re: Removing a shelf.

On Fri, Nov 14, 2008 at 09:43:49AM -0800, Ray Van Dolson wrote:
> On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:
> > Hi all;
> >
> > We have a loaner NetApp that has three shelves on it. One of those
> > shelves needs to be returned to the vendor.
> >
> > An aggregate spans two shelves, one of which is the shelf that needs to
> > be returned. This aggregate contains a FlexVol currently in use. I'd
> > like to preserve the FlexVol but remove the shelf.
> >
> > What are my options? Doesn't look like I can shrink an aggregate. Is
> > my best bet to shut down everything usin the FlexVol, then vol copy it
> > to another aggregate, destroy the original aggregate, remove the shelf
> > and then recreate the aggregate again?
> >
> > Thanks in advance!
> > Ray
> >
>
> Thanks all for the response.
>
> It's only a 512GB (SIS enabled) volume, so I created a new volume on
> the other aggregate and am using vol copy to copy the data over. This
> seems incredibly slow (it's estimating two hours to complete) -- I
> thought it might be a little quicker since there is only about 130GB of
> data on the volume.
>
> Gotta figure out how to up the concurrent login limit on the filer as
> well, can't even fire up another console to stop the copy if I wanted
> to! :)
>
> Thanks,
> Ray
>

So go the volume all moved. Went well. However, I just realized that
vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the
side-effects though?

Ray

rvandolson at esri

Nov 14, 2008, 2:16 PM

Post #14 of 19 (3646 views)
Permalink

Re: Removing a shelf. [In reply to]

On Fri, Nov 14, 2008 at 02:12:12PM -0800, Webster, Stetson wrote:
> How to move or rename the root volume on a filer:
> https://now.netapp.com/Knowledgebase/solutionarea.asp?id=kb6360
>

Thanks Stetson... perfect.

Ray

nick at nicholasbernstein

Nov 14, 2008, 2:17 PM

Post #15 of 19 (3660 views)
Permalink

Re: Removing a shelf. [In reply to]

On 11/14/08 1:55 PM, "Ray Van Dolson" <rvandolson [at] esri> wrote:

>
> So go the volume all moved. Went well. However, I just realized that
> vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
> while the filer is running?
>
> I guess I could snapshot it, vol copy it to aggr1... what would be the
> side-effects though?
>
> Ray

There's no side-effects that I know of, it's a normal vol copy, afik. The
new volume won't be the "root" volume until you give it a: "vol options
newvol root" though; once you reboot your filer newvol is then root.

-Nick

--
Nicholas Bernstein
Technologist, Consultant, Instructor
http://nicholasbernstein.com

rvandolson at esri

Nov 14, 2008, 3:09 PM

Post #16 of 19 (3637 views)
Permalink

Re: Removing a shelf. [In reply to]

On Fri, Nov 14, 2008 at 02:17:04PM -0800, Nicholas Bernstein wrote:
> On 11/14/08 1:55 PM, "Ray Van Dolson" <rvandolson [at] esri> wrote:
>
> >
> > So go the volume all moved. Went well. However, I just realized that
> > vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
> > while the filer is running?
> >
> > I guess I could snapshot it, vol copy it to aggr1... what would be the
> > side-effects though?
> >
> > Ray
>
> There's no side-effects that I know of, it's a normal vol copy, afik. The
> new volume won't be the "root" volume until you give it a: "vol options
> newvol root" though; once you reboot your filer newvol is then root.
>
> -Nick

FWIW I did the following:

* aggr0 is the old aggregate I need to get rid of containing vol0
which is the default root volume currently

> vol create root aggr1 90g
> ndmpd on
> ndmpcopy /etc /vol/root/etc
> ndmpd off
> vol options root root
> aggr options aggr1 root

At a later time I'll perform these steps:

> reboot
> vol offline vol0
> vol rename root vol0
> aggr offline aggr0
> aggr destroy aggr0
> aggr rename aggr1 aggr0

Then I should be able to remove my shelf and hopefully all will be
well. :)

Ray

tmacmd at gmail

Nov 15, 2008, 5:22 PM

Post #17 of 19 (3612 views)
Permalink

Re: Removing a shelf. [In reply to]

Don't forget to check the exports file if you use nfs...
There used to be times where this was not properly updated when doing the
procedure you describe.
(regarding exporting the root or vol0 volume....all others should still be
ok)

--tmac

RedHat Certified Engineer #804006984323821 (RHEL4)
RedHat Certified Engineer #805007643429572 (RHEL5)

Principal Consultant

On Fri, Nov 14, 2008 at 6:09 PM, Ray Van Dolson <rvandolson [at] esri> wrote:

> On Fri, Nov 14, 2008 at 02:17:04PM -0800, Nicholas Bernstein wrote:
> > On 11/14/08 1:55 PM, "Ray Van Dolson" <rvandolson [at] esri> wrote:
> >
> > >
> > > So go the volume all moved. Went well. However, I just realized that
> > > vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
> > > while the filer is running?
> > >
> > > I guess I could snapshot it, vol copy it to aggr1... what would be the
> > > side-effects though?
> > >
> > > Ray
> >
> > There's no side-effects that I know of, it's a normal vol copy, afik. The
> > new volume won't be the "root" volume until you give it a: "vol options
> > newvol root" though; once you reboot your filer newvol is then root.
> >
> > -Nick
>
> FWIW I did the following:
>
> * aggr0 is the old aggregate I need to get rid of containing vol0
> which is the default root volume currently
>
> > vol create root aggr1 90g
> > ndmpd on
> > ndmpcopy /etc /vol/root/etc
> > ndmpd off
> > vol options root root
> > aggr options aggr1 root
>
> At a later time I'll perform these steps:
>
> > reboot
> > vol offline vol0
> > vol rename root vol0
> > aggr offline aggr0
> > aggr destroy aggr0
> > aggr rename aggr1 aggr0
>
> Then I should be able to remove my shelf and hopefully all will be
> well. :)
>
> Ray
>

ggwalker at mindspring

Nov 15, 2008, 5:25 PM

Post #18 of 19 (3610 views)
Permalink

RE: Removing a shelf. [In reply to]

Probably too late to the party given the rest of the thread, but the
plan that Daniel mentioned is the best\easiest: replace the disks with
ones that are on the shelf you own.

Here's another way to do it:

If you have to return the shelf, you have to take downtime ANYWAYS
(cannot hot-remove shelf from loop)... so just move all the disks from
one shelf to the other and give it back to NetApp. Or better even, if
the shelf you have to give back has data disks on it, and the shelf you
have to keep does not, just give them the other shelf (assuming they are
the same).

Glenn

________________________________

From: owner-toasters [at] mathworks [mailto:owner-toasters [at] mathworks]
On Behalf Of Leeds, Daniel
Sent: Friday, November 14, 2008 5:15 PM
To: Ray Van Dolson; toasters [at] mathworks
Subject: RE: Removing a shelf.

one by one disk replace. if vol0 were a trad volume with 2 disks you
would disk replace the first one to a spare disk on the other aggregate.
once complete do the same with the other disk. do this *one by one* for
all disks that make up your vol0 volume.

--
Daniel Leeds
Manager, Storage Operations
Edmunds, Inc.
1620 26th Street, Suite 400 South
Santa Monica, CA 90404

310-309-4999 desk
310-430-0536 cell

-----Original Message-----
From: owner-toasters [at] mathworks on behalf of Ray Van Dolson
Sent: Fri 11/14/2008 1:55 PM
To: toasters [at] mathworks
Subject: Re: Removing a shelf.

On Fri, Nov 14, 2008 at 09:43:49AM -0800, Ray Van Dolson wrote:
> On Thu, Nov 13, 2008 at 12:31:36PM -0800, Ray Van Dolson wrote:
> > Hi all;
> >
> > We have a loaner NetApp that has three shelves on it. One of those
> > shelves needs to be returned to the vendor.
> >
> > An aggregate spans two shelves, one of which is the shelf that needs
to
> > be returned. This aggregate contains a FlexVol currently in use.
I'd
> > like to preserve the FlexVol but remove the shelf.
> >
> > What are my options? Doesn't look like I can shrink an aggregate.
Is
> > my best bet to shut down everything usin the FlexVol, then vol copy
it
> > to another aggregate, destroy the original aggregate, remove the
shelf
> > and then recreate the aggregate again?
> >
> > Thanks in advance!
> > Ray
> >
>
> Thanks all for the response.
>
> It's only a 512GB (SIS enabled) volume, so I created a new volume on
> the other aggregate and am using vol copy to copy the data over. This
> seems incredibly slow (it's estimating two hours to complete) -- I
> thought it might be a little quicker since there is only about 130GB
of
> data on the volume.
>
> Gotta figure out how to up the concurrent login limit on the filer as
> well, can't even fire up another console to stop the copy if I wanted
> to! :)
>
> Thanks,
> Ray
>

So go the volume all moved. Went well. However, I just realized that
vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
while the filer is running?

I guess I could snapshot it, vol copy it to aggr1... what would be the
side-effects though?

Ray

rvandolson at esri

Nov 17, 2008, 8:41 AM

Post #19 of 19 (3568 views)
Permalink

Re: Removing a shelf. [In reply to]

On Fri, Nov 14, 2008 at 03:09:24PM -0800, Ray Van Dolson wrote:
> On Fri, Nov 14, 2008 at 02:17:04PM -0800, Nicholas Bernstein wrote:
> > On 11/14/08 1:55 PM, "Ray Van Dolson" <rvandolson [at] esri> wrote:
> >
> > >
> > > So go the volume all moved. Went well. However, I just realized that
> > > vol0 is on aggr0! Argh. Is there any way to relocate vol0 safely
> > > while the filer is running?
> > >
> > > I guess I could snapshot it, vol copy it to aggr1... what would be the
> > > side-effects though?
> > >
> > > Ray
> >
> > There's no side-effects that I know of, it's a normal vol copy, afik. The
> > new volume won't be the "root" volume until you give it a: "vol options
> > newvol root" though; once you reboot your filer newvol is then root.
> >
> > -Nick
>
> FWIW I did the following:
>
> * aggr0 is the old aggregate I need to get rid of containing vol0
> which is the default root volume currently
>
> > vol create root aggr1 90g
> > ndmpd on
> > ndmpcopy /etc /vol/root/etc
> > ndmpd off
> > vol options root root
> > aggr options aggr1 root
>
> At a later time I'll perform these steps:
>
> > reboot
> > vol offline vol0
> > vol rename root vol0
> > aggr offline aggr0
> > aggr destroy aggr0
> > aggr rename aggr1 aggr0
>
> Then I should be able to remove my shelf and hopefully all will be
> well. :)
>
> Ray
>

Follow-up on this... everything went well. I would like to have tried
the disk fail option, but this method went quite smoothly and only
ended up being a few minutes of downtime.

Thanks again to all for the assistance!

Ray

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads