Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Linux-HA: Users

Fencing

 

 

Linux-HA users RSS feed   Index | Next | Previous | View Threaded


Yount.William at menloworldwide

Aug 2, 2012, 3:28 PM

Post #1 of 3 (212 views)
Permalink
Fencing

So I have been giving some thought to my fencing agent, as it seems a proper fencing solution is integral to any cluster. I only have access to basic Optiplex 990 and 960 desktops which is what I have built my cloud out of. I have been using the fence_pcmk agent but that doesn't seem to be a great solution. It can send shutdown and reboot commands to other nodes, but the nodes usually get hung-up in their shutdown scripts waiting for NFS shares to unmount or for VMs to turn off.

One agent that seems to come up a lot is OpenIPMI. I have done some reading on it and I can't quite get an understanding of if this is a software solution that doesn't need any hardware implementation such as a special IPMI management board. Can anyone let me know if I need hardware that specifically supports IPMI?



William

_______________________________________________
Linux-HA mailing list
Linux-HA [at] lists
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems


lists at alteeve

Aug 2, 2012, 4:55 PM

Post #2 of 3 (206 views)
Permalink
Re: Fencing [In reply to]

On 08/02/2012 06:28 PM, Yount, William D wrote:
> So I have been giving some thought to my fencing agent, as it seems a proper fencing solution is integral to any cluster. I only have access to basic Optiplex 990 and 960 desktops which is what I have built my cloud out of. I have been using the fence_pcmk agent but that doesn't seem to be a great solution. It can send shutdown and reboot commands to other nodes, but the nodes usually get hung-up in their shutdown scripts waiting for NFS shares to unmount or for VMs to turn off.
>
> One agent that seems to come up a lot is OpenIPMI. I have done some reading on it and I can't quite get an understanding of if this is a software solution that doesn't need any hardware implementation such as a special IPMI management board. Can anyone let me know if I need hardware that specifically supports IPMI?
>
>
>
> William

To clarify; A fence agent is designed to talk to a specific target
device. So fence_ipmilan only works if the target machine has an IPMI
BMC (baseboard management controller). Now I don't know Dell hardware,
but most desktop-class equipment does not have IPMI on it. These IPMI
BMCs are almost like little mini computers; They pull their power from
the same system, they can read the sensors of the host, etc, but they
are independent. These IPMI BMC are not generic devices you can add to a
machine, they have to be designed for the host. So if you don't have
IPMI, you're likely not going to add one.

You are right; fencing is critical. Fence agents that rely on the target
responding properly are fundamentally flawed and unreliable. The whole
idea behind fencing is to put a node in an unknown state into a known
state. If you don't know a node's state, there is a very good chance you
won't be able to talk to it, or even if you can, as you've seen, it
isn't operating properly anymore.

The best option at this point would be to use a switched PDU, like the
APC AP7900 (or similar, higher port-count version). These are
effectively network-connected power bars with individual outlet control.
You have to choose the maker carefully, as not all switched PDUs have
agents (APC, Eaton and a couple others do, I think). This is your best
bet to add fencing to your desktop machines.

Cheers

--
Digimer
Papers and Projects: https://alteeve.com
_______________________________________________
Linux-HA mailing list
Linux-HA [at] lists
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems


dmaziuk at bmrb

Aug 2, 2012, 5:31 PM

Post #3 of 3 (204 views)
Permalink
Re: Fencing [In reply to]

On 08/02/2012 05:28 PM, Yount, William D wrote:
> So I have been giving some thought to my fencing agent, as it seems
> a
proper fencing solution is integral to any cluster. I only have access
to basic Optiplex 990 and 960 desktops which is what I have built my
cloud out of. I have been using the fence_pcmk agent but that doesn't
seem to be a great solution. It can send shutdown and reboot commands to
other nodes, but the nodes usually get hung-up in their shutdown scripts
waiting for NFS shares to unmount or for VMs to turn off.
>
> One agent that seems to come up a lot is OpenIPMI. I have done some
reading on it and I can't quite get an understanding of if this is a
software solution that doesn't need any hardware implementation such as
a special IPMI management board. Can anyone let me know if I need
hardware that specifically supports IPMI?

Our 7xx series optiplexes don't have IPMI boards. Dunno about 9x0
series, but I highly doubt it: it's something they put in machines
that's supposed to run headless, not in desktops.

Aside from networked PDUs (last I looked TrippLite had better bang/buck
options than APC on just just about anything), the other option is to
cut the node off at the switch and let it sit until someone comes in to
kick it. Assuming you don't have multiple redundant NICs, you do have
the someone, and so on and so forth.

--
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu
Attachments: signature.asc (0.25 KB)

Linux-HA users RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.