Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: SpamAssassin: users

Cluster/Clone spamassassin node

 

 

SpamAssassin users RSS feed   Index | Next | Previous | View Threaded


ew-reg at mailbox

Nov 15, 2009, 4:42 AM

Post #1 of 10 (976 views)
Permalink
Cluster/Clone spamassassin node

Good morning,

I am preparing env with more then 10 node of spamassassin machine. I am
wonder what kind of software do you use to clone OS and Spamassassin
application to the other machine. I am gonne use Debian, I find FAI but it
won't migrate SA database. So it isn't the best choise.

What it your experience?


Best regards,
E.
--
View this message in context: http://old.nabble.com/Cluster-Clone-spamassassin-node-tp26358800p26358800.html
Sent from the SpamAssassin - Users mailing list archive at Nabble.com.


p at state-of-mind

Nov 15, 2009, 5:50 AM

Post #2 of 10 (924 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

* ewreg <ew-reg [at] mailbox>:
>
> Good morning,
>
> I am preparing env with more then 10 node of spamassassin machine. I am
> wonder what kind of software do you use to clone OS and Spamassassin
> application to the other machine. I am gonne use Debian, I find FAI but it
> won't migrate SA database. So it isn't the best choise.

We use cfengine to install, configure software and also to check for
compliance.

As for databases I recommend using a SQL backend and have the SQL
servers in some sort of HA master-slave setup.

p [at] ric


--
state of mind
Digitale Kommunikation

http://www.state-of-mind.de

Franziskanerstraße 15 Telefon +49 89 3090 4664
81669 München Telefax +49 89 3090 4666

Amtsgericht München Partnerschaftsregister PR 563


ew-reg at mailbox

Nov 15, 2009, 8:02 AM

Post #3 of 10 (922 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

>We use cfengine to install, configure software and also to check for
>compliance.

As I see, I can install software over the cfengine. But can I make mirror
with cfengine? I would like to clone some local files to all n-servers. I
think it can't be done with the help of this software.

TiA,
E.


--
View this message in context: http://old.nabble.com/Cluster-Clone-spamassassin-node-tp26358800p26360404.html
Sent from the SpamAssassin - Users mailing list archive at Nabble.com.


spamassassin-users at lists

Nov 15, 2009, 8:47 AM

Post #4 of 10 (918 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

ewreg wrote:

>> We use cfengine to install, configure software and also to check for
>> compliance.
>
> As I see, I can install software over the cfengine. But can I make mirror
> with cfengine? I would like to clone some local files to all n-servers. I
> think it can't be done with the help of this software.

rsync? unison? glusterfs? gfs over drdb? A nas with NFS/CIFS mounts?
DropBox? s3fs? There are a million ways to share files between multiple
servers.

--
Mike Cardwell - IT Consultant and LAMP developer
Cardwell IT Ltd. (UK Reg'd Company #06920226) http://cardwellit.com/
Technical Blog: https://secure.grepular.com/blog/


p at state-of-mind

Nov 15, 2009, 9:57 AM

Post #5 of 10 (916 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

* ewreg <ew-reg [at] mailbox>:
>
> >We use cfengine to install, configure software and also to check for
> >compliance.
>
> As I see, I can install software over the cfengine. But can I make mirror
> with cfengine? I would like to clone some local files to all n-servers. I
> think it can't be done with the help of this software.

AFAIK you can't. It's a one server to n clients rollout strategie. But there's
an enormous number of alternatives starting from rsync to cluster filesystem
solutions as others already have pointed out.

Another concept may be to have the clients load their config from a database.
You can't load everything this way, but it may suffice. It depends on your
setup.

You may want to let us in on the details and we may be of better help.

p [at] ric

--
state of mind
Digitale Kommunikation

http://www.state-of-mind.de

Franziskanerstraße 15 Telefon +49 89 3090 4664
81669 München Telefax +49 89 3090 4666

Amtsgericht München Partnerschaftsregister PR 563


ew-reg at mailbox

Nov 16, 2009, 1:01 AM

Post #6 of 10 (903 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

> You may want to let us in on the details and we may be of better help.

Okay, so:

I'm preparing ~10 machine of Debian Lenny with spamassassin on the board.
Configuration (hardware&software) of each of those nodes will be almost the
same (excluding ip address, hostname etc.).

What kind of software I should use to manage those nodes? I can always use
rsync and write lots of excludes (/dev, proc etc.) to make copy of one OS
with application to another (and some postcopy script to HUP the app).

I have done some research and I find that systemimager should be the one.
But nowadays it isn't supported by Debian and the last modification comes
from 2007. It looks like someone abandoned the ship.

So what now? Cfengine, puppet, fai do some other stuff. None of them isn't
design to mirror not only conf files but also content of the whole
operating system and application with its configs (!logs).

Maybe I am wrong? Maybe cfengine/puppet can do the work?

TiA,
E.
--
View this message in context: http://old.nabble.com/Cluster-Clone-spamassassin-node-tp26358800p26368690.html
Sent from the SpamAssassin - Users mailing list archive at Nabble.com.


fh-sa2004 at lf

Nov 16, 2009, 2:36 AM

Post #7 of 10 (897 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

Hi ewreg, list,

On Mon, Nov 16, 2009 at 01:01:30AM -0800, ewreg wrote:
...
> I have done some research and I find that systemimager should be the one.
> But nowadays it isn't supported by Debian and the last modification comes
> from 2007. It looks like someone abandoned the ship.

ever thought about using virtual hosts? They could be cloned
easily and using dhcp, the setup of each machine could be identical.
For bayesDB see hint in previous mail about SQL-slaves.


--
Regards
Frank


uhlar at fantomas

Nov 16, 2009, 3:24 AM

Post #8 of 10 (896 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

> On Mon, Nov 16, 2009 at 01:01:30AM -0800, ewreg wrote:
> ...
> > I have done some research and I find that systemimager should be the one.
> > But nowadays it isn't supported by Debian and the last modification comes
> > from 2007. It looks like someone abandoned the ship.

On 16.11.09 11:36, Frank Heydlauf wrote:
> ever thought about using virtual hosts? They could be cloned
> easily and using dhcp, the setup of each machine could be identical.
> For bayesDB see hint in previous mail about SQL-slaves.

I would say that the problems lies in those machines' performance, which
can't be solved by virtual hosting - you would have the same problem with
configuration of IP addresses etc.

Or is there any way of making those easier with virtual hosting?
--
Matus UHLAR - fantomas, uhlar [at] fantomas ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Spam = (S)tupid (P)eople's (A)dvertising (M)ethod


jp at saucer

Nov 16, 2009, 8:17 AM

Post #9 of 10 (890 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

I use dd to duplicate hard drives when needed.
dd if=/dev/sdb of=/dev/sdc bs=1M
for example. It's probably in every distribution.

I use rsync to sync up system wide files such as authentication, etc...
and on a per user basis it copies users' .procmailrc and .spamassassin/*
files from a central server.

I use perdition to load balance the mail checking, and load balancing of
SA/AMAVIS/CLAMAV and checking is managed by having certain letters of
the alphabet (for first letter of username) going to certain mail
servers.

I've considered using mysql to make the SA settings available to each
server, but I'd still need rsync to copy passwd/shadow files, .procmail
files, and so on.

Virtualization was presented, but I think for absolute speed, you'll
want to run the OS natively. I use virtualization for lots of things,
but really heavy duty email isn't one.

On Mon, Nov 16, 2009 at 01:01:30AM -0800, ewreg wrote:
>
> > You may want to let us in on the details and we may be of better help.
>
> Okay, so:
>
> I'm preparing ~10 machine of Debian Lenny with spamassassin on the board.
> Configuration (hardware&software) of each of those nodes will be almost the
> same (excluding ip address, hostname etc.).
>
> What kind of software I should use to manage those nodes? I can always use
> rsync and write lots of excludes (/dev, proc etc.) to make copy of one OS
> with application to another (and some postcopy script to HUP the app).
>
> I have done some research and I find that systemimager should be the one.
> But nowadays it isn't supported by Debian and the last modification comes
> from 2007. It looks like someone abandoned the ship.
>
> So what now? Cfengine, puppet, fai do some other stuff. None of them isn't
> design to mirror not only conf files but also content of the whole
> operating system and application with its configs (!logs).
>
> Maybe I am wrong? Maybe cfengine/puppet can do the work?
>
> TiA,
> E.
> --
> View this message in context: http://old.nabble.com/Cluster-Clone-spamassassin-node-tp26358800p26368690.html
> Sent from the SpamAssassin - Users mailing list archive at Nabble.com.

--
/*
Jason Philbrook | Midcoast Internet Solutions - Wireless and DSL
KB1IOJ | Broadband Internet Access, Dialup, and Hosting
http://f64.nu/ | for Midcoast Maine http://www.midcoast.com/
*/


per at computer

Nov 16, 2009, 10:20 AM

Post #10 of 10 (895 views)
Permalink
Re: Cluster/Clone spamassassin node [In reply to]

ewreg wrote:

>
> Good morning,
>
> I am preparing env with more then 10 node of spamassassin machine. I
> am wonder what kind of software do you use to clone OS and
> Spamassassin application to the other machine.

tar. I've found that to quite manageable for a low number of nodes.


/Per Jessen, Zürich

SpamAssassin users RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.