Gossamer Forum
Home : General : Internet Technologies :

38Gb on 2 sites! :-/

Quote Reply
38Gb on 2 sites! :-/
This is mad. It seems that /dev/hde3 on my server is all used up! How can this be? I have two sites on it.... linkssql.net and f******freelinks.com.

FFL.com has the DMOZ import done on it....and Links SQL is doing a complete DMOZ Import....that should be ok shouldn't it? Unsure Its a PIIII 1.3Ghz with 512Mb RAM, and 40Gb HDD!

Anyone got any ideas on tracking down where the bulk of the space is being used?

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
memphis% find / -size +10000k

- wil
Quote Reply
Re: [Wil] 38Gb on 2 sites! :-/ In reply to
Éugh..this looks interesting!

Lot, and lots of these types are showing up;

/var/spool/mqueue/dfgADNCrl28795

I was just looking into why I'm not getting my emails, so maybe this is why? (getting clogged up) Frown

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
That's just your mail queue and the associated lock and log files. How often do you download and check your mail? You using IMAP? You not deleting after download with POP3?

- wil
Quote Reply
Re: [Wil] 38Gb on 2 sites! :-/ In reply to
Actually, that's the outgoing stuff. Is your mail getting delivered properly? Have you got your sendmail daemon running? What on earth are you sending out?!

- wil

Last edited by:

Wil: Nov 14, 2002, 3:15 AM
Quote Reply
Re: [Wil] 38Gb on 2 sites! :-/ In reply to
Well, I've looked ito it, and there are 23Mb email files...

Turns out they are emails sent out daily by my cron system, which contains the output of the entire build process :-/

Is there any way to stop this from happening again? i.e stop the cron emails being sent out after completion?

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
Either erase the cron job or send the output of the cron job to /dev/null instead of your email.

- wil
Quote Reply
Re: [Wil] 38Gb on 2 sites! :-/ In reply to
Any way to delete the files over 20Mb with the `rm` command? There is well over 200 of them, and Its going to take forever to delete them all :( All google brings up is a load of Russian sites, which ain't a lot of help Unsure

Also, so when running the cron jobs, I should use;

perl /path/to/nph-build.cgi >? /dev/null

Crazy

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
Ok, maybe I'll have to go round this another way....cos there is 8971152 files!

Is there any way to delete files ONLY owned by 'root' (and not admin1). ???

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
rm -f `find /var/spool/mqueue -user root`

Last edited by:

Paul: Nov 14, 2002, 5:00 AM
Quote Reply
Re: [Paul] 38Gb on 2 sites! :-/ In reply to
Thanks, it worked great Smile

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
Yeah, but you should get to the root cause of this and why this is happening?

- wil
Quote Reply
Re: [Wil] 38Gb on 2 sites! :-/ In reply to
I know what the problem is. It was LSQL doing the rebuild via cron. It was logging all the build process, and emailing the contents of the process. Because I had oner 90k of links, it was very large emails, so I am not just setting the cron jobs to email /dev/null (as recommended).

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
You don't email /dev/null - /dev/null is a black hole not an email address Laugh
Quote Reply
Re: [Paul] 38Gb on 2 sites! :-/ In reply to
I know, which is why I'm sending root emails to it Wink

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] 38Gb on 2 sites! :-/ In reply to
Well, I think what paul was getting at is technically your not emailing /dev/null. cron will email the output of any program to whoever owns the cron job. By adding > /dev/null, you are essentially making the program have no output. If there is no output, then it doesn't email.

Cheers,

Alex
--
Gossamer Threads Inc.
Quote Reply
Re: [Alex] 38Gb on 2 sites! :-/ In reply to
Slight technicality Laugh

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!