Gossamer Forum: General: Internet Technologies: 38Gb on 2 sites! :-/

Nov 14, 2002, 2:37 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 2:37 AM

Post #1 of 17

Shortcut

38Gb on 2 sites! :-/

This is mad. It seems that /dev/hde3 on my server is all used up! How can this be? I have two sites on it.... linkssql.net and f******freelinks.com.

FFL.com has the DMOZ import done on it....and Links SQL is doing a complete DMOZ Import....that should be ok shouldn't it? Unsure

Its a PIIII 1.3Ghz with 512Mb RAM, and 40Gb HDD!

Anyone got any ideas on tracking down where the bulk of the space is being used?

Cheers

Andy (mod)
andy@ultranerds.co.uk

IMPORTANT: I've now moved to ultranerds.co.uk, and the .com will no longer work!
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package (plugins total "value" $3,325 & rising, for just $350)| GLinks ULTRA Package PRO (plugins total "value" $5,625 & rising, for just $500)
Support Forum | Links SQL Plugins | DMOZ Dumps | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Compare our different Plugin packages *new* Free CSS Templates

Nov 14, 2002, 2:48 AM

Wil

Veteran / Moderator (4108 posts)

Nov 14, 2002, 2:48 AM

Post #2 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

memphis% find / -size +10000k

- wil

Nov 14, 2002, 3:09 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 3:09 AM

Post #3 of 17

Shortcut

Re: [Wil] 38Gb on 2 sites! :-/ In reply to

Éugh..this looks interesting!

Lot, and lots of these types are showing up;

/var/spool/mqueue/dfgADNCrl28795

I was just looking into why I'm not getting my emails, so maybe this is why? (getting clogged up) Frown

Andy (mod)
andy@ultranerds.co.uk

Nov 14, 2002, 3:12 AM

Wil

Veteran / Moderator (4108 posts)

Nov 14, 2002, 3:12 AM

Post #4 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

That's just your mail queue and the associated lock and log files. How often do you download and check your mail? You using IMAP? You not deleting after download with POP3?

- wil

Nov 14, 2002, 3:14 AM

Wil

Veteran / Moderator (4108 posts)

Nov 14, 2002, 3:14 AM

Post #5 of 17

Shortcut

Re: [Wil] 38Gb on 2 sites! :-/ In reply to

Actually, that's the outgoing stuff. Is your mail getting delivered properly? Have you got your sendmail daemon running? What on earth are you sending out?!

- wil

Last edited by:

Wil: Nov 14, 2002, 3:15 AM

Nov 14, 2002, 3:22 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 3:22 AM

Post #6 of 17

Shortcut

Re: [Wil] 38Gb on 2 sites! :-/ In reply to

Well, I've looked ito it, and there are 23Mb email files...

Turns out they are emails sent out daily by my cron system, which contains the output of the entire build process :-/

Is there any way to stop this from happening again? i.e stop the cron emails being sent out after completion?

Cheers

Andy (mod)
andy@ultranerds.co.uk

Nov 14, 2002, 3:47 AM

Wil

Veteran / Moderator (4108 posts)

Nov 14, 2002, 3:47 AM

Post #7 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

Either erase the cron job or send the output of the cron job to /dev/null instead of your email.

- wil

Nov 14, 2002, 4:09 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 4:09 AM

Post #8 of 17

Shortcut

Re: [Wil] 38Gb on 2 sites! :-/ In reply to

Any way to delete the files over 20Mb with the `rm` command? There is well over 200 of them, and Its going to take forever to delete them all :( All google brings up is a load of Russian sites, which ain't a lot of help Unsure

Also, so when running the cron jobs, I should use;

perl /path/to/nph-build.cgi >? /dev/null

Crazy

Cheers

Andy (mod)
andy@ultranerds.co.uk

Nov 14, 2002, 4:56 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 4:56 AM

Post #9 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

Ok, maybe I'll have to go round this another way....cos there is 8971152 files!

Is there any way to delete files ONLY owned by 'root' (and not admin1). ???

Cheers

Andy (mod)
andy@ultranerds.co.uk

Nov 14, 2002, 4:59 AM

Paul

Veteran (19537 posts)

Nov 14, 2002, 4:59 AM

Post #10 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

rm -f `find /var/spool/mqueue -user root`

Last edited by:

Paul: Nov 14, 2002, 5:00 AM

Nov 14, 2002, 5:07 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 5:07 AM

Post #11 of 17

Shortcut

Re: [Paul] 38Gb on 2 sites! :-/ In reply to

Thanks, it worked great Smile

Andy (mod)
andy@ultranerds.co.uk

Nov 14, 2002, 5:18 AM

Wil

Veteran / Moderator (4108 posts)

Nov 14, 2002, 5:18 AM

Post #12 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

Yeah, but you should get to the root cause of this and why this is happening?

- wil

Nov 14, 2002, 6:24 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 6:24 AM

Post #13 of 17

Shortcut

Re: [Wil] 38Gb on 2 sites! :-/ In reply to

I know what the problem is. It was LSQL doing the rebuild via cron. It was logging all the build process, and emailing the contents of the process. Because I had oner 90k of links, it was very large emails, so I am not just setting the cron jobs to email /dev/null (as recommended).

Cheers

Andy (mod)
andy@ultranerds.co.uk

Nov 14, 2002, 6:56 AM

Paul

Veteran (19537 posts)

Nov 14, 2002, 6:56 AM

Post #14 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

You don't email /dev/null - /dev/null is a black hole not an email address Laugh

Nov 14, 2002, 7:00 AM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 7:00 AM

Post #15 of 17

Shortcut

Re: [Paul] 38Gb on 2 sites! :-/ In reply to

I know, which is why I'm sending root emails to it Wink

Andy (mod)
andy@ultranerds.co.uk

Nov 14, 2002, 9:00 AM

Alex

Administrator (9387 posts)

Nov 14, 2002, 9:00 AM

Post #16 of 17

Shortcut

Re: [Andy] 38Gb on 2 sites! :-/ In reply to

Well, I think what paul was getting at is technically your not emailing /dev/null. cron will email the output of any program to whoever owns the cron job. By adding > /dev/null, you are essentially making the program have no output. If there is no output, then it doesn't email.

Cheers,

Alex
--
Gossamer Threads Inc.

Nov 14, 2002, 3:16 PM

Andy

Veteran / Moderator (17364 posts)

Nov 14, 2002, 3:16 PM

Post #17 of 17

Shortcut

Re: [Alex] 38Gb on 2 sites! :-/ In reply to

Slight technicality Laugh

Andy (mod)
andy@ultranerds.co.uk