I am running nph_index now, and in top it uses ~25% cpu. I have 8 cores in that machine, and top shows a total of about 1.00~1.25 load averages.

I am running a HIGHLY bastardized version of Links, and it takes me 8-10 hours to run a full index on 100k links. A LOT of data there being indexed.

So my question I guess is is nph_index throttled anywhere? Is there anyway I can tell it I have the cpus, go ahead and use more (and finish faster)?

Thans!

D
dave

Big Cartoon DataBase
Big Comic Book DataBase

Are you doing a full index, or just a re-index?

Cheers

Andy (mod)
andy@ultranerds.co.uk

---

IMPORTANT: I've now moved to ultranerds.co.uk, and the .com will no longer work!
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package (plugins total "value" $3,325 & rising, for just $350)| GLinks ULTRA Package PRO (plugins total "value" $5,625 & rising, for just $500)
Support Forum | Links SQL Plugins | DMOZ Dumps | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Compare our different Plugin packages *new* Free CSS Templates

hey Andy!

Full!

Dave
dave

Big Cartoon DataBase
Big Comic Book DataBase

Any reason you are doing a full one? Been a while since I run an index on any sites, but I'm sure there was a way to run them with new links/modified ones?

Cheers

Andy (mod)
andy@ultranerds.co.uk

---

IMPORTANT: I've now moved to ultranerds.co.uk, and the .com will no longer work!
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package (plugins total "value" $3,325 & rising, for just $350)| GLinks ULTRA Package PRO (plugins total "value" $5,625 & rising, for just $500)
Support Forum | Links SQL Plugins | DMOZ Dumps | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Compare our different Plugin packages *new* Free CSS Templates

For me, yeah. You know how funky my site is. I will d/l a whole "Category" and work on it, perhaps taking a basic series entry and adding all the extras- directors, full crew, etc. Or I may even build a whole new category off line- I use Excel. Then, once I have all the changes of the new info, I upload it, and import it into Links.

So all that new info needs to be indexed, to be searched. I have tried other ways, but for me, doing it all local in Excel is much faster than entering things online. And even if I did add things online (update Links set Director= 'Andy and Dave' where CategoryNum = '2341' to update a whole series, which is what I sometimes do), I would STILL have to reindex.

My install is weird. Not static like most installs. I am always adding new info. So, yes, for me, reindexing is a fact or life!
dave

Big Cartoon DataBase
Big Comic Book DataBase

Have you considered duplicating the install, and then when you need to re-index, run it on the 2nd install? This way, there will be NOTHING else accessing mysql, appart from the re-indexing script.

From past experiences, the main reason for a re-index to go slow, is due to the fact people are doing searches/adding listings etc, while its running.

Maybe GT could shed a bit more light though =)

Cheers

Andy (mod)
andy@ultranerds.co.uk

---

IMPORTANT: I've now moved to ultranerds.co.uk, and the .com will no longer work!
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package (plugins total "value" $3,325 & rising, for just $350)| GLinks ULTRA Package PRO (plugins total "value" $5,625 & rising, for just $500)
Support Forum | Links SQL Plugins | DMOZ Dumps | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Compare our different Plugin packages *new* Free CSS Templates

I ran a few monster sites and drove myself crazy with indexing and re-indexing. After about 4 years its either Indexing Scheme: NONINDEXED or I make the site dynamic.


Sandra Roussel
Chonsa Group Design - Fresh Start Housing

I have given that a try, too. I do not like it, either...
dave

Big Cartoon DataBase
Big Comic Book DataBase