As long as your traffic isn't extremely more than I'm anticipating then I don't see any reason why that number of links/categories would cause you any problems. Especially under mod_perl.
Does your server have 256MB RAM or more?
Does your server have 256MB RAM or more?