Gossamer Forum: Products: Gossamer Links: Development, Plugins and Globals: [NEW PLUGIN] UpdateMetaValues

Veteran / Moderator (17298 posts)

Sep 26, 2005, 11:23 PM

Post #1 of 31

Shortcut

[NEW PLUGIN] UpdateMetaValues

UpdateMetaValues v1

Author: Ultranerds.com
More Details: http://ultranerds.com/...bin/details/157.html
Part of ULTRA and ULTRA Pro Packages.

This plugin lets you grab the;

Meta Description
Author
Title
Contact Email (either based on the meta value, or "put together" by using webmaster@domain.com)

..from the URL in questions Meta Tags. NB: Not all sites use these.. so its not a bullet proof way of getting their details!

Requirements

Gossamer Links 3.0.x
MySQL Database
LWP::Simple

If you have any questions, please don't hesitate to ask.

Cheers

Andy (mod)
andy@ultranerds.co.uk

IMPORTANT: I've now moved to ultranerds.co.uk, and the .com will no longer work!
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package (plugins total "value" $3,325 & rising, for just $350)| GLinks ULTRA Package PRO (plugins total "value" $5,625 & rising, for just $500)
Support Forum | Links SQL Plugins | DMOZ Dumps | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Compare our different Plugin packages *new* Free CSS Templates

Dec 17, 2005, 4:55 AM

User (144 posts)

Dec 17, 2005, 4:55 AM

Post #2 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Dumb question - what does it do with the meta content?
Blacknight Solutions - Hosting
Search.ie
Armchair.ie

Dec 17, 2005, 5:07 AM

Veteran / Moderator (17298 posts)

Dec 17, 2005, 5:07 AM

Post #3 of 31

Shortcut

Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to

Hi,

It stores it in the respective new fields.

i.e meta-description gets put in Meta_Description ; meta-keywords gets put in Meta_Keywords, etc.

Smile

Cheers

Andy (mod)
andy@ultranerds.co.uk

Dec 17, 2005, 5:20 AM

User (144 posts)

Dec 17, 2005, 5:20 AM

Post #4 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

So you could use the meta content in the detailed pages?

Sounds useful
Blacknight Solutions - Hosting
Search.ie
Armchair.ie

Dec 17, 2005, 5:34 AM

Veteran / Moderator (17298 posts)

Dec 17, 2005, 5:34 AM

Post #5 of 31

Shortcut

Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to

Yup, or more to the point (and what it was originally written for :)), so you can search these fields,. i.e to give better keyword targetting (so you don't just have the normal fields to look at, i.e Description and Title).

Cheers

Andy (mod)
andy@ultranerds.co.uk

Dec 18, 2005, 1:26 PM

Dinky

User (354 posts)

Dec 18, 2005, 1:26 PM

Post #6 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Andy,
Quick question,
Are your plugins developed for Links 3.0 and higher backwards compatible to 2.1.2? Reason I ask is my links installation is extremely heavily modified, and have not upgraded to 3.0. Probably won't upgrade to 3.0 unless I can find a programmer to make some serious modification to 3.0. The programmer I hired for my 2.12 installation has since gotten out of the business... hence the backwards compatability question??

Happy Holidays Smile

</not a clue>

Dec 18, 2005, 11:43 PM

Veteran / Moderator (17298 posts)

Dec 18, 2005, 11:43 PM

Post #7 of 31

Shortcut

Re: [Dinky] [NEW PLUGIN] UpdateMetaValues In reply to

Hi,

Not all of them are, but this particular one should work fine from 2.1.x --> 3.0.x Smile

Cheers

Andy (mod)
andy@ultranerds.co.uk

Dec 22, 2005, 2:32 AM

User (144 posts)

Dec 22, 2005, 2:32 AM

Post #8 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Very cool plugin. Hopefully Google et al will see the changes soon

The only problem I'm having with it is that it times out ie. if I have 4000 links to parse it may get as far as link 3000 and then stall
Blacknight Solutions - Hosting
Search.ie
Armchair.ie

Dec 22, 2005, 2:55 AM

Veteran / Moderator (17298 posts)

Dec 22, 2005, 2:55 AM

Post #9 of 31

Shortcut

Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to

Hi,

Thanks =)

Regarding it "stalling"... did you try running from SSH? (with the example command in the Readme :)).

Cheers

Andy (mod)
andy@ultranerds.co.uk

Dec 22, 2005, 3:00 AM

User (144 posts)

Dec 22, 2005, 3:00 AM

Post #10 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Ah. I didn't see the example in the readme.. I'll try that :)
Blacknight Solutions - Hosting
Search.ie
Armchair.ie

Dec 22, 2005, 3:04 AM

User (144 posts)

Dec 22, 2005, 3:04 AM

Post #11 of 31

Shortcut

Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to

No wonder I didn't see it .. there are no examples in the version I have installed .. Am I missing something?
Blacknight Solutions - Hosting
Search.ie
Armchair.ie

Dec 22, 2005, 6:07 AM

Veteran / Moderator (17298 posts)

Dec 22, 2005, 6:07 AM

Post #12 of 31

Shortcut

Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to

Sorry, the command is as follows= )

Code:
cd /path/to/admin 
perl admin.cgi 'do=plugin&plugin=UpdateMetaValues&func=Start'

Cheers

Andy (mod)
andy@ultranerds.co.uk

Dec 23, 2005, 12:05 PM

User (294 posts)

Dec 23, 2005, 12:05 PM

Post #13 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Mine is installed but it poops out at the same place on only the 22nd link out of 47,986 links and this is via SSH. Seems like a great plug-in if only I could get it to continue through to completion.

Any suggestions??

Thanks.

Mark

Dec 23, 2005, 12:11 PM

User (294 posts)

Dec 23, 2005, 12:11 PM

Post #14 of 31

Shortcut

Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to

OK. I must have panicked too soon. It's moving along again. It will sit at some sites for a lengthier period of time than others.

Dec 24, 2005, 4:38 AM

Veteran / Moderator (17298 posts)

Dec 24, 2005, 4:38 AM

Post #15 of 31

Shortcut

Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to

In Reply To:

OK. I must have panicked too soon. It's moving along again. It will sit at some sites for a lengthier period of time than others.

Hi,

Its probably just a slow site, and took a while to get the HTML from it :) Some sites are stupidly quick, while others may just as well be running on dial up <G>

Cheers

Andy (mod)
andy@ultranerds.co.uk

Jan 6, 2006, 2:18 AM

User (294 posts)

Jan 6, 2006, 2:18 AM

Post #16 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Andy,

After running this a couple of times via SSH it gets through about the first 3,000 or so of about 48,000 links and just dies. Is there anything that can be done to spider the rest of the links in the database?

Thanks.

Mark

Jan 6, 2006, 2:55 AM

Veteran / Moderator (17298 posts)

Jan 6, 2006, 2:55 AM

Post #17 of 31

Shortcut

Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to

Hi,

In /admin/Plugins/UpdateMetaValues.pm, you could try changing;

Code:
   my $sth = $DB->table('Links')->select( GT::SQL::Condition->new('URL','LIKE','http://%') );

..to;

Code:
   my $sth = $DB->table('Links')->select( GT::SQL::Condition->new('URL','LIKE','http://%','Meta_Title','IS','NULL') );

..or possibly this (if the above doesn't work);

Code:
   my $sth = $DB->table('Links')->select( GT::SQL::Condition->new('URL','LIKE','http://%','Meta_Title','=','') );

This way, it should only re-attempt those that havn't got values already Smile

I'll probably add a staggered option at some point. Its just trying to find the time :(

Cheers

Andy (mod)
andy@ultranerds.co.uk

Jan 6, 2006, 7:36 PM

User (294 posts)

Jan 6, 2006, 7:36 PM

Post #18 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Well, the second option worked a little better - got through about 13,600 links out of 48,000. It looks like it's been sitting on the same link for over 4 hours now - probably stalled out.

I really only need the Descriptions of these links. Is it possible for it to fetc just the descriptions and not Titles and email addresses?

Thanks.

Mark

Jan 7, 2006, 2:20 AM

Veteran / Moderator (17298 posts)

Jan 7, 2006, 2:20 AM

Post #19 of 31

Shortcut

Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to

Hi,

Cool :)

Regarding your last questions - please see the modified module sent via PM :)

Cheers

Andy (mod)
andy@ultranerds.co.uk

Jan 8, 2006, 6:12 PM

User (294 posts)

Jan 8, 2006, 6:12 PM

Post #20 of 31

Shortcut

Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to

Andy,

After running the Description Only script, I notice that it seems to get hung up or won't go past the same link/record in the database (1256 of 33756) after several attempts. What would be neat would be able to start the plugin at any given point within the database. So I could start it at record 1258 (skipping over record 1257) if that is the hurdle.

Your thoughts...

Thanks.

Mark

Jan 9, 2006, 12:45 AM