Gossamer Forum
Home : Products : Gossamer Links : Development, Plugins and Globals :

[NEW PLUGIN] UpdateMetaValues

(Page 1 of 2)
> >
Quote Reply
[NEW PLUGIN] UpdateMetaValues
UpdateMetaValues v1

Author: Ultranerds.com
More Details: http://ultranerds.com/...bin/details/157.html
Part of ULTRA and ULTRA Pro Packages.

This plugin lets you grab the;
  • Meta Description
  • Author
  • Title
  • Contact Email (either based on the meta value, or "put together" by using webmaster@domain.com)
..from the URL in questions Meta Tags. NB: Not all sites use these.. so its not a bullet proof way of getting their details!

Requirements

  • Gossamer Links 3.0.x
  • MySQL Database
  • LWP::Simple
If you have any questions, please don't hesitate to ask.

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Dumb question - what does it do with the meta content?
Blacknight Solutions - Hosting
Search.ie
Armchair.ie
Quote Reply
Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to
Hi,

It stores it in the respective new fields.

i.e meta-description gets put in Meta_Description ; meta-keywords gets put in Meta_Keywords, etc.

Smile

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
So you could use the meta content in the detailed pages?

Sounds useful
Blacknight Solutions - Hosting
Search.ie
Armchair.ie
Quote Reply
Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to
Yup, or more to the point (and what it was originally written for :)), so you can search these fields,. i.e to give better keyword targetting (so you don't just have the normal fields to look at, i.e Description and Title).

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Andy,
Quick question,
Are your plugins developed for Links 3.0 and higher backwards compatible to 2.1.2? Reason I ask is my links installation is extremely heavily modified, and have not upgraded to 3.0. Probably won't upgrade to 3.0 unless I can find a programmer to make some serious modification to 3.0. The programmer I hired for my 2.12 installation has since gotten out of the business... hence the backwards compatability question??

Happy HolidaysSmile

</not a clue>
Quote Reply
Re: [Dinky] [NEW PLUGIN] UpdateMetaValues In reply to
Hi,

Not all of them are, but this particular one should work fine from 2.1.x --> 3.0.x Smile

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Very cool plugin. Hopefully Google et al will see the changes soon

The only problem I'm having with it is that it times out ie. if I have 4000 links to parse it may get as far as link 3000 and then stall
Blacknight Solutions - Hosting
Search.ie
Armchair.ie
Quote Reply
Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to
Hi,

Thanks =)

Regarding it "stalling"... did you try running from SSH? (with the example command in the Readme :)).

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Ah. I didn't see the example in the readme.. I'll try that :)
Blacknight Solutions - Hosting
Search.ie
Armchair.ie
Quote Reply
Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to
No wonder I didn't see it .. there are no examples in the version I have installed .. Am I missing something?
Blacknight Solutions - Hosting
Search.ie
Armchair.ie
Quote Reply
Re: [blacknight] [NEW PLUGIN] UpdateMetaValues In reply to
Sorry, the command is as follows= )

Code:
cd /path/to/admin
perl admin.cgi 'do=plugin&plugin=UpdateMetaValues&func=Start'

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Mine is installed but it poops out at the same place on only the 22nd link out of 47,986 links and this is via SSH. Seems like a great plug-in if only I could get it to continue through to completion.

Any suggestions??

Thanks.

Mark
Quote Reply
Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to
OK. I must have panicked too soon. It's moving along again. It will sit at some sites for a lengthier period of time than others.
Quote Reply
Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to
In Reply To:
OK. I must have panicked too soon. It's moving along again. It will sit at some sites for a lengthier period of time than others.
Hi,

Its probably just a slow site, and took a while to get the HTML from it :) Some sites are stupidly quick, while others may just as well be running on dial up <G>

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Andy,

After running this a couple of times via SSH it gets through about the first 3,000 or so of about 48,000 links and just dies. Is there anything that can be done to spider the rest of the links in the database?

Thanks.

Mark
Quote Reply
Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to
Hi,

In /admin/Plugins/UpdateMetaValues.pm, you could try changing;

Code:
my $sth = $DB->table('Links')->select( GT::SQL::Condition->new('URL','LIKE','http://%') );

..to;

Code:
my $sth = $DB->table('Links')->select( GT::SQL::Condition->new('URL','LIKE','http://%','Meta_Title','IS','NULL') );

..or possibly this (if the above doesn't work);

Code:
my $sth = $DB->table('Links')->select( GT::SQL::Condition->new('URL','LIKE','http://%','Meta_Title','=','') );

This way, it should only re-attempt those that havn't got values already Smile

I'll probably add a staggered option at some point. Its just trying to find the time :(

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Well, the second option worked a little better - got through about 13,600 links out of 48,000. It looks like it's been sitting on the same link for over 4 hours now - probably stalled out.

I really only need the Descriptions of these links. Is it possible for it to fetc just the descriptions and not Titles and email addresses?

Thanks.

Mark
Quote Reply
Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to
Hi,

Cool :)

Regarding your last questions - please see the modified module sent via PM :)

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Andy,

After running the Description Only script, I notice that it seems to get hung up or won't go past the same link/record in the database (1256 of 33756) after several attempts. What would be neat would be able to start the plugin at any given point within the database. So I could start it at record 1258 (skipping over record 1257) if that is the hurdle.

Your thoughts...

Thanks.

Mark
Quote Reply
Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to
Hi,

I've added in a "timeout" function to the LWP::Simple module for you, so that it should only hang for 30 seconds, if its going to. I've PM'ed you the file :)

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
Thanks Andy. I'll give that a try. I'll report back to let you know how it goes.

Mark
Quote Reply
Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to
Andy,

It went all the way through without timing out!

Thanks so much!

Mark
Quote Reply
Re: [mgeyman] [NEW PLUGIN] UpdateMetaValues In reply to
Hi,

Great <G> I'll get that put in the distributed version later on today =)

Cheers

Andy (mod)
andy@ultranerds.co.uk
Want to give me something back for my help? Please see my Amazon Wish List
GLinks ULTRA Package | GLinks ULTRA Package PRO
Links SQL Plugins | Website Design and SEO | UltraNerds | ULTRAGLobals Plugin | Pre-Made Template Sets | FREE GLinks Plugins!
Quote Reply
Re: [Andy] [NEW PLUGIN] UpdateMetaValues In reply to
What the difference between updatemetavalues and the Spider plugin?
> >