Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Wikipedia: Wikitech

not able to generate robot.txt with $wgDefaultRobotPolicy

 

 

Wikipedia wikitech RSS feed   Index | Next | Previous | View Threaded


the_rock3353 at yahoo

Jul 14, 2008, 9:46 AM

Post #1 of 5 (293 views)
Permalink
not able to generate robot.txt with $wgDefaultRobotPolicy

Hi,

I am specifying:

$wgDefaultRobotPolicy = 'index,follow';
$wgNamespaceRobotPolicies = array( NS_MAIN => 'index,follow' );
$wgArticleRobotPolicies = array( 'Main Page' => 'index,follow' );

in my LocalSettings.php file but it is not generating any "robot.txt" file.
Mediawiki is supposed to generate this file right?

Thanks,








_______________________________________________
Wikitech-l mailing list
Wikitech-l[at]lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


minuteelectron at googlemail

Jul 14, 2008, 9:50 AM

Post #2 of 5 (269 views)
Permalink
Re: not able to generate robot.txt with $wgDefaultRobotPolicy [In reply to]

gbtkjd dgjksbg wrote:
> Hi,
>
> I am specifying:
>
> $wgDefaultRobotPolicy = 'index,follow';
> $wgNamespaceRobotPolicies = array( NS_MAIN => 'index,follow' );
> $wgArticleRobotPolicies = array( 'Main Page' => 'index,follow' );
>
> in my LocalSettings.php file but it is not generating any "robot.txt" file.
> Mediawiki is supposed to generate this file right?

No, this controls the meta tags that inform robots of how to handle
individual pages. It does not generate a robots.txt file.

MinuteElectron.

_______________________________________________
Wikitech-l mailing list
Wikitech-l[at]lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


the_rock3353 at yahoo

Jul 14, 2008, 10:21 AM

Post #3 of 5 (272 views)
Permalink
Re: not able to generate robot.txt with $wgDefaultRobotPolicy [In reply to]

Hi,

So 1) How do I generate robot.txt and 2) How do add mediawiki entries in that file.

Thanks,



--- On Mon, 7/14/08, MinuteElectron <minuteelectron[at]googlemail.com> wrote:
From: MinuteElectron <minuteelectron[at]googlemail.com>
Subject: Re: [Wikitech-l] not able to generate robot.txt with $wgDefaultRobotPolicy
To: the_rock3353[at]yahoo.com, "Wikimedia developers" <wikitech-l[at]lists.wikimedia.org>
Date: Monday, July 14, 2008, 11:50 AM

gbtkjd dgjksbg wrote:
> Hi,
>
> I am specifying:
>
> $wgDefaultRobotPolicy = 'index,follow';
> $wgNamespaceRobotPolicies = array( NS_MAIN => 'index,follow' );
> $wgArticleRobotPolicies = array( 'Main Page' =>
'index,follow' );
>
> in my LocalSettings.php file but it is not generating any
"robot.txt" file.
> Mediawiki is supposed to generate this file right?

No, this controls the meta tags that inform robots of how to handle
individual pages. It does not generate a robots.txt file.

MinuteElectron.



_______________________________________________
Wikitech-l mailing list
Wikitech-l[at]lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


minuteelectron at googlemail

Jul 14, 2008, 12:46 PM

Post #4 of 5 (261 views)
Permalink
Re: not able to generate robot.txt with $wgDefaultRobotPolicy [In reply to]

gbtkjd dgjksbg wrote:
> So 1) How do I generate robot.txt and 2) How do add mediawiki entries in
> that file.

You do not need to if you are using them variables. MediaWiki has no
capability to generate robots.txt files.

MinuteElectron.

_______________________________________________
Wikitech-l mailing list
Wikitech-l[at]lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Simetrical+wikilist at gmail

Jul 14, 2008, 5:24 PM

Post #5 of 5 (261 views)
Permalink
Re: not able to generate robot.txt with $wgDefaultRobotPolicy [In reply to]

On Mon, Jul 14, 2008 at 1:21 PM, gbtkjd dgjksbg <the_rock3353[at]yahoo.com> wrote:
> So 1) How do I generate robot.txt and 2) How do add mediawiki entries in that file.

Create it manually. You don't need MediaWiki to do this for you. See
this page on mediawiki.org:

http://www.mediawiki.org/wiki/Robots.txt

_______________________________________________
Wikitech-l mailing list
Wikitech-l[at]lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Wikipedia wikitech RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact lists@gossamer-threads.com
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.