Mailing List Archive: Wikipedia: Wikitech

git.wikimedia.org dead?

Index | Next | Previous | View Threaded

rupert.thurner at gmail

Aug 10, 2013, 6:39 AM

Post #1 of 10 (34 views)
Permalink

git.wikimedia.org dead?

hi,

https://git.wikimedia.org/ seems to be dead.

rupert.

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

z at mzmcbride

Aug 10, 2013, 7:49 AM

Post #2 of 10 (33 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

rupert THURNER wrote:
>https://git.wikimedia.org/ seems to be dead.

Yup. It keeps happening: <https://bugzilla.wikimedia.org/51769>.

MZMcBride

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

rupert.thurner at gmail

Aug 10, 2013, 1:52 PM

Post #3 of 10 (26 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

On Sat, Aug 10, 2013 at 4:49 PM, MZMcBride <z [at] mzmcbride> wrote:
> rupert THURNER wrote:
>>https://git.wikimedia.org/ seems to be dead.
>
> Yup. It keeps happening: <https://bugzilla.wikimedia.org/51769>.

would it be possible to help debugging this?

rupert.

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

lcarr at wikimedia

Aug 10, 2013, 5:44 PM

Post #4 of 10 (26 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

Ahha -

looks like the robots.txt isn't being served - so googlebot is
grabbing things from the zip files
client denied by server configuration: /var/www/robots.txt

sadly too jetlagged to keep looking at this :(

On Sun, Aug 11, 2013 at 4:52 AM, rupert THURNER
<rupert.thurner [at] gmail> wrote:
> On Sat, Aug 10, 2013 at 4:49 PM, MZMcBride <z [at] mzmcbride> wrote:
>> rupert THURNER wrote:
>>>https://git.wikimedia.org/ seems to be dead.
>>
>> Yup. It keeps happening: <https://bugzilla.wikimedia.org/51769>.
>
> would it be possible to help debugging this?
>
> rupert.
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l

--
Leslie Carr
Wikimedia Foundation
AS 14907, 43821
http://as14907.peeringdb.com/

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

innocentkiller at gmail

Aug 10, 2013, 6:09 PM

Post #5 of 10 (26 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

On Sat, Aug 10, 2013 at 5:44 PM, Leslie Carr <lcarr [at] wikimedia> wrote:

> Ahha -
>
> looks like the robots.txt isn't being served - so googlebot is
> grabbing things from the zip files
> client denied by server configuration: /var/www/robots.txt
>
> sadly too jetlagged to keep looking at this :(
>
>
We fixed this Thursday or Friday? https://git.wikimedia.org/robots.txt WFM.

-Chad
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

p858snake at gmail

Aug 10, 2013, 7:25 PM

Post #6 of 10 (26 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

On Sun, Aug 11, 2013 at 10:44 AM, Leslie Carr <lcarr [at] wikimedia> wrote:
> looks like the robots.txt isn't being served - so googlebot is
> grabbing things from the zip files
> client denied by server configuration: /var/www/robots.txt
>
> sadly too jetlagged to keep looking at this :(

make sure you look at robot.txt and not Robot.txt,

As chad points out, its being served now

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

jeremy at tuxmachine

Aug 10, 2013, 7:27 PM

Post #7 of 10 (26 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

On Sun, Aug 11, 2013 at 2:25 AM, K. Peachey <p858snake [at] gmail> wrote:
> On Sun, Aug 11, 2013 at 10:44 AM, Leslie Carr <lcarr [at] wikimedia> wrote:
>> looks like the robots.txt isn't being served - so googlebot is
>> grabbing things from the zip files
>> client denied by server configuration: /var/www/robots.txt
>>
>> sadly too jetlagged to keep looking at this :(
>
> make sure you look at robot.txt and not Robot.txt,
>
> As chad points out, its being served now

it's plural (robots.txt)

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

rupert.thurner at gmail

Aug 11, 2013, 3:51 AM

Post #8 of 10 (15 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

On Sun, Aug 11, 2013 at 4:27 AM, Jeremy Baron <jeremy [at] tuxmachine> wrote:
> On Sun, Aug 11, 2013 at 2:25 AM, K. Peachey <p858snake [at] gmail> wrote:
>> On Sun, Aug 11, 2013 at 10:44 AM, Leslie Carr <lcarr [at] wikimedia> wrote:
>>> looks like the robots.txt isn't being served - so googlebot is
>>> grabbing things from the zip files
>>> client denied by server configuration: /var/www/robots.txt
>>>
>>> sadly too jetlagged to keep looking at this :(
>>
>> make sure you look at robot.txt and not Robot.txt,
>>
>> As chad points out, its being served now
>
> it's plural (robots.txt)

many thanks for getting it up quickly last time! unfortunately
https://git.wikimedia.org is unresponsive again.

rupert

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

faidon at wikimedia

Aug 11, 2013, 6:58 PM

Post #9 of 10 (7 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

Hi,

On Sun, Aug 11, 2013 at 12:51:15PM +0200, rupert THURNER wrote:
>>> As chad points out, its being served now
>>
>> it's plural (robots.txt)
>
>many thanks for getting it up quickly last time! unfortunately
>https://git.wikimedia.org is unresponsive again.

Thanks for the report! I just restarted it again. Root cause was the
same, unfortunately it's not just zip files that kill it; googlebot
asking for every file/revision is more than enough.

Until we have a better solution (and monitoring!) in place, I changed
robots.txt to Disallow /. This means no search indexing for now,
unfortunately.

Faidon

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

rupert.thurner at gmail

Aug 11, 2013, 9:27 PM

Post #10 of 10 (5 views)
Permalink

Re: git.wikimedia.org dead? [In reply to]

faldon, can you attach the trace to the bugzilla ticket please?

On Mon, Aug 12, 2013 at 3:58 AM, Faidon Liambotis <faidon [at] wikimedia> wrote:
> Hi,
>
>
> On Sun, Aug 11, 2013 at 12:51:15PM +0200, rupert THURNER wrote:
>>>>
>>>> As chad points out, its being served now
>>>
>>>
>>> it's plural (robots.txt)
>>
>>
>> many thanks for getting it up quickly last time! unfortunately
>> https://git.wikimedia.org is unresponsive again.
>
>
> Thanks for the report! I just restarted it again. Root cause was the same,
> unfortunately it's not just zip files that kill it; googlebot asking for
> every file/revision is more than enough.
>
> Until we have a better solution (and monitoring!) in place, I changed
> robots.txt to Disallow /. This means no search indexing for now,
> unfortunately.
>
> Faidon
>
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads