Mailing List Archive: Wikipedia: Wikitech

(no subject)

Index | Next | Previous | View Threaded

Edmund.W.Poor at abc

Nov 22, 2002, 9:10 AM

Post #1 of 12 (1760 views)
Permalink

(no subject)

I used to be a Network Administrator for a company with 300 seats, plus as a software developer I had admin rights to all the company's MS SQL Server databases. Unclogging the network and resolving database gridlock were 2 areas I excelled in there.

If you'd like to give me developer access, I could take a look around and try to see what keeps slowing us down. I guess it's a lot of different things, many of which Brion has already identified.

But the fact that restarting the machine always speeds thing up again indicates the probable presence of one or more as-yet unidentified problems.

Of course, as a "developer" I would be ever scrupulous about the "rules" -- I would absolutely not use developer rights to, say, win a POV battle or unilaterally ban an obnoxious user.

Ed Poor
"Opinions and proposals expressed in this letter are mine personally, and are unrelated to any aims or policies of my employer."

magnus.manske at epost

Nov 22, 2002, 11:13 AM

Post #2 of 12 (1698 views)
Permalink

Re: (no subject) [In reply to]

Poor, Edmund W wrote:

>I used to be a Network Administrator for a company with 300 seats, plus as a software developer I had admin rights to all the company's MS SQL Server databases. Unclogging the network and resolving database gridlock were 2 areas I excelled in there.
>
>If you'd like to give me developer access, I could take a look around and try to see what keeps slowing us down. I guess it's a lot of different things, many of which Brion has already identified.
>
Done. For the site, that is. You'll need Jimbo to give you ssh access to
the server.

Magnus

saintonge at telus

Feb 2, 2004, 12:41 AM

Post #3 of 12 (1690 views)
Permalink

Re: (no subject) [In reply to]

This sounds interesting. I know nothing about the technical side either
and would not consider competing for podium space; I don't even know
whether the conference itself would interest me.

If enough people are interested this could serve as the excuse for a
get-together of Wikipedians, particularly the ones on the West coast.
For me it's a leisurely 6-hour drive from Vancouver. There was talk
about such things last year that never materialized.

Ec

Geoff Burling wrote:

>This year, O'Reilly will be presenting the Open Source Convention here
>is Portland, Oregon. Since travelling to it is a negligible task
>(it's in downtown, & I usually commute further to work than there), I've
>been considering making a presentation about Wikipedia at this year's
>convention.
>
>However, I can think of about a dozen people who know far more about
>the goings-on at Wikipedia than me (e.g., Brion, Magnus, Mav, Ed Poor --
>practically everyone on this mailling list), & I wanted to make sure that
>
>1. No one is planning on making a similar presentation;
>
>2. No one minds that I attempt to give what O'Reilly calls a "Session
>Presentation" (it's a 90 minute talk) on Wikipedia.
>
>Obviously, I'm not very familiar with the technical side of Wikipedia --
>although the challenge of keeping one of the largest Wikiwiki sites up
>& running is something that any talk needs to address. My intended emphasis
>for this talk would be more on the social side -- as well as addressing
>the perennial question, ``Can a distributed group of people write a
>useable encyclopedia?" (FWIW, my honest answer to that question is yes.)
>
>More information about making presentations at OSCON is available at
>http://conferences.oreillynet.com/os2004/
>

brion at pobox

Aug 9, 2004, 11:23 AM

Post #4 of 12 (1711 views)
Permalink

Re: (no subject) [In reply to]

karl [at] karllong wrote:
> Warning: $wgProxyKey is insecure Can't find a writable temp
> directory for the XHTML template. Check that the TMP environment
> variable points to a writable directory, or that the default temp
> dir (/tmp) exists and is writable.

So have you done this?

-- brion vibber (brion @ pobox.com)

Attachments:

signature.asc (0.25 KB)

dgerard at gmail

Feb 20, 2006, 5:04 AM

Post #5 of 12 (1704 views)
Permalink

Re: (no subject) [In reply to]

I've got no idea what I need to unblock for this to work :-( Try again
until you get a different IP address?

I've cc'ed this to the technical list for their consideration. This
user is on AOL and is blocked from creating an account, but we don't
have enough information for me to work out which autoblock is causing
the problem and undo it.

- d.

On 20/02/06, WARDCOLIN6 [at] aol <WARDCOLIN6 [at] aol> wrote:

> When I tried to create an account in order to logon, I was told that I had already opened ten accounts and was blocked from creating any more.
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] wikimedia
http://mail.wikipedia.org/mailman/listinfo/wikitech-l

brion at pobox

Feb 20, 2006, 11:02 AM

Post #6 of 12 (1695 views)
Permalink

Re: (no subject) [In reply to]

David Gerard wrote:
> I've got no idea what I need to unblock for this to work :-( Try again
> until you get a different IP address?
>
> I've cc'ed this to the technical list for their consideration. This
> user is on AOL and is blocked from creating an account, but we don't
> have enough information for me to work out which autoblock is causing
> the problem and undo it.

That's the rate limiter, not the autoblocker.

Wait a day and try again.

-- brion vibber (brion @ pobox.com)

Attachments:

signature.asc (0.24 KB)

thibaut.deveraux at gmail

Jul 3, 2009, 6:10 AM

Post #7 of 12 (1392 views)
Permalink

Re: (no subject) [In reply to]

Sorry for double mail; Can we imagine a search motor that can look into :
1 - The mailing lists where users can ask questions
2 - The main forums
3 - The main site with documentation (mediawiki.org and sites such as
semantic-mediawiki)
4 - ...

Google can does 2 and 3, I don't know about 1.

There is also layers that goes more work than a simple personalised google.

2009/7/3 Thibaut DEVERAUX <thibaut.deveraux [at] gmail>

> What about a search motor wich can find information into thoose mailings ?
> This is not a "solution" but this is a way to make the users able to find
> information.
>
>
>
> Original messages :
>
> Ever met a developer who likes writing doc? :)
>
> > and a lot of the docs have never been read by a developer. That being
> > said, using FlaggedRevs we might be able to deliver more solid docs
> > on MW.org by flagging docs at like two levels. One could be like a basic
> > "has been looked over for glaring errors and basic readability" and
> > a second could be "has been thoroughly reviewed and is considered
> > the doc on the given subject."
>
> Perhaps we could start by getting developers to thoroughly review
> documentation?
>
> You're proposing a technical solution to a people problem. The problem
> is not that the site can't display the fact that a developer vouches
> for the quality of documentation. The problem is that there are no
> processes for getting developers to review documentation and vouch for
> it.
>
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

innocentkiller at gmail

Jul 3, 2009, 6:23 AM

Post #8 of 12 (1381 views)
Permalink

Re: (no subject) [In reply to]

I'm not sure what you're proposing here. I think the
primary problem isn't "where are the docs?" but rather
"how good are the docs?"

A great example came up in #mediawiki a few days
ago. A user asked about using pretty urls relative to
their document root (ie: example.com/Page). A good
number of us gave the typical line about it being
broken and to not use it. Upon further discussion, it
became more clear that this idea was not broken due
to huge issues in Mediawiki itself, but rather that's
what the docs said so we just treated it as fact.

That's obviously not a position we wish to take on our
documentation. It hinders proper support of the
software and wastes everyone's time.

-Chad

On Jul 3, 2009 9:11 AM, "Thibaut DEVERAUX" <thibaut.deveraux [at] gmail>
wrote:

Sorry for double mail; Can we imagine a search motor that can look into :
1 - The mailing lists where users can ask questions
2 - The main forums
3 - The main site with documentation (mediawiki.org and sites such as
semantic-mediawiki)
4 - ...

Google can does 2 and 3, I don't know about 1.

There is also layers that goes more work than a simple personalised google.

2009/7/3 Thibaut DEVERAUX <thibaut.deveraux [at] gmail>

> What about a search motor wich can find information into thoose mailings ?
> This is not a "solut...
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

daniel at brightbyte

Jul 3, 2009, 9:03 AM

Post #9 of 12 (1386 views)
Permalink

Re: (no subject) [In reply to]

Chad schrieb:
> I'm not sure what you're proposing here. I think the
> primary problem isn't "where are the docs?" but rather
> "how good are the docs?"
>
> A great example came up in #mediawiki a few days
> ago. A user asked about using pretty urls relative to
> their document root (ie: example.com/Page). A good
> number of us gave the typical line about it being
> broken and to not use it. Upon further discussion, it
> became more clear that this idea was not broken due
> to huge issues in Mediawiki itself, but rather that's
> what the docs said so we just treated it as fact.

The idea is broken not due to technical problems, but due to conceptual
problems, malely namespace pollution. mixing two different things (files and
wiki pages) in the same namespace is a bad thing. it can be done, but it often
leads to problems. This is why the documentation recommends against it. But the
documentation also tells you how to do it.

-- daniel

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

mike.lifeguard at gmail

Sep 5, 2009, 3:24 PM

Post #10 of 12 (1228 views)
Permalink

Re: (no subject) [In reply to]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

>> A while back I ran clamav against all 'executable' looking external links and found one nasty file. It would be really nice if the mechanism that updates externalinks table spat out a running log of external link additions and removals that we could hook an ongoing scanner into.
>
>
> Simple matter of coding, then? :-)

This sort of thing would hekp with some of or external antispam tools.
Currently we rely on parsing edits manually to see when links are added
- - some realtime and machine-readable format for notifications of such
edits would be great.

- -Mike
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (GNU/Linux)

iEYEARECAAYFAkqi5QgACgkQst0AR/DaKHuxVQCglYidNlbvwkEmFELrK9IJm4Oy
gvMAn05SP3jmptvGif0GGA5xM518Mq/t
=BEi7
-----END PGP SIGNATURE-----

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Platonides at gmail

Sep 5, 2009, 3:47 PM

Post #11 of 12 (1239 views)
Permalink

Re: (no subject) [In reply to]

Mike.lifeguard wrote:
>> Simple matter of coding, then? :-)
>
> This sort of thing would hekp with some of or external antispam tools.
> Currently we rely on parsing edits manually to see when links are added
> - some realtime and machine-readable format for notifications of such
> edits would be great.
>
> -Mike

File a bug?
This probably depends on bug 17450 and should block 16599.

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

marco at harddisk

Jan 28, 2010, 11:21 AM

Post #12 of 12 (835 views)
Permalink

Re: (no subject) [In reply to]

On Thu, Jan 28, 2010 at 5:02 PM, Tei <oscar.vives [at] gmail> wrote:

> On 28 January 2010 15:06, 李琴 <qli [at] ica> wrote:
> > Hi all,
> > I have built a LocalWiki. Now I want the data of it to keep
> consistent
> > with the
> > Wikipedia and one work I should do is to get the data of update from
> > Wikipedia.
> > I get the URLs through analyzing the RSS
> > (
> http://zh.wikipedia.org/w/index.php?title=Special:%E6%9C%80%E8%BF%91%E6%9B%B4%E6%94%B9&feed=rss
> )
> > and get all HTML content of the edit box by analyzing
> > these URLs after opening an URL and clicking the ’edit this page’.
> ....
> > That’s because I visit it too frequently and my IP address is prohibited
> > or the network is too slow?
>
> 李琴 well.. thats webscrapping, that is a poor tecnique, one with lots
> of errors that generate lots of trafic.
>
> One thing a robot must do is read and follow the
> http://zh.wikipedia.org/robots.txt file ( probably you sould read it
> too)
> As a general rule of Internet, a "rude" robot will be banned by the
> site admins.
>
> It would be a good idea to anounce your bot as a bot in the user_agent
> string . Good bot beavior is one that read a website like a human. I
> don't know, like 10 request minute?. I don't know about this
> "Wikipedia" site rules about it.
>
> What you are suffering could be automatic or manual throttling, since
> is detected a abusive number of request from your IP.
>
> "Wikipedia" seems to provide fulldumps of his wiki, but are unusable
> for you, since are giganteous :-/, trying to rebuilt wikipedia on your
> PC with a snapshot would be like summoning Tchulu in a teapot. But.. I
> don't know, maybe the zh version is smaller, or your resources
> powerfull enough. One feels that what you have built has a severe
> overload (wastage of resources) and there must be better ways to do
> it...
>
Indeed there are. What you need:
1) the Wikimedia IRC live feed - last time I've looked at it, it was at
irc://irc.wikimedia.org/ and then each project had its own channel.
2) A PHP IRC bot framework - Net_SmartIRC is well-written and easy to get
started with
3) the page source you can EASILY get either in rendered form
http://zh.wikipedia.org/w/index.php?title=TITLE&action=render or in raw form
http://zh.wikipedia.org/w/index.php?title=TITLE&action=raw (this is page
source).

Marco

--
VMSoft GbR
Nabburger Str. 15
81737 München
Geschäftsführer: Marco Schuster, Volker Hemmert
http://vmsoft-gbr.de
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads