Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Wikipedia: Wikitech

Fancy MediaWiki codeswarm!

  

 
Wikipedia wikitech RSS feed   Index | Next | Previous | View Threaded


leon at leonweber

Jul 19, 2008, 6:43 AM

Post #1 of 12 (1211 views)
Permalink
Fancy MediaWiki codeswarm!
Hey,

I've found that cool code_swarm tool[0] which visualizes the history of an
subversion repository. This is what we all were looking for, because it's
colored, it blinks, and it moves, so I've just ran it on mediawiki trunk,
r37834.

I've changed some of the old usernames to the current ones (like vibber ->
brion, timstarling -> tstarling, etc) , though I think I didn't catch all
of them.

The output is available as an 1024x786 h264 video[1], and there's also a small
version (640x480)[2] (in which the is not that readable, though).

It all began back in 2001 with some edits by magnus to phpwiki. The big cround
around Lee Daniel Crocker in June 2002 is when he started commiting the first
phase3 code.

Leon

[0] http://vis.cs.ucdavis.edu/~ogawa/codeswarm/
[1] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.1024x786.avi
[2] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.640x480.avi

--
Leon Weber, leon [at] leonweber 0x8E04D7FC
blog: https://leonweber.de/blog
jabber: leon [at] jabber (icq: 261067046)
--
Wer Gründe anhört, kommt in Gefahr nachzugeben. (Goethe)


innocentkiller at gmail

Jul 19, 2008, 8:10 AM

Post #2 of 12 (1176 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
On Sat, Jul 19, 2008 at 9:43 AM, Leon Weber <leon [at] leonweber> wrote:
> Hey,
>
> I've found that cool code_swarm tool[0] which visualizes the history of an
> subversion repository. This is what we all were looking for, because it's
> colored, it blinks, and it moves, so I've just ran it on mediawiki trunk,
> r37834.
>
> I've changed some of the old usernames to the current ones (like vibber ->
> brion, timstarling -> tstarling, etc) , though I think I didn't catch all
> of them.
>
> The output is available as an 1024x786 h264 video[1], and there's also a small
> version (640x480)[2] (in which the is not that readable, though).
>
> It all began back in 2001 with some edits by magnus to phpwiki. The big cround
> around Lee Daniel Crocker in June 2002 is when he started commiting the first
> phase3 code.
>
> Leon
>
> [0] http://vis.cs.ucdavis.edu/~ogawa/codeswarm/
> [1] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.1024x786.avi
> [2] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.640x480.avi
>
> --
> Leon Weber, leon [at] leonweber 0x8E04D7FC
> blog: https://leonweber.de/blog
> jabber: leon [at] jabber (icq: 261067046)
> --
> Wer Gründe anhört, kommt in Gefahr nachzugeben. (Goethe)
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>

That's really cool :-)

-Chad

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


bryan.tongminh at gmail

Jul 19, 2008, 8:19 AM

Post #3 of 12 (980 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
On Sat, Jul 19, 2008 at 3:43 PM, Leon Weber <leon [at] leonweber> wrote:

>
> I've changed some of the old usernames to the current ones (like vibber ->
> brion, timstarling -> tstarling, etc) , though I think I didn't catch all
> of them.
>

You missed the kate > river one, and I think mark and Mark Bergsma are
the same. Also an erik pops up which is probably either erik zachte or
eloquence. Otherwise, very cool!

Bryan

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


leon at leonweber

Jul 19, 2008, 8:21 AM

Post #4 of 12 (968 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
On 19.07.2008 17:19:09, Bryan Tong Minh wrote:
> On Sat, Jul 19, 2008 at 3:43 PM, Leon Weber <leon [at] leonweber> wrote:
> > I've changed some of the old usernames to the current ones (like vibber ->
> > brion, timstarling -> tstarling, etc) , though I think I didn't catch all
> > of them.
> You missed the kate > river one, and I think mark and Mark Bergsma are
> the same. Also an erik pops up which is probably either erik zachte or
> eloquence. Otherwise, very cool!

Whoops, I had river and mark in mind, then I just forgot to change it. It was
quite late ;o

Leon

--
Leon Weber, leon [at] leonweber 0x8E04D7FC
blog: https://leonweber.de/blog
jabber: leon [at] jabber (icq: 261067046)
--
Die Wahrscheinlichkeit, beim Lotto zu gewinnen, steigt rasant, wenn man
einen Lottoschein ausfüllt.


dan_the_man at telus

Jul 19, 2008, 9:22 AM

Post #5 of 12 (977 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
^_^ There were some real interesting points...

During May 2007 there's so much showing up up it's literally as if the
project exploded in a month ;)
magnus kept fading out and popping back...
As the repo crossed from 2003 into 2004 there was a small point where
lcrocker was at the center and a pile of commits just flew in, and
another set around the end of 2005...
heh, the first thing I thought of was, Gundam! >.< Particle cannon built
off info stored in MW anyone?

~Daniel Friesen(Dantman, Nadir-Seen-Fire) of:
-The Nadir-Point Group (http://nadir-point.com)
--It's Wiki-Tools subgroup (http://wiki-tools.com)
--The ElectronicMe project (http://electronic-me.org)
--Games-G.P.S. (http://ggps.org)
-And Wikia ACG on Wikia.com (http://wikia.com/wiki/Wikia_ACG)
--Animepedia (http://anime.wikia.com)
--Narutopedia (http://naruto.wikia.com)


Leon Weber wrote:
> Hey,
>
> I've found that cool code_swarm tool[0] which visualizes the history of an
> subversion repository. This is what we all were looking for, because it's
> colored, it blinks, and it moves, so I've just ran it on mediawiki trunk,
> r37834.
>
> I've changed some of the old usernames to the current ones (like vibber ->
> brion, timstarling -> tstarling, etc) , though I think I didn't catch all
> of them.
>
> The output is available as an 1024x786 h264 video[1], and there's also a small
> version (640x480)[2] (in which the is not that readable, though).
>
> It all began back in 2001 with some edits by magnus to phpwiki. The big cround
> around Lee Daniel Crocker in June 2002 is when he started commiting the first
> phase3 code.
>
> Leon
>
> [0] http://vis.cs.ucdavis.edu/~ogawa/codeswarm/
> [1] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.1024x786.avi
> [2] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.640x480.avi
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


dan_the_man at telus

Jul 19, 2008, 11:26 AM

Post #6 of 12 (976 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
Did you notice that MediaWiki (Though they're using the common mistake
of using the name Wikimedia) is on the ToDo list for data import?
http://code.google.com/p/codeswarm/wiki/GeneralPlan

When do you think we'll see something for WP?

~Daniel Friesen(Dantman, Nadir-Seen-Fire) of:
-The Nadir-Point Group (http://nadir-point.com)
--It's Wiki-Tools subgroup (http://wiki-tools.com)
--The ElectronicMe project (http://electronic-me.org)
--Games-G.P.S. (http://ggps.org)
-And Wikia ACG on Wikia.com (http://wikia.com/wiki/Wikia_ACG)
--Animepedia (http://anime.wikia.com)
--Narutopedia (http://naruto.wikia.com)

Leon Weber wrote:
> Hey,
>
> I've found that cool code_swarm tool[0] which visualizes the history of an
> subversion repository. This is what we all were looking for, because it's
> colored, it blinks, and it moves, so I've just ran it on mediawiki trunk,
> r37834.
>
> I've changed some of the old usernames to the current ones (like vibber ->
> brion, timstarling -> tstarling, etc) , though I think I didn't catch all
> of them.
>
> The output is available as an 1024x786 h264 video[1], and there's also a small
> version (640x480)[2] (in which the is not that readable, though).
>
> It all began back in 2001 with some edits by magnus to phpwiki. The big cround
> around Lee Daniel Crocker in June 2002 is when he started commiting the first
> phase3 code.
>
> Leon
>
> [0] http://vis.cs.ucdavis.edu/~ogawa/codeswarm/
> [1] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.1024x786.avi
> [2] http://zaphod.leonweber.de/codeswarms/mediawiki.h264.640x480.avi
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


leon at leonweber

Jul 19, 2008, 11:32 AM

Post #7 of 12 (968 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
On 19.07.2008 11:26:27, Daniel Friesen wrote:
> Did you notice that MediaWiki (Though they're using the common mistake
> of using the name Wikimedia) is on the ToDo list for data import?
> http://code.google.com/p/codeswarm/wiki/GeneralPlan

Yeah, saw that. Would be a great visualization for large articles. Anyone
volunteering to implement it? ;-)

Leon


--
Leon Weber, leon [at] leonweber 0x8E04D7FC
blog: https://leonweber.de/blog
jabber: leon [at] jabber (icq: 261067046)
--
Wer Gründe anhört, kommt in Gefahr nachzugeben. (Goethe)


dan_the_man at telus

Jul 19, 2008, 7:35 PM

Post #8 of 12 (955 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
I was actually considering it while away. It honestly doesn't seam to
hard looking at the format. You could probably develop two simultaneous
versions, one that uses the API (slow because of throttle, but works
remotely) and another that uses the database (faster, but you need
access to the revisions table, or at least a dump).

~Daniel Friesen(Dantman, Nadir-Seen-Fire) of:
-The Nadir-Point Group (http://nadir-point.com)
--It's Wiki-Tools subgroup (http://wiki-tools.com)
--The ElectronicMe project (http://electronic-me.org)
--Games-G.P.S. (http://ggps.org)
-And Wikia ACG on Wikia.com (http://wikia.com/wiki/Wikia_ACG)
--Animepedia (http://anime.wikia.com)
--Narutopedia (http://naruto.wikia.com)

Leon Weber wrote:
> On 19.07.2008 11:26:27, Daniel Friesen wrote:
>
>> Did you notice that MediaWiki (Though they're using the common mistake
>> of using the name Wikimedia) is on the ToDo list for data import?
>> http://code.google.com/p/codeswarm/wiki/GeneralPlan
>>
>
> Yeah, saw that. Would be a great visualization for large articles. Anyone
> volunteering to implement it? ;-)
>
> Leon
>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


dan_the_man at telus

Jul 20, 2008, 3:14 PM

Post #9 of 12 (940 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
^_^ Already done...
I coded a small extension to export histories from the database into a
plain format... And modified the converter to support the format.
Though it may be a little bit before I can get that committed.

While waiting:
http://naruto.wikia.com/wiki/Forum:A_visual_history_of_the_Narutopedia

^_^ Tips for getting x264 encodings to work on Windows would be nice.
I just get a:
x264 [error]: no ratecontrol method specified
x264_encoder_open failed.
FATAL: Cannot initialize video driver.

~Daniel Friesen(Dantman, Nadir-Seen-Fire) of:
-The Nadir-Point Group (http://nadir-point.com)
--It's Wiki-Tools subgroup (http://wiki-tools.com)
--The ElectronicMe project (http://electronic-me.org)
--Games-G.P.S. (http://ggps.org)
-And Wikia ACG on Wikia.com (http://wikia.com/wiki/Wikia_ACG)
--Animepedia (http://anime.wikia.com)
--Narutopedia (http://naruto.wikia.com)

Leon Weber wrote:
> On 19.07.2008 11:26:27, Daniel Friesen wrote:
>
>> Did you notice that MediaWiki (Though they're using the common mistake
>> of using the name Wikimedia) is on the ToDo list for data import?
>> http://code.google.com/p/codeswarm/wiki/GeneralPlan
>>
>
> Yeah, saw that. Would be a great visualization for large articles. Anyone
> volunteering to implement it? ;-)
>
> Leon
>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


brion at wikimedia

Jul 21, 2008, 11:40 AM

Post #10 of 12 (928 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
Daniel Friesen wrote:
> ^_^ Already done...
> I coded a small extension to export histories from the database into a
> plain format... And modified the converter to support the format.
> Though it may be a little bit before I can get that committed.

Cool!

Would be interesting to be able to make such visualizations for given
sets of pages, categories, etc...

-- brion

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


dan_the_man at telus

Jul 21, 2008, 12:40 PM

Post #11 of 12 (927 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
Well, right now it's a simple maintenance script. I've got support for
--usersonly (strip out anon and system users [id:0]) and a prefix so
rather than grouping pages together, you can use a prefix and have
export from multiple wiki using --append --startid=0 and have multiple
projects exported into the same log and use that prefix inside of
code_swarm to give you a visualization of how much the contributors to
the individual projects interact.

Though, the code_swarm project wants to make this something that can be
done using a GUI and doesn't require developer tools to work with. So
ideally this would become a SpecialPage extension with an extra
maintenance script for larger projects. Then using the GUI you could
select what kind of visualization you want.

^_^ Actually, ideally someone would make a extension for integrating
code_swarm into MediaWiki itself. A SpecialPage for listing out existing
visualization videos (and administrators could force generate a set),
one for managing a list of visualization types, and a cron job would
periodically rebuild those visualizations.


Though, to be honest I don't know about how well code_swarm will
visualize some projects. The Narutopedia is fairly small, not dead, but
still it has a limited number of people contributing to it. And as you
may have saw with my videos, it got pretty crammed together. Wiki on
diverse topics like Wikipedia may have enough user separation to have
groups show up and stop to much from clumping together. But any sort of
focused project will probably look more like an explosion at some point.
^_^ Though, any project will probably look like that if you don't remove
the anonymous users from the report.

~Daniel Friesen(Dantman, Nadir-Seen-Fire) of:
-The Nadir-Point Group (http://nadir-point.com)
--It's Wiki-Tools subgroup (http://wiki-tools.com)
--The ElectronicMe project (http://electronic-me.org)
--Games-G.P.S. (http://ggps.org)
-And Wikia ACG on Wikia.com (http://wikia.com/wiki/Wikia_ACG)
--Animepedia (http://anime.wikia.com)
--Narutopedia (http://naruto.wikia.com)

Brion Vibber wrote:
> Daniel Friesen wrote:
>
>> ^_^ Already done...
>> I coded a small extension to export histories from the database into a
>> plain format... And modified the converter to support the format.
>> Though it may be a little bit before I can get that committed.
>>
>
> Cool!
>
> Would be interesting to be able to make such visualizations for given
> sets of pages, categories, etc...
>
> -- brion
>
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


dan_the_man at telus

Jul 22, 2008, 10:58 PM

Post #12 of 12 (917 views)
Permalink
Re: Fancy MediaWiki codeswarm! [In reply to]
^_^ And it's done.

My SwarmExport extension can be found at:
http://wiki-tools.com/wiki/SwarmExport

There's a page in the code swarm project on generating a video, I've
modified it to also include information on doing it for a wiki:
http://code.google.com/p/codeswarm/wiki/GeneratingAVideo

~Daniel Friesen(Dantman, Nadir-Seen-Fire) of:
-The Nadir-Point Group (http://nadir-point.com)
--It's Wiki-Tools subgroup (http://wiki-tools.com)
--The ElectronicMe project (http://electronic-me.org)
--Games-G.P.S. (http://ggps.org)
-And Wikia ACG on Wikia.com (http://wikia.com/wiki/Wikia_ACG)
--Animepedia (http://anime.wikia.com)
--Narutopedia (http://naruto.wikia.com)


_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Wikipedia wikitech RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.