Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Wikipedia: Wikitech

Git migration - instructions for Sysops

  

 
Wikipedia wikitech RSS feed   Index | Next | Previous | View Threaded


jidanni at jidanni

Feb 15, 2012, 5:09 PM

Post #1 of 16 (277 views)
Permalink
Git migration - instructions for Sysops
Folks, the switchover documentation is all aimed at savvy read-write
developers. We drones who just use SVN as a simple yet risky way to keep
our live version of MediaWiki fresh need instructions on how to:

* install git (OK, apt-get install git etc.)

* convert our maintenance scripts to use git commands instead of svn
commands. In particular for me

svn update

svn status

for i in RELEASE-NOTES-*
do
echo $i diff:
svn diff -r ${BASE-BASE}:HEAD $i|wdiff -d -3|tee /tmp/mediawikiDiff$$
done


Add notes also on how we first cd(1) to the right directory, run some
command that zaps all the hidden .svn files and another command that
adds all the equivalent hidden .git files or whatever.

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


innocentkiller at gmail

Feb 15, 2012, 5:17 PM

Post #2 of 16 (268 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Wed, Feb 15, 2012 at 8:09 PM, <jidanni [at] jidanni> wrote:
> Folks, the switchover documentation is all aimed at savvy read-write
> developers. We drones who just use SVN as a simple yet risky way to keep
> our live version of MediaWiki fresh need instructions on how to:
>
> * install git (OK, apt-get install git etc.)
>

Actually the package is git-core.

> * convert our maintenance scripts to use git commands instead of svn
>  commands. In particular for me
>
>    svn update
>

`git pull origin master`

>    svn status
>

`git status`

>    for i in RELEASE-NOTES-*
>        do
>            echo $i diff:
>            svn diff -r ${BASE-BASE}:HEAD $i|wdiff -d -3|tee /tmp/mediawikiDiff$$
>        done
>

We can't possibly write instructions for every obscure shell script
somebody might've come up with. For this one I'd suggest taking
a look at `git help diff` to get an idea of how git diffs work.

> Add notes also on how we first cd(1) to the right directory, run some
> command that zaps all the hidden .svn files and another command that
> adds all the equivalent hidden .git files or whatever.
>

The .git folders will exist after you clone the repository. There won't be
any .svn directories there to clean up.

-Chad

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


jeremy at tuxmachine

Feb 15, 2012, 5:28 PM

Post #3 of 16 (267 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Wed, Feb 15, 2012 at 20:17, Chad <innocentkiller [at] gmail> wrote:
> The .git folders will exist after you clone the repository. There won't be
> any .svn directories there to clean up.

.git folder (singular).

Subversion puts .svn in nested subdirectories, git doesn't. There's
only one .git and it's in the root of the repo working dir. (unless
you're using a bare repo)

So, you can remove with just `rm -rf path/to/git/repo/.git`.

-Jeremy

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


innocentkiller at gmail

Feb 15, 2012, 5:30 PM

Post #4 of 16 (269 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Wed, Feb 15, 2012 at 8:28 PM, Jeremy Baron <jeremy [at] tuxmachine> wrote:
> On Wed, Feb 15, 2012 at 20:17, Chad <innocentkiller [at] gmail> wrote:
>> The .git folders will exist after you clone the repository. There won't be
>> any .svn directories there to clean up.
>
> .git folder (singular).
>
> Subversion puts .svn in nested subdirectories, git doesn't. There's
> only one .git and it's in the root of the repo working dir. (unless
> you're using a bare repo)
>
> So, you can remove with just `rm -rf path/to/git/repo/.git`.
>

Yeah, I changed the plural in that sentence like 3 times.
Thanks for correcting me.

-Chad

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


lists at nadir-seen-fire

Feb 15, 2012, 5:32 PM

Post #5 of 16 (268 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Wed, 15 Feb 2012 17:17:28 -0800, Chad <innocentkiller [at] gmail> wrote:

> On Wed, Feb 15, 2012 at 8:09 PM, <jidanni [at] jidanni> wrote:
>> Add notes also on how we first cd(1) to the right directory, run some
>> command that zaps all the hidden .svn files and another command that
>> adds all the equivalent hidden .git files or whatever.
>>
>
> The .git folders will exist after you clone the repository. There won't
> be
> any .svn directories there to clean up.
>
> -Chad

;) Actually you mean "folder", not "folders" (well, unless you're talking
about subfolders within .git/).
Unlike .svn with its complete mess, you don't need something fancy to
clean it up. Since git uses nothing but one root .git/ folder.

Though double checking. It looks like rather than asking how to clone the
git repo. He's asking how to convert a svn based checkout to a git
checkout.

--
~Daniel Friesen (Dantman, Nadir-Seen-Fire) [http://daniel.friesen.name]

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


jidanni at jidanni

Feb 15, 2012, 8:06 PM

Post #6 of 16 (260 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
>>>>> "DF" == Daniel Friesen <lists [at] nadir-seen-fire> writes:

DF> Though double checking. It looks like rather than asking how to clone
DF> the git repo. He's asking how to convert a svn based checkout to a git
DF> checkout.

Yes, and then there's the issue of if LocalSettings.php can survive
unscathed etc.

We also read that the SVN will continue to exist in some form. So maybe
we pure downloaders don't need to do anything... for a few years.

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


innocentkiller at gmail

Feb 15, 2012, 9:13 PM

Post #7 of 16 (265 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Wed, Feb 15, 2012 at 11:06 PM, <jidanni [at] jidanni> wrote:
>>>>>> "DF" == Daniel Friesen <lists [at] nadir-seen-fire> writes:
>
> DF> Though double checking. It looks like rather than asking how to clone
> DF> the git repo. He's asking how to convert a svn based checkout to a git
> DF> checkout.
>
> Yes, and then there's the issue of if LocalSettings.php can survive
> unscathed etc.

You should do a fresh clone from git rather than trying to turn
a SVN repo into a Git one. Then you can just copy LocalSettings
from one directory to another.

> We also read that the SVN will continue to exist in some form. So maybe
> we pure downloaders don't need to do anything... for a few years.
>

Yes, we do plan to leave SVN up in read-only form for quite some
time after the changeover. Be aware that once we switch, changes
won't be merged back into the SVN.

-Chad

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


petr.kadlec at gmail

Feb 15, 2012, 11:54 PM

Post #8 of 16 (256 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On 16 February 2012 02:28, Jeremy Baron <jeremy [at] tuxmachine> wrote:
> Subversion puts .svn in nested subdirectories, git doesn't.

Not anymore. Since Subversion 1.7, there is only one .svn directory in
the root of the working copy.

-- [[cs:User:Mormegil | Petr Kadlec]]

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


lists at nadir-seen-fire

Feb 16, 2012, 12:14 AM

Post #9 of 16 (257 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Wed, 15 Feb 2012 23:54:29 -0800, Petr Kadlec <petr.kadlec [at] gmail>
wrote:

> On 16 February 2012 02:28, Jeremy Baron <jeremy [at] tuxmachine> wrote:
>> Subversion puts .svn in nested subdirectories, git doesn't.
>
> Not anymore. Since Subversion 1.7, there is only one .svn directory in
> the root of the working copy.
>
> -- [[cs:User:Mormegil | Petr Kadlec]]

Of course no-one uses 1.7 ;)

--
~Daniel Friesen (Dantman, Nadir-Seen-Fire) [http://daniel.friesen.name]

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


hashar+wmf at free

Feb 16, 2012, 5:43 AM

Post #10 of 16 (259 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
Jidanni wrote:
>
> for i in RELEASE-NOTES-*
> do
> echo $i diff:
> svn diff -r ${BASE-BASE}:HEAD $i|wdiff -d -3|tee
> /tmp/mediawikiDiff$$
> done

To achieve that you will have to fetch objects and references from
the remote repository without changing anything locally. Then run
the difference between the objects.

First find out the repository name with 'git remote':

$ git remote
origin
$

When cloning a repository, 'origin' is the default name.

Fetch objects from the repository:

$ git fetch origin
remote: Counting objects: 37, done
remote: Finding sources: 100% (22/22)
remote: Total 22 (delta 13), reused 17 (delta 13)
Unpacking objects: 100% (22/22), done.
From ssh://to/some/path/there
81e98d4..858cf92 master -> origin/master
$

Now that you have all objects from the remote repository, you
can locally do a difference using 'git diff'. The syntax being:

git diff <localbranch>..<remote>/<remotebranch> [somefile]

So that would be:
git diff master..origin/master

The 'git diff' command supports various options, one of them
being word diff so you can probably skip the widff utility.


git diff master..origin/master --word-diff=color


To sum it up:

git fetch origin
git diff master..origin/master \
--word-diff=plain \
--color=never \
RELEASE-NOTES-1.20

If your terminal supports color just --word-diff=color


--
Antoine "hashar" Musso


_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Platonides at gmail

Feb 16, 2012, 11:02 AM

Post #11 of 16 (260 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On 16/02/12 06:13, Chad wrote:
> On Wed, Feb 15, 2012 at 11:06 PM, <jidanni [at] jidanni> wrote:
>>>>>>> "DF" == Daniel Friesen <lists [at] nadir-seen-fire> writes:
>>
>> DF> Though double checking. It looks like rather than asking how to clone
>> DF> the git repo. He's asking how to convert a svn based checkout to a git
>> DF> checkout.
>>
>> Yes, and then there's the issue of if LocalSettings.php can survive
>> unscathed etc.
>
> You should do a fresh clone from git rather than trying to turn
> a SVN repo into a Git one. Then you can just copy LocalSettings
> from one directory to another.

There's also images, caches...
Seems easier to upgrade a svn checkout to a git one:

# You had long ago done:
svn co http://svn.wikimedia.org/svnroot/mediawiki/trunk/phase3/
cd phase3
echo '<?php /* Some configuration */' > LocalSettings.php

# Now you do in phase3:

git clone --no-checkout --bare --depth=1
https://github.com/mediawiki/mediawiki-trunk-phase3.git .git
git config --unset core.bare
git reset


Due to svn:keywords expansion you will end with 86 modified files... :(


_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


gicodewarrior at gmail

Feb 16, 2012, 12:29 PM

Post #12 of 16 (256 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Wed, Feb 15, 2012 at 5:17 PM, Chad <innocentkiller [at] gmail> wrote:
> On Wed, Feb 15, 2012 at 8:09 PM,  <jidanni [at] jidanni> wrote:
>> * install git (OK, apt-get install git etc.)
>
> Actually the package is git-core.

In Ubuntu 10.04 and earlier it is "git-core". In 10.10 and forward it is "git".

They needed time to deprecate the GNU Interactive Tools "git" package
after it was moved to "gnuit" in 08.10.

~Rusty

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


innocentkiller at gmail

Feb 16, 2012, 12:37 PM

Post #13 of 16 (256 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On Thu, Feb 16, 2012 at 3:29 PM, Rusty Burchfield
<gicodewarrior [at] gmail> wrote:
> On Wed, Feb 15, 2012 at 5:17 PM, Chad <innocentkiller [at] gmail> wrote:
>> On Wed, Feb 15, 2012 at 8:09 PM,  <jidanni [at] jidanni> wrote:
>>> * install git (OK, apt-get install git etc.)
>>
>> Actually the package is git-core.
>
> In Ubuntu 10.04 and earlier it is "git-core".  In 10.10 and forward it is "git".
>
> They needed time to deprecate the GNU Interactive Tools "git" package
> after it was moved to "gnuit" in 08.10.
>

Ah, I didn't know the history there. Thanks for clarifying.

-Chad

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Platonides at gmail

Feb 16, 2012, 1:10 PM

Post #14 of 16 (256 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
On 16/02/12 02:17, Chad wrote:
> On Wed, Feb 15, 2012 at 8:09 PM, <jidanni [at] jidanni> wrote:
>> * convert our maintenance scripts to use git commands instead of svn
>> commands. In particular for me
>>
>> svn update
>>
>
> `git pull origin master`

Usually git pull is enough.


>> svn status
>>
>
> `git status`

It's not a simple replacement. git status can be quite unintuitive to
those used to the much simpler svn status.

>> for i in RELEASE-NOTES-*
>> do
>> echo $i diff:
>> svn diff -r ${BASE-BASE}:HEAD $i|wdiff -d -3|tee /tmp/mediawikiDiff$$
>> done
>>

I think you could replace the svn line with
git diff $BASE HEAD $i
(HEAD being optional there)


_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


stevagewp at gmail

Feb 17, 2012, 2:55 AM

Post #15 of 16 (256 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
Hi,
I'm not involved in media wiki development but I've been through the got
thing a couple of times. There's an alternative command line interface
called easygit which you can download and install. It makes the learning
curve shallower with more intuitive commands, more helpful output and much
better man pages.

Steve
On Feb 16, 2012 12:10 PM, <jidanni [at] jidanni> wrote:

> Folks, the switchover documentation is all aimed at savvy read-write
> developers. We drones who just use SVN as a simple yet risky way to keep
> our live version of MediaWiki fresh need instructions on how to:
>
> * install git (OK, apt-get install git etc.)
>
> * convert our maintenance scripts to use git commands instead of svn
> commands. In particular for me
>
> svn update
>
> svn status
>
> for i in RELEASE-NOTES-*
> do
> echo $i diff:
> svn diff -r ${BASE-BASE}:HEAD $i|wdiff -d -3|tee
> /tmp/mediawikiDiff$$
> done
>
>
> Add notes also on how we first cd(1) to the right directory, run some
> command that zaps all the hidden .svn files and another command that
> adds all the equivalent hidden .git files or whatever.
>
> _______________________________________________
> Wikitech-l mailing list
> Wikitech-l [at] lists
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


jidanni at jidanni

Feb 22, 2012, 3:49 AM

Post #16 of 16 (251 views)
Permalink
Re: Git migration - instructions for Sysops [In reply to]
>>>>> "C" == Chad <innocentkiller [at] gmail> writes:

C> Yes, we do plan to leave SVN up in read-only form for quite some
C> time after the changeover. Be aware that once we switch, changes
C> won't be merged back into the SVN.

OK, my plan then is to do my weekly 'svn update's until I notice one day
they don't update anything anymore. Whereupon I will look back at the
notes in this thread and the latest official documentation on how to
maintain a mediawiki site's updates via git.

_______________________________________________
Wikitech-l mailing list
Wikitech-l [at] lists
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Wikipedia wikitech RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.