Mailing List Archive: Maemo: Developers

Debian Etch, Rebuilt: 6,451 .debs for Maemo 5

Index | Next | Previous | View Threaded

moe at blagblagblag

Feb 2, 2010, 8:20 PM

Post #1 of 9 (1815 views)
Permalink

Debian Etch, Rebuilt: 6,451 .debs for Maemo 5

Hey,

* I rebuilt all Debian Etch source packages with the Maemo 5 SDK and sdbmock.

* 10,220 Source packages processed.

* 6,451 .debs produced.

* The job ran for 8 days.

* They have not been run through maemo-optify yet--I will test the fix for the recursive symlink bug[1] when ready.

* They were compiled against the current maemos-extras repository. They have no dependencies other than that. In other words, no package within the rebuild depends on anything else in the rebuild--this is the first pass.

* I could batch import packages that don't already exist in extras-devel. I think this would be rad.

* Download locations (temporary):
Directory: http://obra.freemoe.org/freemoe-etch/
Install file for N900: http://obra.freemoe.org/obra.install
/etc/apt/sources.list:
deb http://obra.freemoe.org/freemoe-etch ./

* Thx Ed for sbdmock help.

Have fun,

-Jeff Moe
http://wiki.maemo.org/User:Jebba

[1] https://bugs.maemo.org/show_bug.cgi?id=7707
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

moe at blagblagblag

Feb 2, 2010, 9:23 PM

Post #2 of 9 (1736 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

On Tuesday 02 February 2010 21:20:25 Jeff Moe wrote:
> /etc/apt/sources.list:
> deb http://obra.freemoe.org/freemoe-etch ./

CORRECTION:
deb http://obra.freemoe.org/ freemoe-etch/
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

marius.vollmer at nokia

Feb 2, 2010, 10:04 PM

Post #3 of 9 (1731 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

ext Jeff Moe <moe [at] blagblagblag> writes:

> * I rebuilt all Debian Etch source packages with the Maemo 5 SDK and sdbmock.

Cool!

> * 10,220 Source packages processed.
> * 6,451 .debs produced.

This means there were a lot of build failures (as could be expected).

Mining the failures would be interesting, too. I suppose a lot are due
to missing build dependencies, but some have probably failed in more
interesting ways.

Do you have the build logs online as well?

> * They have not been run through maemo-optify yet--I will test the fix
> for the recursive symlink bug[1] when ready.

There should be a fix any day now...

> * I could batch import packages that don't already exist in
> extras-devel. I think this would be rad.

You should probably also exclude packages that already exist in the
SSU and SDK repositories, just to avoid confusion.
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

moe at blagblagblag

Feb 2, 2010, 10:19 PM

Post #4 of 9 (1738 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

On Tuesday 02 February 2010 23:04:57 you wrote:
> ext Jeff Moe <moe [at] blagblagblag> writes:
> > * 10,220 Source packages processed.
> > * 6,451 .debs produced.
>
> This means there were a lot of build failures (as could be expected).
>
> Mining the failures would be interesting, too. I suppose a lot are due
> to missing build dependencies, but some have probably failed in more
> interesting ways.
>
> Do you have the build logs online as well?

Yes, from
http://obra.freemoe.org/freemoe-etch/3/3dchess/root.log
to
http://obra.freemoe.org/freemoe-etch/z/zziplib/build.log

> > * I could batch import packages that don't already exist in
> > extras-devel. I think this would be rad.
>
> You should probably also exclude packages that already exist in the
> SSU and SDK repositories, just to avoid confusion.

Yes, I was thinking of running a few checks across the package before submitting it, such as:

* In extras* ?

* Depends: are ok? Just because the Build-Depends: were there doesn't mean the Depends: are there.

* Isn't ridiculously huge? etc. Suggestions welcome.

Future options include:

* Building with faster flags (neon etc).

* Automatically adding icon + Section: if is GUI app.

* Rebuilding against itself (2nd and multiple passes). This will build yet many more packages since so many more libfoo-* have been built.

* Lenny? Sid?

* http://wiki.maemo.org/User:Jebba/Etch

As a side note, this build was done on a server at netdepot.com. They graciously bumped the RAM about 25% of the way into the build...

For the future(tm), I have created Amazon Machine Instances of the build server (SDK + sbdmock) for use on Amazon's "Elastic Compute Cloud" (EC2). Using these, innumerable virtual machines can be launched in Amazon's most excellent network and set to work building packages. Rent by the hour, then turn the thing off. :)
http://aws.amazon.com/ec2/

-Jeff
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

marius.vollmer at nokia

Feb 2, 2010, 10:43 PM

Post #5 of 9 (1727 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

ext Jeff Moe <moe [at] blagblagblag> writes:

>> Do you have the build logs online as well?
>
> Yes, from
> http://obra.freemoe.org/freemoe-etch/3/3dchess/root.log
> to
> http://obra.freemoe.org/freemoe-etch/z/zziplib/build.log

Great!

> * Depends: are ok? Just because the Build-Depends: were there doesn't mean the Depends: are there.

Yes. Would be good to compile a list of such missing Depends and maybe
put some extra effort into making them build, too.

There will be cyclic build dependencies, though, and things get
interesting then.
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

jeremiah at jeremiahfoster

Feb 3, 2010, 1:14 AM

Post #6 of 9 (1720 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

Amazing stuff Jeff - really great!

On Feb 3, 2010, at 7:43 AM, Marius Vollmer wrote:

> ext Jeff Moe <moe [at] blagblagblag> writes:
>
>>> Do you have the build logs online as well?
>>
>> Yes, from
>> http://obra.freemoe.org/freemoe-etch/3/3dchess/root.log
>> to
>> http://obra.freemoe.org/freemoe-etch/z/zziplib/build.log
>
> Great!
>
>> * Depends: are ok? Just because the Build-Depends: were there doesn't mean the Depends: are there.
>
> Yes. Would be good to compile a list of such missing Depends and maybe
> put some extra effort into making them build, too.
>
> There will be cyclic build dependencies, though, and things get
> interesting then.

One thing that might be done is to compare the builds to a build in pbuilder which is a minimal set of debian tools.

Also, I would like to do some testing of maemian on the built packages - just to see what sort of data there is an how to go about making maemian more friendly to developers. You've given me a login to your machine so I assume you don't mind me doing this but I thought I would ask you first. I would also like to make the maemian logs visible as well. Is that okay?

Warm regards,

Jeremiah
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

marcin at juszkiewicz

Feb 3, 2010, 1:26 AM

Post #7 of 9 (1731 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

Dnia środa, 3 lutego 2010 o 07:04:57 Marius Vollmer napisał(a):
> > * I rebuilt all Debian Etch source packages with the Maemo 5 SDK and
> > sdbmock.
>
> Cool!

Nice stuff indeed. I hope that you will try Lenny or Squezze soon as Etch is
not supported now by Debian (but is similar to Maemo5 roots).

> > * I could batch import packages that don't already exist in
> > extras-devel. I think this would be rad.
>
> You should probably also exclude packages that already exist in the
> SSU and SDK repositories, just to avoid confusion.

SSU yes, SDK no. Users of devices do not use SDK repos as they were described
as 'can break device' due to dependencies.

Regards,
--
JID: hrw [at] jabber
Website: http://marcin.juszkiewicz.com.pl/
LinkedIn: http://www.linkedin.com/in/marcinjuszkiewicz

_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

moe at blagblagblag

Feb 3, 2010, 1:36 AM

Post #8 of 9 (1722 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

On Wednesday 03 February 2010 02:14:01 you wrote:
> I would like to do some testing of maemian on the built packages - just to see what sort of data there is an how to go about making maemian more friendly to developers. You've given me a login to your machine so I assume you don't mind me doing this but I thought I would ask you first. I would also like to make the maemian logs visible as well. Is that okay?

You have a login on mas (espejo node 1); this is obra. Both are virtual KVMs on topo at NetDepot. I copied over your key from mas, so you should be able to ssh jeremiah [at] obra

Interesting dir for you may be:
/var/www/freemoe-etch/

You have many gigs of space @ /home--feel free to copy over the whole archive (9.3G) to your homedir and process the files as you like. All can be made visible.

-Jeff
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

tanner at gmx

Feb 3, 2010, 2:56 AM

Post #9 of 9 (1718 views)
Permalink

Re: Debian Etch, Rebuilt: 6,451 .debs for Maemo 5 [In reply to]

great job, Jeff!

Marius Vollmer wrote:
>> * Depends: are ok? Just because the Build-Depends: were there doesn't mean the Depends: are there.
> Yes. Would be good to compile a list of such missing Depends and maybe
> put some extra effort into making them build, too.
> There will be cyclic build dependencies, though, and things get
> interesting then.

http://collab-maint.alioth.debian.org/debtree/
could be useful for ordering the build sequence from root to leaves
or for visualizing the missing dependencies.

cheers,
--
Thomas Tanner ------
email: tanner [at] gmx
GnuPG: 1024/5924D4DD
_______________________________________________
maemo-developers mailing list
maemo-developers [at] maemo
https://lists.maemo.org/mailman/listinfo/maemo-developers

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads