Mailing List Archive: Python: Dev

Daily Windows Installers

Index | Next | Previous | View Threaded

martin at v

Sep 14, 2007, 5:24 AM

Post #1 of 9 (487 views)
Permalink

Daily Windows Installers

Together with David Bolen, I set up a series of buildbot
slaves that create an MSI installer from the 2.5, 2.6,
and 3.0 branches every day. The result files are available
from

http://www.python.org/dev/daily-msi/

The buildbot pages themselves are at

http://www.python.org/dev/buildbot/msi/

There are still some glitches with that installation
(in particular, the Microsoft help compiler seems to
crash occasionally).

If you find any problems with the MSI files themselves,
please report them to this list, or to the bug tracker.

Regards,
Martin
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

g.brandl at gmx

Sep 14, 2007, 8:43 AM

Post #2 of 9 (453 views)
Permalink

Re: Daily Windows Installers [In reply to]

Martin v. Löwis schrieb:
> Together with David Bolen, I set up a series of buildbot
> slaves that create an MSI installer from the 2.5, 2.6,
> and 3.0 branches every day. The result files are available
> from
>
> http://www.python.org/dev/daily-msi/
>
> The buildbot pages themselves are at
>
> http://www.python.org/dev/buildbot/msi/
>
> There are still some glitches with that installation
> (in particular, the Microsoft help compiler seems to
> crash occasionally).

I hope this isn't due to the files that Sphinx creates.
I had a nasty crash with HTML Help Workshop when I generated
an "invalid" index file -- but this was reproducible of course.

Georg

--
Thus spake the Lord: Thou shalt indent with four spaces. No more, no less.
Four shall be the number of spaces thou shalt indent, and the number of thy
indenting shall be four. Eight shalt thou not indent, nor either indent thou
two, excepting that thou then proceed to four. Tabs are right out.

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

p.f.moore at gmail

Sep 14, 2007, 8:46 AM

Post #3 of 9 (455 views)
Permalink

Re: Daily Windows Installers [In reply to]

On 14/09/2007, "Martin v. Löwis" <martin [at] v> wrote:
> Together with David Bolen, I set up a series of buildbot
> slaves that create an MSI installer from the 2.5, 2.6,
> and 3.0 branches every day.

That's good news. Thanks for doing this.

Paul.
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

martin at v

Sep 14, 2007, 9:45 AM

Post #4 of 9 (452 views)
Permalink

Re: Daily Windows Installers [In reply to]

> I hope this isn't due to the files that Sphinx creates.
> I had a nasty crash with HTML Help Workshop when I generated
> an "invalid" index file -- but this was reproducible of course.

It's not clear what precisely the problem is, but yes, it
must have to do with the input :-) If you fixed that problem
fairly recently (within the last 48 hours), this may have been
the one we were seeing.

Unfortunately, this is again one of the Windows problems which
make buildbot on Windows so difficult: it brings up an error
window, and then hangs.

Regards,
Martin
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

db3l.net at gmail

Sep 14, 2007, 12:26 PM

Post #5 of 9 (452 views)
Permalink

Re: Daily Windows Installers [In reply to]

Georg Brandl <g.brandl [at] gmx> writes:

> I hope this isn't due to the files that Sphinx creates.
> I had a nasty crash with HTML Help Workshop when I generated
> an "invalid" index file -- but this was reproducible of course.

The really annoying thing is that this only occurs (so far) in the 3.0
tree when run beneath the buildbot, although it seems consistent
there. Using the same tree right after a crash, and running the same
build command interactively always seems to work fine. I thought it
might be a stdout/console thing but redirecting the compiler's output
to a file still crashes.

I think, but can't prove it has parsed all the input files, since the
last bit of output even in verbose mode is still buffered in its
process when it crashes.

I did determine that genindex.html is being created with malformed
HTML (< and > in operators aren't being quoted as < and >), but
manually fixing that didn't resolve the crash. And even in the 2.6
branch (which builds fine) genindex.html has erroneous uses of
"<protocol>" that isn't quoted either.

For the moment I'm probably going to work to ensure we don't get the
pop-up box (which blocks the rest of the processing) so at least an
MSI can get created even if the chm is bad.

-- David

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

g.brandl at gmx

Sep 14, 2007, 1:37 PM

Post #6 of 9 (452 views)
Permalink

Re: Daily Windows Installers [In reply to]

David Bolen schrieb:
> Georg Brandl <g.brandl [at] gmx> writes:
>
>> I hope this isn't due to the files that Sphinx creates.
>> I had a nasty crash with HTML Help Workshop when I generated
>> an "invalid" index file -- but this was reproducible of course.
>
> The really annoying thing is that this only occurs (so far) in the 3.0
> tree when run beneath the buildbot, although it seems consistent
> there. Using the same tree right after a crash, and running the same
> build command interactively always seems to work fine. I thought it
> might be a stdout/console thing but redirecting the compiler's output
> to a file still crashes.
>
> I think, but can't prove it has parsed all the input files, since the
> last bit of output even in verbose mode is still buffered in its
> process when it crashes.

Can't help you there, just notice that this is the same point where
I saw "my" crash.

> I did determine that genindex.html is being created with malformed
> HTML (< and > in operators aren't being quoted as < and >), but
> manually fixing that didn't resolve the crash. And even in the 2.6
> branch (which builds fine) genindex.html has erroneous uses of
> "<protocol>" that isn't quoted either.

Okay, I should really fix this. Added a todo-list item.

> For the moment I'm probably going to work to ensure we don't get the
> pop-up box (which blocks the rest of the processing) so at least an
> MSI can get created even if the chm is bad.

Thanks for handling this!

Georg

--
Thus spake the Lord: Thou shalt indent with four spaces. No more, no less.
Four shall be the number of spaces thou shalt indent, and the number of thy
indenting shall be four. Eight shalt thou not indent, nor either indent thou
two, excepting that thou then proceed to four. Tabs are right out.

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

db3l.net at gmail

Sep 14, 2007, 2:51 PM

Post #7 of 9 (457 views)
Permalink

Re: Daily Windows Installers [In reply to]

Georg Brandl <g.brandl [at] gmx> writes:

> David Bolen schrieb:
>> Georg Brandl <g.brandl [at] gmx> writes:
(...)
>> For the moment I'm probably going to work to ensure we don't get the
>> pop-up box (which blocks the rest of the processing) so at least an
>> MSI can get created even if the chm is bad.
>
> Thanks for handling this!

I hit it with a sledge-hammer and modified my build slave to disable
error boxes for anything it runs, so we'll get the 3.0 MSI now but
with a bad chm until it gets figured out.

-- David

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

trentm at activestate

Sep 17, 2007, 3:13 PM

Post #8 of 9 (450 views)
Permalink

Re: Daily Windows Installers [In reply to]

David Bolen wrote:
> I hit it with a sledge-hammer and modified my build slave to disable
> error boxes for anything it runs, so we'll get the 3.0 MSI now but
> with a bad chm until it gets figured out.

How do you tell Windows to do that?

Trent

--
Trent Mick
trentm at activestate.com
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

db3l.net at gmail

Sep 17, 2007, 3:19 PM

Post #9 of 9 (442 views)
Permalink

Re: Daily Windows Installers [In reply to]

On 9/17/07, Trent Mick <trentm [at] activestate> wrote:

> How do you tell Windows to do that?

Via the SetErrorMode call.

Since the Windows buildbot already uses the win32 extensions, I just
used the existing win32api wrapper (although through ctypes is very
easy too). In my case I just surrounded the reactor.spawnProcess call
in buildbot/slave/commands.py with:

old_err_mode = win32api.SetErrorMode(7)
and
win32api.SetErrorMode(old_err_mode)

I suppose I should really tweak that to 0x8007 rather than just 7 to
include missing file dialogs (like when a removeable device is not
available).

Since the error mode is inherited by child processes (unless
explicitly overridden in the CreateProcess call), this effectively
covers the primary child process and any others it may spawn during
execution, so it works even though buildbot uses an intermediate
command interpreter to execute whatever command is requested.

We had a bit of discussion about this recently on the py3k devel list,
in regards to failures in the python buildbot tests, in regards to
more local changes within Python itself.

-- David
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads