Mailing List Archive: Python: Bugs

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102)

1 2

View All

Index | Next | Previous | View Threaded

report at bugs

Jun 23, 2012, 9:35 AM

Post #1 of 27 (210 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102)

Martin v. Löwis <martin [at] v> added the comment:

> This change eliminates the need for HOST_PYTHON. Why is it required
> in the first place? It is not documented as being required to build
> Python.

It helps to build 64-bit binaries on a 32-bit Windows installation.
Normally, Python uses the python.exe it just built, but this fails if
the binary is a 64-bit binary, but the host is 32-bits.

It would be best if HOST_PYTHON was used if set, but it otherwise
falls back to using the Python just built.

I'm fine with dropping HOST_PYTHON for 3.4, but not for 3.3.

> When building in the VS IDE, the proper compilers are chosen.
> However, when building via the buildbot scripts, the compilers are
> forced to the 64-bit only versions and thus cause link errors. See
> the buildbot status for the exact error messages.

I see the errors, but I believe the solution is incorrect. It must
be possible to build from the command line exactly in the same way
as from the IDE, and it *was* possible to do so with VS 2008. We
just need to find out how to do it with VS 2010.

> This file is a redundant with python_nt.h. It was removed for simplicity.

That is out of scope for this issue, then. If the file annoys you much,
create a separate issue.

> I do not know what you reviewed, but the diff I generated does not
> have those changes.

Interesting. Now Rietveld doesn't show them anymore, either, in the place
where I left the comment.

----------
title: Fix 64-bit building for buildbot scripts -> Fix 64-bit building for buildbot scripts (issue 15102)

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 9:37 AM

Post #2 of 27 (200 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Martin v. Löwis <martin [at] v> added the comment:

Stefan: your patch looks good, please apply.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 9:59 AM

Post #3 of 27 (199 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Roundup Robot <devnull [at] psf> added the comment:

New changeset 979567d33376 by Stefan Krah in branch 'default':
Issue #15102: Allow platform-specific settings for the current project
http://hg.python.org/cpython/rev/979567d33376

----------
nosy: +python-dev

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 12:08 PM

Post #4 of 27 (195 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Roundup Robot <devnull [at] psf> added the comment:

New changeset a9d4cf7d15b9 by Martin v. Löwis in branch 'default':
Issue #15102: Use HOST_PYTHON only if it is set.
http://hg.python.org/cpython/rev/a9d4cf7d15b9

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 12:18 PM

Post #5 of 27 (195 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

I've fixed some paths in external-amd64.bat. Uploading a diff
instead of committing right away so as not to interfere with
the steadily incoming commits.

----------
Added file: http://bugs.python.org/file26114/external-amd64.diff

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 12:37 PM

Post #6 of 27 (193 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Antoine Pitrou <pitrou [at] free> added the comment:

Stefan, don't fear interfering. Merging is easy.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 1:19 PM

Post #7 of 27 (192 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Roundup Robot <devnull [at] psf> added the comment:

New changeset c56783fe2e3b by Stefan Krah in branch 'default':
Issue #15102: Fix paths in external-amd64.bat.
http://hg.python.org/cpython/rev/c56783fe2e3b

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 1:22 PM

Post #8 of 27 (193 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

Antoine Pitrou <report [at] bugs> wrote:
> Stefan, don't fear interfering. Merging is easy.

Good to know, I loathe merging. :)

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 1:33 PM

Post #9 of 27 (194 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Antoine Pitrou <pitrou [at] free> added the comment:

There's still a problem when building ssl:

Project "C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\pcbuild.sln" (1) is building "C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\_ssl.vcxproj" (18) on node 1 (default targets).
Project "C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\_ssl.vcxproj" (18) is building "C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\ssl.vcxproj" (19) on node 1 (default targets).
Build:
cd "C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\"
"C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\python_d.exe" build_ssl.py Release x64 -a

'"C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\python_d.exe"' is not recognized as an internal or external command,
operable program or batch file.

(from http://www.python.org/dev/buildbot/all/builders/AMD64%20Windows7%20SP1%203.x/builds/90/steps/compile/logs/stdio )

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 23, 2012, 3:22 PM

Post #10 of 27 (192 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Roundup Robot <devnull [at] psf> added the comment:

New changeset 9c71d7f057b3 by Martin v. Löwis in branch 'default':
Issue #15102: find python.exe in OutDir, not SolutionDir.
http://hg.python.org/cpython/rev/9c71d7f057b3

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 3:45 AM

Post #11 of 27 (216 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

All Windows buildbots are failing now:

C:\Program Files\MSBuild\Microsoft.Cpp\v4.0\Microsoft.MakeFile.Targets(38,5): error MSB3073: The command "cd "d:\cygwin\home\db3l\buildarea\3.x.bolen-windows\build\PCbuild\" [d:\cygwin\home\db3l\buildarea\3.x.bolen-windows\build\PCbuild\ssl.vcxproj]
C:\Program Files\MSBuild\Microsoft.Cpp\v4.0\Microsoft.MakeFile.Targets(38,5): error MSB3073: "d:\cygwin\home\db3l\buildarea\3.x.bolen-windows\build\PCbuild\Debug\python_d.exe" build_ssl.py Release Win32 -a [d:\cygwin\home\db3l\buildarea\3.x.bolen-windows\build\PCbuild\ssl.vcxproj]
C:\Program Files\MSBuild\Microsoft.Cpp\v4.0\Microsoft.MakeFile.Targets(38,5): error MSB3073: " exited with code 3. [d:\cygwin\home\db3l\buildarea\3.x.bolen-windows\build\PCbuild\ssl.vcxproj]

Perhaps it would be possible to set HOST_PYTHON in build-amd64.bat
as a temporary measure until a more elegant solution is found?

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 4:04 AM

Post #12 of 27 (195 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Roundup Robot <devnull [at] psf> added the comment:

New changeset fc84ac3e8dfc by Stefan Krah in branch 'default':
Issue #15102: Try setting HOST_PYTHON in build-amd64.bat as a temporary
http://hg.python.org/cpython/rev/fc84ac3e8dfc

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 4:06 AM

Post #13 of 27 (192 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

I'm trying out my suggestion on the 64-bit bot. Will revert if it
doesn't work out.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 4:22 AM

Post #14 of 27 (196 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

Well, the path to python_d.exe looks right now, but Perl and nasm
aren't found:

"C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\amd64\python_d.exe" build_ssl.py Release x64 -a

Found a working perl at 'C:\perl\bin\perl.exe'
'nasm' is not recognized as an internal or external command,
operable program or batch file.
nasm assembler has failed.

Jeremy, did you install these on your machine?

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 4:23 AM

Post #15 of 27 (192 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Martin v. Löwis <martin [at] v> added the comment:

> I'm trying out my suggestion on the 64-bit bot. Will revert if it
> doesn't work out.

Even if it does work out it should be reverted. As HOST_PYTHON is not
set, PythonExe should be computed correctly. So we really need to find
out why it isn't.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 4:32 AM

Post #16 of 27 (193 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Martin v. Löwis <martin [at] v> added the comment:

On 24.06.2012 13:22, Stefan Krah wrote:
>
> Stefan Krah <stefan-usenet [at] bytereef> added the comment:
>
> Well, the path to python_d.exe looks right now, but Perl and nasm
> aren't found:

perl shouldn't be necessary. Not sure why nasm is.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 4:36 AM

Post #17 of 27 (192 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

Martin v. L??wis <report [at] bugs> wrote:
> Even if it does work out it should be reverted. As HOST_PYTHON is not
> set, PythonExe should be computed correctly. So we really need to find
> out why it isn't.

Yes, of course. It's meant as a temporary measure to work out things like
the missing nasm and hopefully get a functioning bot before the beta.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 4:45 AM

Post #18 of 27 (192 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

> Well, the path to python_d.exe looks right now, but Perl and nasm
> aren't found:
>
>
> "C:\Users\Buildbot\buildbot.python.org\3.x.kloth-win64\build\PCbuild\amd64\python_d.exe" build_ssl.py Release x64 -a
>
> Found a working perl at 'C:\perl\bin\perl.exe'

Hmm, obviously Perl *is* found. That leaves nasm.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 7:00 AM

Post #19 of 27 (191 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Jeremy Kloth <jeremy.kloth [at] gmail> added the comment:

> Hmm, obviously Perl *is* found. That leaves nasm.

nasm.exe was installed for myself (hence testing worked). I've now
made it available to the buildbot account as well.

Note that I have Perl installed but *not* on my PATH (on purpose).
The patch supplied in issue15052 will fix the issue brought out by
that circumstance.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 7:17 AM

Post #20 of 27 (191 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

Jeremy Kloth <report [at] bugs> wrote:
> nasm.exe was installed for myself (hence testing worked). I've now
> made it available to the buildbot account as well.
>
> Note that I have Perl installed but *not* on my PATH (on purpose).
> The patch supplied in issue15052 will fix the issue brought out by
> that circumstance.

Thanks. The Perl situation looks OK since the buildbot has proceeded to
the testing stage in the last build.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 7:57 AM

Post #21 of 27 (202 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

Jeremy, your python-dev suggestion to move x64.props before pyproject.props
does not work for me. For instance, in python3dll.vcxproj:

C:\Program Files (x86)\MSBuild\Microsoft.Cpp\v4.0\Microsoft.MakeFile.Targets(38,5): error MSB3073: The comma
nd "cd C:\Users\stefan\pydev\cpython\PCbuild\\..\PC [C:\Users\stefan\pydev\cpython\PCbuild\python3dll.vcxproj]
C:\Program Files (x86)\MSBuild\Microsoft.Cpp\v4.0\Microsoft.MakeFile.Targets(38,5): error MSB3073: nmake /f py
thon3.mak MACHINE=x64 OutDir=C:\Users\stefan\pydev\cpython\PCbuild\x64-pgo\" exited with code 9009. [C:\Users\
stefan\pydev\cpython\PCbuild\python3dll.vcxproj]

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 8:50 AM

Post #22 of 27 (191 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Antoine Pitrou <pitrou [at] free> added the comment:

Ouch. The test failures on the buildbot now seem to point to problems with OpenSSL's SHA1 implementation.

Jeremy, perhaps you can try to run the OpenSSL self-tests?

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 9:43 AM

Post #23 of 27 (193 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Stefan Krah <stefan-usenet [at] bytereef> added the comment:

outdir.diff contains a solution that doesn't rely on HOST_PYTHON.
Works for both x64 and Win32.

Note that I've edited the files using Vim. -- I'm not sure if one can
even select Condition="'$(Platform)'=='Win32'" using Visual Studio.

----------
Added file: http://bugs.python.org/file26130/outdir.diff

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 9:51 AM

Post #24 of 27 (191 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Martin v. Löwis <martin [at] v> added the comment:

Stefan: I think that's acceptable. Perhaps someone will come up with a better solution; if this works, it's good enough for me.

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

report at bugs

Jun 24, 2012, 10:05 AM

Post #25 of 27 (191 views)
Permalink

[issue15102] Fix 64-bit building for buildbot scripts (issue 15102) [In reply to]

Roundup Robot <devnull [at] psf> added the comment:

New changeset f12a2f2c93e5 by Stefan Krah in branch 'default':
Issue #15102: Fix paths of python executables.
http://hg.python.org/cpython/rev/f12a2f2c93e5

----------

_______________________________________
Python tracker <report [at] bugs>
<http://bugs.python.org/issue15102>
_______________________________________
_______________________________________________
Python-bugs-list mailing list
Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/list-python-bugs%40lists.gossamer-threads.com

1 2

View All

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads