Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Python: Dev

Debian wheezy, amd64: make not finding files for bz2 and other packages

 

 

Python dev RSS feed   Index | Next | Previous | View Threaded


edcjones at comcast

May 4, 2012, 11:07 AM

Post #1 of 15 (1638 views)
Permalink
Debian wheezy, amd64: make not finding files for bz2 and other packages

I use up-to-date Debian testing (wheezy), amd64 architecture.
I have made a "clone" of the developmental version of Python 3.3.
"make -s -j3" prints:

====
...
Python build finished, but the necessary bits to build these modules were
not found:
_bz2 _curses _curses_panel
_dbm _gdbm _lzma
_sqlite3 _ssl readline
zlib
To find the necessary bits, look in setup.py in detect_modules() for the
module's name.


Failed to build these modules:
_crypt nis

[101752 refs]
====

I looked into bz2. My system already contained the Debian packages
libbz2-dev,
libbz2-1.0, and bzip2. From the Debian website, I got the list of all the
files in these three packages:

====
Filelist of package libbz2-dev in wheezy of architecture amd64

/usr/include/bzlib.h
/usr/lib/x86_64-linux-gnu/libbz2.a
/usr/lib/x86_64-linux-gnu/libbz2.so
/usr/share/doc/libbz2-dev
====
Filelist of package libbz2-1.0 in wheezy of architecture amd64

/lib/x86_64-linux-gnu/libbz2.so.1
/lib/x86_64-linux-gnu/libbz2.so.1.0
/lib/x86_64-linux-gnu/libbz2.so.1.0.4
/usr/share/doc/libbz2-1.0/changelog.Debian.gz
/usr/share/doc/libbz2-1.0/changelog.gz
/usr/share/doc/libbz2-1.0/copyright
====
Filelist of package bzip2 in wheezy of architecture amd64

/bin/bunzip2
/bin/bzcat
/bin/bzcmp
/bin/bzdiff
/bin/bzegrep
/bin/bzexe
/bin/bzfgrep
/bin/bzgrep
/bin/bzip2
/bin/bzip2recover
/bin/bzless
/bin/bzmore
/usr/share/doc/bzip2/changelog.Debian.gz
/usr/share/doc/bzip2/changelog.gz
/usr/share/doc/bzip2/copyright
/usr/share/man/man1/bunzip2.1.gz
/usr/share/man/man1/bzcat.1.gz
/usr/share/man/man1/bzcmp.1.gz
/usr/share/man/man1/bzdiff.1.gz
/usr/share/man/man1/bzegrep.1.gz
/usr/share/man/man1/bzexe.1.gz
/usr/share/man/man1/bzfgrep.1.gz
/usr/share/man/man1/bzgrep.1.gz
/usr/share/man/man1/bzip2.1.gz
/usr/share/man/man1/bzip2recover.1.gz
/usr/share/man/man1/bzless.1.gz
/usr/share/man/man1/bzmore.1.gz
====

What is the problem? Does wheezy amd64 put files in unusual places?

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


phd at phdru

May 4, 2012, 11:39 AM

Post #2 of 15 (1593 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On Fri, May 04, 2012 at 02:07:28PM -0400, "Edward C. Jones" <edcjones [at] comcast> wrote:
> From the Debian website, I got the list of all the
> files in these three packages:

Don't know about amd64 arch, sorry. You can list content of a package
from command line:

dpkg [-L|--listfiles] libbz2-dev

Oleg.
--
Oleg Broytman http://phdru.name/ phd [at] phdru
Programmers don't die, they just GOSUB without RETURN.
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


rosuav at gmail

May 4, 2012, 6:20 PM

Post #3 of 15 (1590 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On Sat, May 5, 2012 at 4:07 AM, Edward C. Jones <edcjones [at] comcast> wrote:
> /usr/include/bzlib.h
> /usr/lib/x86_64-linux-gnu/libbz2.a
> /usr/lib/x86_64-linux-gnu/libbz2.so
> /lib/x86_64-linux-gnu/libbz2.so.1
> /lib/x86_64-linux-gnu/libbz2.so.1.0
> /lib/x86_64-linux-gnu/libbz2.so.1.0.4

I have an Ubuntu Maverick 64-bit system, not identical but hopefully
similar to your Debian. I have /usr/include/bzlib.h, but the others
are all one directory level higher - /usr/lib/libbz2.a,
/lib/libbz2.so.1.0.4, etc. Does your /etc/ld.so.conf.d mention the
appropriate directories?

ChrisA
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


solipsis at pitrou

May 5, 2012, 3:36 AM

Post #4 of 15 (1582 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

Hello,

On Fri, 04 May 2012 14:07:28 -0400
"Edward C. Jones" <edcjones [at] comcast> wrote:
> Filelist of package libbz2-dev in wheezy of architecture amd64
>
> /usr/include/bzlib.h
> /usr/lib/x86_64-linux-gnu/libbz2.a
> /usr/lib/x86_64-linux-gnu/libbz2.so
> /usr/share/doc/libbz2-dev

setup.py probably doesn't search in the right paths for libbz2.so. I
suggest you open a bug at http://bugs.python.org

Thanks for your report,

Antoine.


_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


lists at cheimes

May 5, 2012, 6:31 AM

Post #5 of 15 (1578 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

Am 05.05.2012 12:36, schrieb Antoine Pitrou:
>
> Hello,
>
> On Fri, 04 May 2012 14:07:28 -0400
> "Edward C. Jones" <edcjones [at] comcast> wrote:
>> Filelist of package libbz2-dev in wheezy of architecture amd64
>>
>> /usr/include/bzlib.h
>> /usr/lib/x86_64-linux-gnu/libbz2.a
>> /usr/lib/x86_64-linux-gnu/libbz2.so
>> /usr/share/doc/libbz2-dev
>
> setup.py probably doesn't search in the right paths for libbz2.so. I
> suggest you open a bug at http://bugs.python.org

The issue might be caused by Debian's new multiarch libraries. In recent
versions of Debian (and Ubuntu), 64bit and 32bit libraries can coexist
on the same system.

What's the output of "dpkg-architecture -qDEB_HOST_MULTIARCH" on your
system? It should print out "x86_64-linux-gnu". setup.py supports
multiarch for some time, see PyBuildExt.add_multiarch_paths().

Christian

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


solipsis at pitrou

May 5, 2012, 6:39 AM

Post #6 of 15 (1577 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On Sat, 05 May 2012 15:31:24 +0200
Christian Heimes <lists [at] cheimes> wrote:
> Am 05.05.2012 12:36, schrieb Antoine Pitrou:
> >
> > Hello,
> >
> > On Fri, 04 May 2012 14:07:28 -0400
> > "Edward C. Jones" <edcjones [at] comcast> wrote:
> >> Filelist of package libbz2-dev in wheezy of architecture amd64
> >>
> >> /usr/include/bzlib.h
> >> /usr/lib/x86_64-linux-gnu/libbz2.a
> >> /usr/lib/x86_64-linux-gnu/libbz2.so
> >> /usr/share/doc/libbz2-dev
> >
> > setup.py probably doesn't search in the right paths for libbz2.so. I
> > suggest you open a bug at http://bugs.python.org
>
> The issue might be caused by Debian's new multiarch libraries. In recent
> versions of Debian (and Ubuntu), 64bit and 32bit libraries can coexist
> on the same system.

It probably is, but I thought Barry had tackled that in setup.py :-)

Regards

Antoine.


_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


tshepang at gmail

May 5, 2012, 6:43 AM

Post #7 of 15 (1581 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

This is likely because you don't have dpkg-dev installed.
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


tshepang at gmail

May 5, 2012, 6:48 AM

Post #8 of 15 (1578 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On Sat, May 5, 2012 at 3:43 PM, Tshepang Lekhonkhobe <tshepang [at] gmail> wrote:
> This is likely  because you don't have dpkg-dev installed.

http://bugs.python.org/issue13956
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


lists at cheimes

May 5, 2012, 7:04 AM

Post #9 of 15 (1579 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

Am 05.05.2012 15:39, schrieb Antoine Pitrou:
> On Sat, 05 May 2012 15:31:24 +0200
> Christian Heimes <lists [at] cheimes> wrote:
>> Am 05.05.2012 12:36, schrieb Antoine Pitrou:
>>>
>>> Hello,
>>>
>>> On Fri, 04 May 2012 14:07:28 -0400
>>> "Edward C. Jones" <edcjones [at] comcast> wrote:
>>>> Filelist of package libbz2-dev in wheezy of architecture amd64
>>>>
>>>> /usr/include/bzlib.h
>>>> /usr/lib/x86_64-linux-gnu/libbz2.a
>>>> /usr/lib/x86_64-linux-gnu/libbz2.so
>>>> /usr/share/doc/libbz2-dev
>>>
>>> setup.py probably doesn't search in the right paths for libbz2.so. I
>>> suggest you open a bug at http://bugs.python.org
>>
>> The issue might be caused by Debian's new multiarch libraries. In recent
>> versions of Debian (and Ubuntu), 64bit and 32bit libraries can coexist
>> on the same system.
>
> It probably is, but I thought Barry had tackled that in setup.py :-)

The fix needs the dpkg-architecture program. As Tshepang pointed out it
may not be available on Edward's box. I always install build-essential
on all development boxes as it includes GCC, make and dpkg-dev.

Christian

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


solipsis at pitrou

May 5, 2012, 7:13 AM

Post #10 of 15 (1580 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On Sat, 05 May 2012 16:04:40 +0200
Christian Heimes <lists [at] cheimes> wrote:
> Am 05.05.2012 15:39, schrieb Antoine Pitrou:
> > On Sat, 05 May 2012 15:31:24 +0200
> > Christian Heimes <lists [at] cheimes> wrote:
> >> Am 05.05.2012 12:36, schrieb Antoine Pitrou:
> >>>
> >>> Hello,
> >>>
> >>> On Fri, 04 May 2012 14:07:28 -0400
> >>> "Edward C. Jones" <edcjones [at] comcast> wrote:
> >>>> Filelist of package libbz2-dev in wheezy of architecture amd64
> >>>>
> >>>> /usr/include/bzlib.h
> >>>> /usr/lib/x86_64-linux-gnu/libbz2.a
> >>>> /usr/lib/x86_64-linux-gnu/libbz2.so
> >>>> /usr/share/doc/libbz2-dev
> >>>
> >>> setup.py probably doesn't search in the right paths for libbz2.so. I
> >>> suggest you open a bug at http://bugs.python.org
> >>
> >> The issue might be caused by Debian's new multiarch libraries. In recent
> >> versions of Debian (and Ubuntu), 64bit and 32bit libraries can coexist
> >> on the same system.
> >
> > It probably is, but I thought Barry had tackled that in setup.py :-)
>
> The fix needs the dpkg-architecture program. As Tshepang pointed out it
> may not be available on Edward's box. I always install build-essential
> on all development boxes as it includes GCC, make and dpkg-dev.

Perhaps setup.py should detect that? It shouldn't be too hard to
parse /etc/debian_version in order to know whether the system is
multiarch-enabled. That would avoid confusing build failures.

Regards

Antoine.


_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


lists at cheimes

May 5, 2012, 8:23 AM

Post #11 of 15 (1579 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

Am 05.05.2012 16:13, schrieb Antoine Pitrou:
> Perhaps setup.py should detect that? It shouldn't be too hard to
> parse /etc/debian_version in order to know whether the system is
> multiarch-enabled. That would avoid confusing build failures.

This sounds like a good idea. dpkg-architecture is available on older
version of Debian and Ubuntu but doesn't support DEB_HOST_MULTIARCH
(which is fine).

We could parse the output of platform.dist() but it's easier to just
search for the apt-get command:

if not find_executable('apt-get'):
# no Debian based distro
return
if not find_executable('dpkg-architecture'):
print "Warning, Debian detected but no dpkg-architecture found.
Please run 'sudo apt-get install build-essential'.
return

Christian

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


barry at python

May 5, 2012, 9:28 AM

Post #12 of 15 (1583 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On May 05, 2012, at 04:04 PM, Christian Heimes wrote:

>The fix needs the dpkg-architecture program. As Tshepang pointed out it
>may not be available on Edward's box. I always install build-essential
>on all development boxes as it includes GCC, make and dpkg-dev.

That's probably it. Certainly Python 2.7, 3.2, and 3.3 build just fine for me
on Debian Wheezy and Ubuntu Precise. One other thing: you might want to
`apt-get build-dep python3.2` to get all the build dependencies installed
first, even if you're building Python from source. If you're building Python
3.3 from source, you'll also want to install liblzma-dev.

Cheers,
-Barry

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


edcjones at comcast

May 5, 2012, 2:59 PM

Post #13 of 15 (1578 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

dpkg-architecture -qDEB_HOST_MULTIARCH

gives

x86_64-linux-gnu

Installing dpkg-dev fixed the problem. Now both 3.3a3 and a developmental "clone" work.

There is already a Debian package for 3.3 alpha3.
See http://packages.debian.org/source/experimental/python3.3
A large diff for Debian Python is available at this url.

The following should be installed before compiling python3. This list may
be incomplete. This list may include unnecessary packages.

dpkg-dev
sharutils
libreadline6-dev libreadline5
libncursesw5-dev libncursesw5
zlib1g-dev zlib1g
libbz2-dev bzip2
liblzma-dev liblzma5
libgdbm-dev libgdbm3
libdb5.3-dev libdb5.3
tk8.5-dev tk8.5
blt-dev blt
libssl-dev libssl1.0.0
libexpat1-dev libexpat1
libbluetooth-dev libbluetooth3
locales
libsqlite3-dev libsqlite3
libffi-dev libffi5
libgpm2 libgpm-dev
libtinfo-dev libtinfo5
mime-support
netbase
gdb
xvfb
xauth
python-sphinx (Implemented in python 2)


_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


doko at ubuntu

May 8, 2012, 5:17 PM

Post #14 of 15 (1560 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On 05.05.2012 16:13, Antoine Pitrou wrote:
> On Sat, 05 May 2012 16:04:40 +0200
> Christian Heimes <lists [at] cheimes> wrote:
>> Am 05.05.2012 15:39, schrieb Antoine Pitrou:
>>> On Sat, 05 May 2012 15:31:24 +0200
>>> Christian Heimes <lists [at] cheimes> wrote:
>>>> Am 05.05.2012 12:36, schrieb Antoine Pitrou:
>>>>>
>>>>> Hello,
>>>>>
>>>>> On Fri, 04 May 2012 14:07:28 -0400
>>>>> "Edward C. Jones" <edcjones [at] comcast> wrote:
>>>>>> Filelist of package libbz2-dev in wheezy of architecture amd64
>>>>>>
>>>>>> /usr/include/bzlib.h
>>>>>> /usr/lib/x86_64-linux-gnu/libbz2.a
>>>>>> /usr/lib/x86_64-linux-gnu/libbz2.so
>>>>>> /usr/share/doc/libbz2-dev
>>>>>
>>>>> setup.py probably doesn't search in the right paths for libbz2.so. I
>>>>> suggest you open a bug at http://bugs.python.org
>>>>
>>>> The issue might be caused by Debian's new multiarch libraries. In recent
>>>> versions of Debian (and Ubuntu), 64bit and 32bit libraries can coexist
>>>> on the same system.
>>>
>>> It probably is, but I thought Barry had tackled that in setup.py :-)
>>
>> The fix needs the dpkg-architecture program. As Tshepang pointed out it
>> may not be available on Edward's box. I always install build-essential
>> on all development boxes as it includes GCC, make and dpkg-dev.
>
> Perhaps setup.py should detect that? It shouldn't be too hard to
> parse /etc/debian_version in order to know whether the system is
> multiarch-enabled. That would avoid confusing build failures.

IMO, the correct fix would be not to hard-code the system include and library
directories, but get them from gcc directly (if CC is gcc), and not relying on
dpkg-architecture.

$ gcc -v -E - </dev/null
[...]
#include <...> search starts here:
/usr/lib/gcc/x86_64-linux-gnu/4.6/include
/usr/local/include
/usr/lib/gcc/x86_64-linux-gnu/4.6/include-fixed
/usr/include/x86_64-linux-gnu
/usr/include
End of search list.
[...]
LIBRARY_PATH=/usr/lib/gcc/x86_64-linux-gnu/4.6/:/usr/lib/gcc/x86_64-linux-gnu/4.6/../../../x86_64-linux-gnu/:/usr/lib/gcc/x86_64-linux-gnu/4.6/../../../../lib/:/lib/x86_64-linux-gnu/:/lib/../lib/:/usr/lib/x86_64-linux-gnu/:/usr/lib/../lib/:/usr/lib/gcc/x86_64-linux-gnu/4.6/../../../:/lib/:/usr/lib/

Matthias
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com


barry at python

May 8, 2012, 6:16 PM

Post #15 of 15 (1558 views)
Permalink
Re: Debian wheezy, amd64: make not finding files for bz2 and other packages [In reply to]

On May 09, 2012, at 02:17 AM, Matthias Klose wrote:

>IMO, the correct fix would be not to hard-code the system include and library
>directories, but get them from gcc directly (if CC is gcc), and not relying on
>dpkg-architecture.
>
>$ gcc -v -E - </dev/null
>[...]
>#include <...> search starts here:
> /usr/lib/gcc/x86_64-linux-gnu/4.6/include
> /usr/local/include
> /usr/lib/gcc/x86_64-linux-gnu/4.6/include-fixed
> /usr/include/x86_64-linux-gnu
> /usr/include
>End of search list.
>[...]
>LIBRARY_PATH=/usr/lib/gcc/x86_64-linux-gnu/4.6/:/usr/lib/gcc/x86_64-linux-gnu/4.6/../../../x86_64-linux-gnu/:/usr/lib/gcc/x86_64-linux-gnu/4.6/../../../../lib/:/lib/x86_64-linux-gnu/:/lib/../lib/:/usr/lib/x86_64-linux-gnu/:/usr/lib/../lib/:/usr/lib/gcc/x86_64-linux-gnu/4.6/../../../:/lib/:/usr/lib/

+1

This would make a good fix for Python 3.3. Matthias, perhaps you can work up
a patch for that?

-Barry
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

Python dev RSS feed   Index | Next | Previous | View Threaded
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.