Mailing List Archive: OpenSSH: Dev

Stack trace dor gssapi-with-mic

Index | Next | Previous | View Threaded

tcreedon at easystreet

Apr 19, 2009, 11:05 AM

Post #1 of 7 (1187 views)
Permalink

Stack trace dor gssapi-with-mic

I think I had better update akk the kerberos and gssapi to the latest?

Please advise.

Thanks

Tedc
ssh -vvv admin [at] geronimo
<<<<<<<<snip>>>>>>>>>
debug2: service_accept: ssh-userauth
debug1: SSH2_MSG_SERVICE_ACCEPT received
debug2: key: /root/.ssh/identity ((nil))
debug2: key: /root/.ssh/id_rsa (0x568da0)
debug2: key: /root/.ssh/id_dsa (0x568dc0)
debug1: Authentications that can continue: gssapi-with-mic
debug3: start over, passed a different list gssapi-with-mic
debug3: preferred gssapi-with-mic
debug3: authmethod_lookup gssapi-with-mic
debug3: remaining preferred:
debug3: authmethod_is_enabled gssapi-with-mic
debug1: Next authentication method: gssapi-with-mic
*** glibc detected *** ssh: double free or corruption (!prev):
0x0000000000574a20 ***
======= Backtrace: =========
/lib64/libc.so.6[0x2b044f62537e]
/lib64/libc.so.6(__libc_free+0x6c)[0x2b044f62699c]
/usr/lib64/libkrb5.so.3(krb5_free_cred_contents+0x6d)[0x2b044f1620cd]
/usr/lib64/libkrb5.so.3(krb5_free_creds+0x9)[0x2b044f162139]
/usr/lib64/libkrb5.so.3(krb5_free_tgt_creds+0x1d)[0x2b044f16216d]
/usr/lib64/libkrb5.so.3(krb5_get_credentials+0x209)[0x2b044f15d299]
/usr/lib64/libgssapi_krb5.so.2(krb5_gss_init_sec_context+0x998)[0x2b044f00ed68]
ssh[0x433b09]
ssh[0x433d3b]
ssh[0x412c83]
ssh[0x412e86]
ssh[0x42d2ca]
ssh[0x4139a8]
ssh[0x40e407]
ssh[0x4071ee]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x2b044f5d7154]
ssh[0x405d69]
======= Memory map: ========
00400000-0044f000 r-xp 00000000 08:05 571523
/usr/bin/ssh
0054f000-00551000 rw-p 0004f000 08:05 571523
/usr/bin/ssh
00551000-00596000 rw-p 00551000 00:00 0
[heap]
2b044e6c7000-2b044e6e2000 r-xp 00000000 08:05 33837
/lib64/ld-2.4.so
2b044e6e2000-2b044e6e4000 rw-p 2b044e6e2000 00:00 0
2b044e7e2000-2b044e7e4000 rw-p 0001b000 08:05 33837
/lib64/ld-2.4.so
2b044e7e4000-2b044e922000 r-xp 00000000 08:05 110687
/usr/lib64/libcrypto.so.0.9.8
2b044e922000-2b044ea21000 ---p 0013e000 08:05 110687
/usr/lib64/libcrypto.so.0.9.8
2b044ea21000-2b044ea44000 rw-p 0013d000 08:05 110687
/usr/lib64/libcrypto.so.0.9.8
2b044ea44000-2b044ea47000 rw-p 2b044ea44000 00:00 0
2b044ea47000-2b044ea7c000 r--s 00000000 08:05 570425
/var/run/nscd/passwd
2b044ea86000-2b044ea88000 r-xp 00000000 08:05 33878
/lib64/libutil-2.4.so
2b044ea88000-2b044eb87000 ---p 00002000 08:05 33878
/lib64/libutil-2.4.so
2b044eb87000-2b044eb89000 rw-p 00001000 08:05 33878
/lib64/libutil-2.4.so
2b044eb89000-2b044eb9d000 r-xp 00000000 08:05 48294
/lib64/libz.so.1.2.3
2b044eb9d000-2b044ec9c000 ---p 00014000 08:05 48294
/lib64/libz.so.1.2.3
2b044ec9c000-2b044ec9d000 rw-p 00013000 08:05 48294
/lib64/libz.so.1.2.3
2b044ec9d000-2b044ecb0000 r-xp 00000000 08:05 33855
/lib64/libnsl-2.4.so
2b044ecb0000-2b044edaf000 ---p 00013000 08:05 33855
/lib64/libnsl-2.4.so
2b044edaf000-2b044edb1000 rw-p 00012000 08:05 33855
/lib64/libnsl-2.4.so
2b044edb1000-2b044edb4000 rw-p 2b044edb1000 00:00 0
2b044edb4000-2b044edbd000 r-xp 00000000 08:05 33848
/lib64/libcrypt-2.4.so
2b044edbd000-2b044eebc000 ---p 00009000 08:05 33848
/lib64/libcrypt-2.4.so
2b044eebc000-2b044eebf000 rw-p 00008000 08:05 33848
/lib64/libcrypt-2.4.so
2b044eebf000-2b044eeed000 rw-p 2b044eebf000 00:00 0
2b044eeed000-2b044eefe000 r-xp 00000000 08:05 33872
/lib64/libresolv-2.4.so
2b044eefe000-2b044effd000 ---p 00011000 08:05 33872
/lib64/libresolv-2.4.so
2b044effd000-2b044efff000 rw-p 00010000 08:05 33872
/lib64/libresolv-2.4.so
2b044efff000-2b044f001000 rw-p 2b044efff000 00:00 0
2b044f001000-2b044f018000 r-xp 00000000 08:05 79430
/usr/lib64/libgssapi_krb5.so.2.2
2b044f018000-2b044f118000 ---p 00017000 08:05 79430
/usr/lib64/libgssapi_krb5.so.2.2
2b044f118000-2b044f119000 rw-p 00017000 08:05 79430
/usr/lib64/libgssapi_krb5.so.2.2
2b044f119000-2b044f11a000 rw-p 2b044f119000 00:00 0
2b044f11a000-2b044f18e000 r-xp 00000000 08:05 79444
/usr/lib64/libkrb5.so.3.2
2b044f18e000-2b044f28d000 ---p 00074000 08:05 79444
/usr/lib64/libkrb5.so.3.2
2b044f28d000-2b044f291000 rw-p 00073000 08:05 79444
/usr/lib64/libkrb5.so.3.2
2b044f291000-2b044f2b3000 r-xp 00000000 08:05 79434
/usr/lib64/libAborted
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev [at] mindrot
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev

Sergio.Gelato at astro

Apr 19, 2009, 1:10 PM

Post #2 of 7 (1133 views)
Permalink

Re: Stack trace dor gssapi-with-mic [In reply to]

* Ted Creedon [2009-04-19 11:05:22 -0700]:
> I think I had better update akk the kerberos and gssapi to the latest?
>
> Please advise.
>
> Thanks
>
> Tedc
> ssh -vvv admin [at] geronimo
> <<<<<<<<snip>>>>>>>>>
> debug2: service_accept: ssh-userauth
> debug1: SSH2_MSG_SERVICE_ACCEPT received
> debug2: key: /root/.ssh/identity ((nil))
> debug2: key: /root/.ssh/id_rsa (0x568da0)
> debug2: key: /root/.ssh/id_dsa (0x568dc0)
> debug1: Authentications that can continue: gssapi-with-mic
> debug3: start over, passed a different list gssapi-with-mic
> debug3: preferred gssapi-with-mic
> debug3: authmethod_lookup gssapi-with-mic
> debug3: remaining preferred:
> debug3: authmethod_is_enabled gssapi-with-mic
> debug1: Next authentication method: gssapi-with-mic
> *** glibc detected *** ssh: double free or corruption (!prev):
> 0x0000000000574a20 ***
> ======= Backtrace: =========
> /lib64/libc.so.6[0x2b044f62537e]
> /lib64/libc.so.6(__libc_free+0x6c)[0x2b044f62699c]
> /usr/lib64/libkrb5.so.3(krb5_free_cred_contents+0x6d)[0x2b044f1620cd]
> /usr/lib64/libkrb5.so.3(krb5_free_creds+0x9)[0x2b044f162139]
> /usr/lib64/libkrb5.so.3(krb5_free_tgt_creds+0x1d)[0x2b044f16216d]
> /usr/lib64/libkrb5.so.3(krb5_get_credentials+0x209)[0x2b044f15d299]
> /usr/lib64/libgssapi_krb5.so.2(krb5_gss_init_sec_context+0x998)[0x2b044f00ed68]

This looks like a client-side problem. Is the client also running some version
of SuSE? At this point I would look at the source code for the MIT Kerberos
package (the exact version installed on your client) and work out what must
have been happening. Running the ssh client under valgrind may also prove
instructive. Does your ccache contain a ticket for host/geronimo.creedon.biz
after the error?
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev [at] mindrot
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev

tcreedon at easystreet

Apr 19, 2009, 2:52 PM

Post #3 of 7 (1123 views)
Permalink

Re: Stack trace dor gssapi-with-mic [In reply to]

I think there are two problems:
1. geronimo.creedon.biz reverse dnslookups as a comcast uri (its on a
comcast dhcp line) - the forward dns is set up using dyndns. Look at the
garbled klist below..
2. all the servers are suse's - 10.0 thru 11.1 see the previous or I can
update all to 11.1..

ted

redcloud:~ # ping geronimo.creedon.biz
PING geronimo.creedon.biz (71.236.188.74) 56(84) bytes of data.
64 bytes from c-71-236-188-74.hsd1.or.comcast.net (71.236.188.74):
icmp_seq=1 ttl=62 time=27.4 ms

kinit -f root
ssh -vvv geronimo.creedon.biz

debug3: authmethod_is_enabled gssapi-with-mic
debug1: Next authentication method: gssapi-with-mic
*** glibc detected *** ssh: double free or corruption (!prev):
0x0000000000574b60 ***
======= Backtrace: =========
/lib64/libc.so.6[0x2b790e29237e]
/lib64/libc.so.6(__libc_free+0x6c)[0x2b790e29399c]
/usr/lib64/libkrb5.so.3(krb5_free_cred_contents+0x6d)[0x2b790ddcf0cd]
/usr/lib64/libkrb5.so.3(krb5_free_creds+0x9)[0x2b790ddcf139]
/usr/lib64/libkrb5.so.3(krb5_free_tgt_creds+0x1d)[0x2b790ddcf16d]
/usr/lib64/libkrb5.so.3(krb5_get_credentials+0x209)[0x2b790ddca299]
/usr/lib64/libgssapi_krb5.so.2(krb5_gss_init_sec_context+0x998)[0x2b790dc7bd68]
ssh[0x433b09]
ssh[0x433d3b]
ssh[0x412c83]
ssh[0x412e86]
ssh[0x42d2ca]
ssh[0x4139a8]
ssh[0x40e407]
ssh[0x4071ee]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x2b790e244154]
ssh[0x405d69]
======= Memory map: ========
00400000-0044f000 r-xp 00000000 08:05 571523
/usr/bin/ssh
0054f000-00551000 rw-p 0004f000 08:05 571523
/usr/bin/ssh
00551000-00596000 rw-p 00551000 00:00 0
[heap]
2b790d334000-2b790d34f000 r-xp 00000000 08:05 33837
/lib64/ld-2.4.so
2b790d34f000-2b790d351000 rw-p 2b790d34f000 00:00 0
2b790d44f000-2b790d451000 rw-p 0001b000 08:05 33837
/lib64/ld-2.4.so
2b790d451000-2b790d58f000 r-xp 00000000 08:05 110687
/usr/lib64/libcrypto.so.0.9.8
2b790d58f000-2b790d68e000 ---p 0013e000 08:05 110687
/usr/lib64/libcrypto.so.0.9.8
2b790d68e000-2b790d6b1000 rw-p 0013d000 08:05 110687
/usr/lib64/libcrypto.so.0.9.8
2b790d6b1000-2b790d6b4000 rw-p 2b790d6b1000 00:00 0
2b790d6b4000-2b790d6e9000 r--s 00000000 08:05 570797
/var/run/nscd/passwd
2b790d6f3000-2b790d6f5000 r-xp 00000000 08:05 33878
/lib64/libutil-2.4.so
2b790d6f5000-2b790d7f4000 ---p 00002000 08:05 33878
/lib64/libutil-2.4.so
2b790d7f4000-2b790d7f6000 rw-p 00001000 08:05 33878
/lib64/libutil-2.4.so
2b790d7f6000-2b790d80a000 r-xp 00000000 08:05 48294
/lib64/libz.so.1.2.3
2b790d80a000-2b790d909000 ---p 00014000 08:05 48294
/lib64/libz.so.1.2.3
2b790d909000-2b790d90a000 rw-p 00013000 08:05 48294
/lib64/libz.so.1.2.3
2b790d90a000-2b790d91d000 r-xp 00000000 08:05 33855
/lib64/libnsl-2.4.so
2b790d91d000-2b790da1c000 ---p 00013000 08:05 33855
/lib64/libnsl-2.4.so
2b790da1c000-2b790da1e000 rw-p 00012000 08:05 33855
/lib64/libnsl-2.4.so
2b790da1e000-2b790da21000 rw-p 2b790da1e000 00:00 0
2b790da21000-2b790da2a000 r-xp 00000000 08:05 33848
/lib64/libcrypt-2.4.so
2b790da2a000-2b790db29000 ---p 00009000 08:05 33848
/lib64/libcrypt-2.4.so
2b790db29000-2b790db2c000 rw-p 00008000 08:05 33848
/lib64/libcrypt-2.4.so
2b790db2c000-2b790db5a000 rw-p 2b790db2c000 00:00 0
2b790db5a000-2b790db6b000 r-xp 00000000 08:05 33872
/lib64/libresolv-2.4.so
2b790db6b000-2b790dc6a000 ---p 00011000 08:05 33872
/lib64/libresolv-2.4.so
2b790dc6a000-2b790dc6c000 rw-p 00010000 08:05 33872
/lib64/libresolv-2.4.so
2b790dc6c000-2b790dc6e000 rw-p 2b790dc6c000 00:00 0
2b790dc6e000-2b790dc85000 r-xp 00000000 08:05 79430
/usr/lib64/libgssapi_krb5.so.2.2
2b790dc85000-2b790dd85000 ---p 00017000 08:05 79430
/usr/lib64/libgssapi_krb5.so.2.2
2b790dd85000-2b790dd86000 rw-p 00017000 08:05 79430
/usr/lib64/libgssapi_krb5.so.2.2
2b790dd86000-2b790dd87000 rw-p 2b790dd86000 00:00 0
2b790dd87000-2b790ddfb000 r-xp 00000000 08:05 79444
/usr/lib64/libkrb5.so.3.2
2b790ddfb000-2b790defa000 ---p 00074000 08:05 79444
/usr/lib64/libkrb5.so.3.2
2b790defa000-2b790defe000 rw-p 00073000 08:05 79444
/usr/lib64/libkrb5.so.3.2
2b790defe000-2b790df20000 r-xp 00000000 08:05 79434
/usr/lib64/libk5crypto.so.3.0
2b790df20000-2b790e01f000 ---p 00022000 08:05 79434
/usr/lib64/libk5crypto.so.3.0
2b790e01f000-2b790e021000 rw-p 00021000 08:05 79434
/usr/lib64/libk5crypto.so.3.0
2b790e021000-2b790e024000 r-xp 00000000 08:05 79446
/usr/lib64/libkrb5support.so.0.0
2b790e024000-2b790e123000 ---p 00003000 08:05 79446
/usr/lib64/libkrb5support.so.0.0
2b790e123000-2b790e124000 rw-p 00002000 08:05 79446
/usr/lib64/libkrb5support.so.0.0
2b790e124000-2b790e125000 rw-p 2b790e124000 00:00 0
2b790e125000-2b790e127000 r-Aborted
redcloud:~ # klist
Ticket cache: FILE:/tmp/krb5cc_0
Default principal: root [at] CREEDON

Valid starting Expires Service principal
04/19/09 14:42:40 04/19/09 15:42:40 krbtgt/CREEDON.BIZ [at] CREEDON
renew until 04/19/09 15:42:40
04/19/09 14:43:00 04/19/09 15:42:40 /\@UW\0\0\0\0\0ST.NET [at] U\0\0\0\0\0BIZ
for client @GW\0\0\0\0\0BIZ, renew until 04/19/09 15:42:40
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev [at] mindrot
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev

dan at nf15

Apr 19, 2009, 3:43 PM

Post #4 of 7 (1128 views)
Permalink

Re: Stack trace dor gssapi-with-mic [In reply to]

On 20.04.2009 1:52, Ted Creedon wrote:
>
> debug3: authmethod_is_enabled gssapi-with-mic
> debug1: Next authentication method: gssapi-with-mic
> *** glibc detected *** ssh: double free or corruption (!prev):
> 0x0000000000574b60 ***
> ======= Backtrace: =========
> /lib64/libc.so.6[0x2b790e29237e]
> /lib64/libc.so.6(__libc_free+0x6c)[0x2b790e29399c]
> /usr/lib64/libkrb5.so.3(krb5_free_cred_contents+0x6d)[0x2b790ddcf0cd]
> /usr/lib64/libkrb5.so.3(krb5_free_creds+0x9)[0x2b790ddcf139]
> /usr/lib64/libkrb5.so.3(krb5_free_tgt_creds+0x1d)[0x2b790ddcf16d]
> /usr/lib64/libkrb5.so.3(krb5_get_credentials+0x209)[0x2b790ddca299]
> /usr/lib64/libgssapi_krb5.so.2(krb5_gss_init_sec_context+0x998)[0x2b790dc7bd68]

According to above lines, the problem is in /usr/lib64/libkrb5.so.3. So the
solution should be first upgrading Kerberos up to the latest available version,
and if that doesn't help, digging into Kerberos source. Most probably the
problem is that krb5_free_cred_contents() doesn't reset some pointer to NULL
after calling free() on it's target.
--

Sincerely Your, Dan.
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev [at] mindrot
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev

tcreedon at easystreet

Apr 19, 2009, 4:09 PM

Post #5 of 7 (1140 views)
Permalink

Re: Stack trace dor gssapi-with-mic [In reply to]

I'm going to update all my servers to the latest - will take a day or so..

thanks

ted

On Sun, Apr 19, 2009 at 3:43 PM, Dan Yefimov <dan [at] nf15>wrote:

> On 20.04.2009 1:52, Ted Creedon wrote:
> >
> > debug3: authmethod_is_enabled gssapi-with-mic
> > debug1: Next authentication method: gssapi-with-mic
> > *** glibc detected *** ssh: double free or corruption (!prev):
> > 0x0000000000574b60 ***
> > ======= Backtrace: =========
> > /lib64/libc.so.6[0x2b790e29237e]
> > /lib64/libc.so.6(__libc_free+0x6c)[0x2b790e29399c]
> > /usr/lib64/libkrb5.so.3(krb5_free_cred_contents+0x6d)[0x2b790ddcf0cd]
> > /usr/lib64/libkrb5.so.3(krb5_free_creds+0x9)[0x2b790ddcf139]
> > /usr/lib64/libkrb5.so.3(krb5_free_tgt_creds+0x1d)[0x2b790ddcf16d]
> > /usr/lib64/libkrb5.so.3(krb5_get_credentials+0x209)[0x2b790ddca299]
> >
> /usr/lib64/libgssapi_krb5.so.2(krb5_gss_init_sec_context+0x998)[0x2b790dc7bd68]
>
> According to above lines, the problem is in /usr/lib64/libkrb5.so.3. So the
> solution should be first upgrading Kerberos up to the latest available
> version,
> and if that doesn't help, digging into Kerberos source. Most probably the
> problem is that krb5_free_cred_contents() doesn't reset some pointer to
> NULL
> after calling free() on it's target.
> --
>
> Sincerely Your, Dan.
> _______________________________________________
> openssh-unix-dev mailing list
> openssh-unix-dev [at] mindrot
> https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev
>
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev [at] mindrot
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev

Sergio.Gelato at astro

Apr 20, 2009, 12:47 AM

Post #6 of 7 (1133 views)
Permalink

Re: Stack trace dor gssapi-with-mic [In reply to]

* Ted Creedon [2009-04-19 14:52:45 -0700]:
> I think there are two problems:
> 1. geronimo.creedon.biz reverse dnslookups as a comcast uri (its on a
> comcast dhcp line) - the forward dns is set up using dyndns. Look at the
> garbled klist below..

Both the stack trace and the garbled klist point to a serious problem
with the installation of MIT Kerberos on redcloud. (I assume your klist is
MIT Kerberos like the libraries ssh is linked against.) The DNS forward/reverse
mismatch is not a sufficient explanation for that klist output; a
corrupt credentials cache is more likely. (The timestamps look correct,
though; only the principals for that second ticket don't make sense.)

Try purging and reinstalling the Kerberos RPMs on redcloud. If this
were a fundamental problem with SuSE 10.1 I'd think it would have been
reported by others.

Check also the contents of /etc/krb5.conf.

Try testing basic Kerberos functionality independently of ssh.
For example, does aklog work for you? If it does, then maybe only the
GSSAPI library (which aklog doesn't use) is bad.

> redcloud:~ # klist
> Ticket cache: FILE:/tmp/krb5cc_0
> Default principal: root [at] CREEDON
>
> Valid starting Expires Service principal
> 04/19/09 14:42:40 04/19/09 15:42:40 krbtgt/CREEDON.BIZ [at] CREEDON
> renew until 04/19/09 15:42:40
> 04/19/09 14:43:00 04/19/09 15:42:40 /\@UW\0\0\0\0\0ST.NET [at] U\0\0\0\0\0BIZ
> for client @GW\0\0\0\0\0BIZ, renew until 04/19/09 15:42:40
>
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev [at] mindrot
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev

tcreedon at easystreet

Apr 20, 2009, 8:01 AM

Post #7 of 7 (1129 views)
Permalink

Re: Stack trace dor gssapi-with-mic [In reply to]

I'm running OpenAFS which relies on krb5

The garbled cc is a surprise to me too..

It does not explain the inconsistencies between the other 3 servers though

Best bet is to get to the latest of everything..It'll take a day or so..

thanks
tedc

On Mon, Apr 20, 2009 at 12:47 AM, Sergio Gelato
<Sergio.Gelato [at] astro>wrote:

> * Ted Creedon [2009-04-19 14:52:45 -0700]:
> > I think there are two problems:
> > 1. geronimo.creedon.biz reverse dnslookups as a comcast uri (its on a
> > comcast dhcp line) - the forward dns is set up using dyndns. Look at the
> > garbled klist below..
>
> Both the stack trace and the garbled klist point to a serious problem
> with the installation of MIT Kerberos on redcloud. (I assume your klist is
> MIT Kerberos like the libraries ssh is linked against.) The DNS
> forward/reverse
> mismatch is not a sufficient explanation for that klist output; a
> corrupt credentials cache is more likely. (The timestamps look correct,
> though; only the principals for that second ticket don't make sense.)
>
> Try purging and reinstalling the Kerberos RPMs on redcloud. If this
> were a fundamental problem with SuSE 10.1 I'd think it would have been
> reported by others.
>
> Check also the contents of /etc/krb5.conf.
>
> Try testing basic Kerberos functionality independently of ssh.
> For example, does aklog work for you? If it does, then maybe only the
> GSSAPI library (which aklog doesn't use) is bad.
>
> > redcloud:~ # klist
> > Ticket cache: FILE:/tmp/krb5cc_0
> > Default principal: root [at] CREEDON
> >
> > Valid starting Expires Service principal
> > 04/19/09 14:42:40 04/19/09 15:42:40 krbtgt/CREEDON.BIZ [at] CREEDON
> > renew until 04/19/09 15:42:40
> > 04/19/09 14:43:00 04/19/09 15:42:40 /\@UW\0\0\0\0\0ST.NET
> @UW\0\0\0\0\0BIZ
> > for client @GW\0\0\0\0\0BIZ, renew until 04/19/09 15:42:40
> >
>
_______________________________________________
openssh-unix-dev mailing list
openssh-unix-dev [at] mindrot
https://lists.mindrot.org/mailman/listinfo/openssh-unix-dev

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads