Mailing List Archive: Python: Dev

Re: thinking about 2.7 / buildbots / testing

Index | Next | Previous | View Threaded

david.lyon at preisshare

Sep 23, 2009, 9:23 PM

Post #1 of 6 (590 views)
Permalink

Re: thinking about 2.7 / buildbots / testing

On Wed, 23 Sep 2009 15:13:55 -0000, exarkun [at] twistedmatrix wrote:
> Quite a few years of experience with a distributed team of build slave
> managers has shown me that by far the most reliable way to keep slaves
> online is to have them managed by a dedicated team. This team doesn't
> need to be small, but since finding dedicated people can sometimes be
> challenging, I think small teams are the most likely outcome (possibly
> resulting in a team of one).

> ..

> Casual volunteers generally just won't keep up with these tasks.

True.

> I suggest finding someone who's seriously interested in the quality of
> CPython and giving them the responsibility of keeping things operating
> properly. This includes paying attention to the status of slaves,
> cajoling hardware operators into bringing hosts back online and fixing
> network issues, and finding replacements of the appropriate type
> (hardware/software platform) when a slave host is permanently lost.

Well, I'm a system administrator now, and a casual developer.

Yes, you need somebody who watches machine control panels and can
type emails on python lists at the same time.

> I would also personally recommend that this person first (well, after
> tracking down all the slave operators and convincing them to bring their
> slaves back online) acquire shell access to all of the slave machines so
> that the owners of the slave hosts themselves no longer need to be the
> gating factor for most issues.

Depends on where the machines are. There are good tools do check all
automatically. Nagios is one.

Anyway, this would suite my work schedule for the next 12 months.

Do we already have the machines? or do they need to be acquired?

David

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

ctb at msu

Sep 23, 2009, 9:40 PM

Post #2 of 6 (563 views)
Permalink

Re: thinking about 2.7 / buildbots / testing [In reply to]

On Thu, Sep 24, 2009 at 12:23:31AM -0400, David Lyon wrote:
> On Wed, 23 Sep 2009 15:13:55 -0000, exarkun [at] twistedmatrix wrote:
>
> > I would also personally recommend that this person first (well, after
> > tracking down all the slave operators and convincing them to bring their
> > slaves back online) acquire shell access to all of the slave machines so
> > that the owners of the slave hosts themselves no longer need to be the
> > gating factor for most issues.
>
> Depends on where the machines are. There are good tools do check all
> automatically. Nagios is one.
>
> Anyway, this would suite my work schedule for the next 12 months.
>
> Do we already have the machines? or do they need to be acquired?

Hi David,

as Brett leaked, I am developing software towards making this buildbot
dilemma easier to deal with. It's not really ready for primetime yet;
I'll send you a link off-list.

I am also (physically) hosting Snakebite, which Trent Nelson will be
tackling over the next few months.

And, finally, I now have Windows VMs (XP, Vista, 7) and a Mac OS X box
that I can dedicate to Python purposes. I even have a student that will
be monitoring those boxes. I am happy to give you access to these
machines if you want to set up buildbot on them; buildbot is compatible
with my own endeavors, so that would actually help me out ;)

I will be buying more/better/bigger Linux hardware over the next few
months, too, and I am happy to slice that off to provide more VMs --
basically whatever x86-based platforms people think are needed.

cheers,
--titus
--
C. Titus Brown, ctb [at] msu
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

solipsis at pitrou

Sep 24, 2009, 6:49 AM

Post #3 of 6 (539 views)
Permalink

Re: thinking about 2.7 / buildbots / testing [In reply to]

Le Thu, 24 Sep 2009 00:23:31 -0400, David Lyon a écrit :
>
> Depends on where the machines are. There are good tools do check all
> automatically. Nagios is one.
>
> Anyway, this would suite my work schedule for the next 12 months.
>
> Do we already have the machines? or do they need to be acquired?

I have (root) access to a powerful x86-64 Debian machine that I might
give you non-root access to, if it's enough. I'll have to ask the owner
of the machine, however. Tell me if that can be useful.

Regards

Antoine.

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

rdmurray at bitdance

Sep 24, 2009, 7:14 AM

Post #4 of 6 (543 views)
Permalink

Re: thinking about 2.7 / buildbots / testing [In reply to]

On Thu, 24 Sep 2009 at 13:49, Antoine Pitrou wrote:
> Le Thu, 24 Sep 2009 00:23:31 -0400, David Lyon a écrit :
>>
>> Depends on where the machines are. There are good tools do check all
>> automatically. Nagios is one.
>>
>> Anyway, this would suite my work schedule for the next 12 months.
>>
>> Do we already have the machines? or do they need to be acquired?
>
> I have (root) access to a powerful x86-64 Debian machine that I might
> give you non-root access to, if it's enough. I'll have to ask the owner
> of the machine, however. Tell me if that can be useful.

I've been a sysadmin for years (among other things). If Jean-Paul's
suggestion of forming a small team to manage this is followed, I
volunteer to be part of that team. And if Snakebite isn't enough I
have a well-connected platform I could run Linux buildbots on in
vserver virthosts, and a less-well-connected platform that could run
KVM based stuff.

--David (R. David Murray)

solipsis at pitrou

Sep 24, 2009, 10:16 AM

Post #5 of 6 (535 views)
Permalink

Re: thinking about 2.7 / buildbots / testing [In reply to]

R. David Murray <rdmurray <at> bitdance.com> writes:
>
> And if Snakebite isn't enough I
> have a well-connected platform I could run Linux buildbots on in
> vserver virthosts, and a less-well-connected platform that could run
> KVM based stuff.

I suppose Snakebite will be enough, but only once it is ready :)
We still need some buildbots (or any equivalent) in the meantime...

Regards

Antoine.

_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

martin at v

Sep 24, 2009, 4:25 PM

Post #6 of 6 (551 views)
Permalink

Re: thinking about 2.7 / buildbots / testing [In reply to]

> Do we already have the machines? or do they need to be acquired?

Yes, the machines are all there, see

http://www.python.org/dev/buildbot/all/

Regards,
Martin
_______________________________________________
Python-Dev mailing list
Python-Dev [at] python
http://mail.python.org/mailman/listinfo/python-dev
Unsubscribe: http://mail.python.org/mailman/options/python-dev/list-python-dev%40lists.gossamer-threads.com

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads