Mailing List Archive: OpenStack: Dev

Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list

Index | Next | Previous | View Threaded

apontes at cpqd

May 16, 2012, 5:25 AM

Post #1 of 9 (139 views)
Permalink

Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list

Hi,

If the problem is libvirt, nova-compute should not be running, and it would
be reported in the /var/log/nova/nova.conf and in
/var/log/libvirt/libvirtd.log

Verify with
$ service nova-compute status

It can also be a sincronization problem.
Did you properly configured ntp??

2012/5/16 heut2008 <heut2008 [at] gmail>

> the log shows nova-compute is connecting to qemu://system ,can you
> use virsh list .I still suspecd that it is you libvirt causes this.
>
> 2012/5/16 Gurjar, Unmesh <Unmesh.Gurjar [at] nttdata>:
> > Hi Leander,
> >
> >
> >
> > The issue is the Compute is not updating its heartbeat (services table in
> > the nova database), which is causing this.
> >
> > You probably need to check database connection string in the nova.conf on
> > the Compute host and the db connection from the Compute host is working.
> >
> >
> >
> > Thanks & Regards,
> >
> > Unmesh Gurjar | Lead Engineer | Vertex Software Private Ltd. | w.
> > +91.20.6604.1500 x 379 | m. +91.982.324.7631 | unmesh.gurjar [at] nttdata|
> > Follow us on Twitter [at] NTTDATAAmerica
> >
> >
> >
> > From: openstack-bounces+unmesh.gurjar=nttdata.com [at] lists
> > [mailto:openstack-bounces+unmesh.gurjar=nttdata.com [at] lists]
> On
> > Behalf Of Leander Bessa Beernaert
> > Sent: Wednesday, May 16, 2012 4:30 PM
> > To: openstack [at] lists
> > Subject: [Openstack] [Compute] nova-compute does not show up as ":-)" in
> > nova-manage service list
> >
> >
> >
> > Hello,
> >
> >
> >
> >
> >
> > I can't get nova-compute to show up as ":-)" under 'nova-manager service
> > list'. I've checked the logs and can't find any error or warning.
> >
> >
> >
> > I'm using the default packages shipped with ubuntu 12.04 and have
> installed
> > everything in a virtual machine.
> >
> >
> >
> > Regards,
> >
> >
> >
> > Leander
> >
> >
> > ______________________________________________________________________
> > Disclaimer:This email and any attachments are sent in strictest
> confidence
> > for the sole use of the addressee and may contain legally privileged,
> > confidential, and proprietary data. If you are not the intended
> recipient,
> > please advise the sender by replying promptly to this email and then
> delete
> > and destroy this email and any attachments without any further use,
> copying
> > or forwarding
> >
> > _______________________________________________
> > Mailing list: https://launchpad.net/~openstack
> > Post to : openstack [at] lists
> > Unsubscribe : https://launchpad.net/~openstack
> > More help : https://help.launchpad.net/ListHelp
> >
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to : openstack [at] lists
> Unsubscribe : https://launchpad.net/~openstack
> More help : https://help.launchpad.net/ListHelp
>

--
*Alisson*

kiall at managedit

May 16, 2012, 6:28 AM

Post #2 of 9 (137 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
apontes [at] cpqd> wrote:

> If the problem is libvirt, nova-compute should not be running, and it
> would be reported in the /var/log/nova/nova.conf and in
> /var/log/libvirt/libvirtd.log
>
> Verify with
> $ service nova-compute status
>

I've seen *many* cases where nova stalls due to some libvirt issues. I
wouldn't be so quick to rule libvirt out just because the nova-compute
process is alive!

It can also be a sincronization problem.
> Did you properly configured ntp??
>

I believe this is a single server (well .. VM) setup. NTP /
time synchronization should not be an issue.

Thanks,
Kiall

leanderbb at gmail

May 16, 2012, 6:39 AM

Post #3 of 9 (136 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

Do you have any suggestions on where to start looking for libvirt issues?
I've tried looking at the logs from libvirt, but they did not show any
indication of errors.

On Wed, May 16, 2012 at 2:28 PM, Kiall Mac Innes <kiall [at] managedit> wrote:

> On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
> apontes [at] cpqd> wrote:
>
>> If the problem is libvirt, nova-compute should not be running, and it
>> would be reported in the /var/log/nova/nova.conf and in
>> /var/log/libvirt/libvirtd.log
>>
>> Verify with
>> $ service nova-compute status
>>
>
> I've seen *many* cases where nova stalls due to some libvirt issues. I
> wouldn't be so quick to rule libvirt out just because the nova-compute
> process is alive!
>
> It can also be a sincronization problem.
>> Did you properly configured ntp??
>>
>
> I believe this is a single server (well .. VM) setup. NTP /
> time synchronization should not be an issue.
>

> Thanks,
> Kiall
>

kiall at managedit

May 16, 2012, 6:44 AM

Post #4 of 9 (138 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

Almost all of the libvirt issues I ran into were "fixed" by restarting
libvirt, and on one occasion, rebooting the server.

I narrowed some of the issues down to various libvirt bugs at the time, but
never followed up after an Ubuntu update fixed the issues..

All that said, "I tried 'virsh list', and the command hangs." sounds very
familiar - as does your log output ;)

Have you attempted to restart libvirt yet? (`service libvirt-bin restart`)

Thanks,
Kiall

On Wed, May 16, 2012 at 2:39 PM, Leander Bessa Beernaert <
leanderbb [at] gmail> wrote:

> Do you have any suggestions on where to start looking for libvirt issues?
> I've tried looking at the logs from libvirt, but they did not show any
> indication of errors.
>
>
> On Wed, May 16, 2012 at 2:28 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>
>> On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
>> apontes [at] cpqd> wrote:
>>
>>> If the problem is libvirt, nova-compute should not be running, and it
>>> would be reported in the /var/log/nova/nova.conf and in
>>> /var/log/libvirt/libvirtd.log
>>>
>>> Verify with
>>> $ service nova-compute status
>>>
>>
>> I've seen *many* cases where nova stalls due to some libvirt issues. I
>> wouldn't be so quick to rule libvirt out just because the nova-compute
>> process is alive!
>>
>> It can also be a sincronization problem.
>>> Did you properly configured ntp??
>>>
>>
>> I believe this is a single server (well .. VM) setup. NTP /
>> time synchronization should not be an issue.
>>
>
>> Thanks,
>> Kiall
>>
>
>

leanderbb at gmail

May 16, 2012, 6:51 AM

Post #5 of 9 (137 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

I stopped nova-compute, restarted libvirt-bin and then started
nova-compute. Yet, the issue still remains :/

On Wed, May 16, 2012 at 2:44 PM, Kiall Mac Innes <kiall [at] managedit> wrote:

> Almost all of the libvirt issues I ran into were "fixed" by restarting
> libvirt, and on one occasion, rebooting the server.
>
> I narrowed some of the issues down to various libvirt bugs at the time,
> but never followed up after an Ubuntu update fixed the issues..
>
> All that said, "I tried 'virsh list', and the command hangs." sounds very
> familiar - as does your log output ;)
>
> Have you attempted to restart libvirt yet? (`service libvirt-bin restart`)
>
> Thanks,
> Kiall
>
>
>
> On Wed, May 16, 2012 at 2:39 PM, Leander Bessa Beernaert <
> leanderbb [at] gmail> wrote:
>
>> Do you have any suggestions on where to start looking for libvirt issues?
>> I've tried looking at the logs from libvirt, but they did not show any
>> indication of errors.
>>
>>
>> On Wed, May 16, 2012 at 2:28 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>
>>> On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
>>> apontes [at] cpqd> wrote:
>>>
>>>> If the problem is libvirt, nova-compute should not be running, and it
>>>> would be reported in the /var/log/nova/nova.conf and in
>>>> /var/log/libvirt/libvirtd.log
>>>>
>>>> Verify with
>>>> $ service nova-compute status
>>>>
>>>
>>> I've seen *many* cases where nova stalls due to some libvirt issues. I
>>> wouldn't be so quick to rule libvirt out just because the nova-compute
>>> process is alive!
>>>
>>> It can also be a sincronization problem.
>>>> Did you properly configured ntp??
>>>>
>>>
>>> I believe this is a single server (well .. VM) setup. NTP /
>>> time synchronization should not be an issue.
>>>
>>
>>> Thanks,
>>> Kiall
>>>
>>
>>
>

kiall at managedit

May 16, 2012, 6:51 AM

Post #6 of 9 (137 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

Does `virsh list` still hang? Until that succeeds, nova is not the
problem..

Thanks,
Kiall

On Wed, May 16, 2012 at 2:51 PM, Leander Bessa Beernaert <
leanderbb [at] gmail> wrote:

> I stopped nova-compute, restarted libvirt-bin and then started
> nova-compute. Yet, the issue still remains :/
>
>
> On Wed, May 16, 2012 at 2:44 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>
>> Almost all of the libvirt issues I ran into were "fixed" by restarting
>> libvirt, and on one occasion, rebooting the server.
>>
>> I narrowed some of the issues down to various libvirt bugs at the time,
>> but never followed up after an Ubuntu update fixed the issues..
>>
>> All that said, "I tried 'virsh list', and the command hangs." sounds
>> very familiar - as does your log output ;)
>>
>> Have you attempted to restart libvirt yet? (`service libvirt-bin restart`)
>>
>> Thanks,
>> Kiall
>>
>>
>>
>> On Wed, May 16, 2012 at 2:39 PM, Leander Bessa Beernaert <
>> leanderbb [at] gmail> wrote:
>>
>>> Do you have any suggestions on where to start looking for libvirt
>>> issues? I've tried looking at the logs from libvirt, but they did not show
>>> any indication of errors.
>>>
>>>
>>> On Wed, May 16, 2012 at 2:28 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>>
>>>> On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
>>>> apontes [at] cpqd> wrote:
>>>>
>>>>> If the problem is libvirt, nova-compute should not be running, and it
>>>>> would be reported in the /var/log/nova/nova.conf and in
>>>>> /var/log/libvirt/libvirtd.log
>>>>>
>>>>> Verify with
>>>>> $ service nova-compute status
>>>>>
>>>>
>>>> I've seen *many* cases where nova stalls due to some libvirt issues. I
>>>> wouldn't be so quick to rule libvirt out just because the nova-compute
>>>> process is alive!
>>>>
>>>> It can also be a sincronization problem.
>>>>> Did you properly configured ntp??
>>>>>
>>>>
>>>> I believe this is a single server (well .. VM) setup. NTP /
>>>> time synchronization should not be an issue.
>>>>
>>>
>>>> Thanks,
>>>> Kiall
>>>>
>>>
>>>
>>
>

leanderbb at gmail

May 16, 2012, 6:53 AM

Post #7 of 9 (138 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

It only hangs when invoked as root. With standard user permissions it works
just fine.

On Wed, May 16, 2012 at 2:51 PM, Kiall Mac Innes <kiall [at] managedit> wrote:

> Does `virsh list` still hang? Until that succeeds, nova is not the
> problem..
>
> Thanks,
> Kiall
>
>
>
> On Wed, May 16, 2012 at 2:51 PM, Leander Bessa Beernaert <
> leanderbb [at] gmail> wrote:
>
>> I stopped nova-compute, restarted libvirt-bin and then started
>> nova-compute. Yet, the issue still remains :/
>>
>>
>> On Wed, May 16, 2012 at 2:44 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>
>>> Almost all of the libvirt issues I ran into were "fixed" by restarting
>>> libvirt, and on one occasion, rebooting the server.
>>>
>>> I narrowed some of the issues down to various libvirt bugs at the time,
>>> but never followed up after an Ubuntu update fixed the issues..
>>>
>>> All that said, "I tried 'virsh list', and the command hangs." sounds
>>> very familiar - as does your log output ;)
>>>
>>> Have you attempted to restart libvirt yet? (`service libvirt-bin
>>> restart`)
>>>
>>> Thanks,
>>> Kiall
>>>
>>>
>>>
>>> On Wed, May 16, 2012 at 2:39 PM, Leander Bessa Beernaert <
>>> leanderbb [at] gmail> wrote:
>>>
>>>> Do you have any suggestions on where to start looking for libvirt
>>>> issues? I've tried looking at the logs from libvirt, but they did not show
>>>> any indication of errors.
>>>>
>>>>
>>>> On Wed, May 16, 2012 at 2:28 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>>>
>>>>> On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
>>>>> apontes [at] cpqd> wrote:
>>>>>
>>>>>> If the problem is libvirt, nova-compute should not be running, and it
>>>>>> would be reported in the /var/log/nova/nova.conf and in
>>>>>> /var/log/libvirt/libvirtd.log
>>>>>>
>>>>>> Verify with
>>>>>> $ service nova-compute status
>>>>>>
>>>>>
>>>>> I've seen *many* cases where nova stalls due to some libvirt issues.
>>>>> I wouldn't be so quick to rule libvirt out just because the nova-compute
>>>>> process is alive!
>>>>>
>>>>> It can also be a sincronization problem.
>>>>>> Did you properly configured ntp??
>>>>>>
>>>>>
>>>>> I believe this is a single server (well .. VM) setup. NTP /
>>>>> time synchronization should not be an issue.
>>>>>
>>>>
>>>>> Thanks,
>>>>> Kiall
>>>>>
>>>>
>>>>
>>>
>>
>

kiall at managedit

May 16, 2012, 6:57 AM

Post #8 of 9 (144 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

Interesting.. I've never seen that before and honestly have no clue why
root would fail, but a less privileged account would succeed.

Also.. I should have mentioned, I found that certain libvirt stalls needed
an explicit `service libvirt-bin stop && service libvirt-bin start` to get
it going again rather than a `service libvirt-bin restart`.

Thanks,
Kiall

On Wed, May 16, 2012 at 2:53 PM, Leander Bessa Beernaert <
leanderbb [at] gmail> wrote:

> It only hangs when invoked as root. With standard user permissions it
> works just fine.
>
>
> On Wed, May 16, 2012 at 2:51 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>
>> Does `virsh list` still hang? Until that succeeds, nova is not the
>> problem..
>>
>> Thanks,
>> Kiall
>>
>>
>>
>> On Wed, May 16, 2012 at 2:51 PM, Leander Bessa Beernaert <
>> leanderbb [at] gmail> wrote:
>>
>>> I stopped nova-compute, restarted libvirt-bin and then started
>>> nova-compute. Yet, the issue still remains :/
>>>
>>>
>>> On Wed, May 16, 2012 at 2:44 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>>
>>>> Almost all of the libvirt issues I ran into were "fixed" by restarting
>>>> libvirt, and on one occasion, rebooting the server.
>>>>
>>>> I narrowed some of the issues down to various libvirt bugs at the time,
>>>> but never followed up after an Ubuntu update fixed the issues..
>>>>
>>>> All that said, "I tried 'virsh list', and the command hangs." sounds
>>>> very familiar - as does your log output ;)
>>>>
>>>> Have you attempted to restart libvirt yet? (`service libvirt-bin
>>>> restart`)
>>>>
>>>> Thanks,
>>>> Kiall
>>>>
>>>>
>>>>
>>>> On Wed, May 16, 2012 at 2:39 PM, Leander Bessa Beernaert <
>>>> leanderbb [at] gmail> wrote:
>>>>
>>>>> Do you have any suggestions on where to start looking for libvirt
>>>>> issues? I've tried looking at the logs from libvirt, but they did not show
>>>>> any indication of errors.
>>>>>
>>>>>
>>>>> On Wed, May 16, 2012 at 2:28 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>>>>
>>>>>> On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
>>>>>> apontes [at] cpqd> wrote:
>>>>>>
>>>>>>> If the problem is libvirt, nova-compute should not be running, and
>>>>>>> it would be reported in the /var/log/nova/nova.conf and in
>>>>>>> /var/log/libvirt/libvirtd.log
>>>>>>>
>>>>>>> Verify with
>>>>>>> $ service nova-compute status
>>>>>>>
>>>>>>
>>>>>> I've seen *many* cases where nova stalls due to some libvirt issues.
>>>>>> I wouldn't be so quick to rule libvirt out just because the nova-compute
>>>>>> process is alive!
>>>>>>
>>>>>> It can also be a sincronization problem.
>>>>>>> Did you properly configured ntp??
>>>>>>>
>>>>>>
>>>>>> I believe this is a single server (well .. VM) setup. NTP /
>>>>>> time synchronization should not be an issue.
>>>>>>
>>>>>
>>>>>> Thanks,
>>>>>> Kiall
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>

leanderbb at gmail

May 16, 2012, 7:08 AM

Post #9 of 9 (146 views)
Permalink

Re: Fwd: [Compute] nova-compute does not show up as ":-)" in nova-manage service list [In reply to]

Still doesn't work for root. Thanks for the pointers though. I'm going to
try this on a physical machine and hopefully this issues solves it self.

On Wed, May 16, 2012 at 2:57 PM, Kiall Mac Innes <kiall [at] managedit> wrote:

> Interesting.. I've never seen that before and honestly have no clue why
> root would fail, but a less privileged account would succeed.
>
> Also.. I should have mentioned, I found that certain libvirt stalls needed
> an explicit `service libvirt-bin stop && service libvirt-bin start` to get
> it going again rather than a `service libvirt-bin restart`.
>
> Thanks,
> Kiall
>
>
>
> On Wed, May 16, 2012 at 2:53 PM, Leander Bessa Beernaert <
> leanderbb [at] gmail> wrote:
>
>> It only hangs when invoked as root. With standard user permissions it
>> works just fine.
>>
>>
>> On Wed, May 16, 2012 at 2:51 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>
>>> Does `virsh list` still hang? Until that succeeds, nova is not the
>>> problem..
>>>
>>> Thanks,
>>> Kiall
>>>
>>>
>>>
>>> On Wed, May 16, 2012 at 2:51 PM, Leander Bessa Beernaert <
>>> leanderbb [at] gmail> wrote:
>>>
>>>> I stopped nova-compute, restarted libvirt-bin and then started
>>>> nova-compute. Yet, the issue still remains :/
>>>>
>>>>
>>>> On Wed, May 16, 2012 at 2:44 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>>>
>>>>> Almost all of the libvirt issues I ran into were "fixed" by restarting
>>>>> libvirt, and on one occasion, rebooting the server.
>>>>>
>>>>> I narrowed some of the issues down to various libvirt bugs at the
>>>>> time, but never followed up after an Ubuntu update fixed the issues..
>>>>>
>>>>> All that said, "I tried 'virsh list', and the command hangs." sounds
>>>>> very familiar - as does your log output ;)
>>>>>
>>>>> Have you attempted to restart libvirt yet? (`service libvirt-bin
>>>>> restart`)
>>>>>
>>>>> Thanks,
>>>>> Kiall
>>>>>
>>>>>
>>>>>
>>>>> On Wed, May 16, 2012 at 2:39 PM, Leander Bessa Beernaert <
>>>>> leanderbb [at] gmail> wrote:
>>>>>
>>>>>> Do you have any suggestions on where to start looking for libvirt
>>>>>> issues? I've tried looking at the logs from libvirt, but they did not show
>>>>>> any indication of errors.
>>>>>>
>>>>>>
>>>>>> On Wed, May 16, 2012 at 2:28 PM, Kiall Mac Innes <kiall [at] managedit>wrote:
>>>>>>
>>>>>>> On Wed, May 16, 2012 at 1:25 PM, Alisson Soares Limeira Pontes <
>>>>>>> apontes [at] cpqd> wrote:
>>>>>>>
>>>>>>>> If the problem is libvirt, nova-compute should not be running, and
>>>>>>>> it would be reported in the /var/log/nova/nova.conf and in
>>>>>>>> /var/log/libvirt/libvirtd.log
>>>>>>>>
>>>>>>>> Verify with
>>>>>>>> $ service nova-compute status
>>>>>>>>
>>>>>>>
>>>>>>> I've seen *many* cases where nova stalls due to some libvirt
>>>>>>> issues. I wouldn't be so quick to rule libvirt out just because the
>>>>>>> nova-compute process is alive!
>>>>>>>
>>>>>>> It can also be a sincronization problem.
>>>>>>>> Did you properly configured ntp??
>>>>>>>>
>>>>>>>
>>>>>>> I believe this is a single server (well .. VM) setup. NTP /
>>>>>>> time synchronization should not be an issue.
>>>>>>>
>>>>>>
>>>>>>> Thanks,
>>>>>>> Kiall
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

Index | Next | Previous | View Threaded

Interested in having your list archived? Contact Gossamer Threads