Login | Register For Free | Help
Search for: (Advanced)

Mailing List Archive: Xen: Devel
[Hackathon minutes] PV frontends/backends and NUMA machines
 

Index | Next | Previous | View Flat


stefano.stabellini at eu

May 20, 2013, 6:44 AM


Views: 1196
Permalink
[Hackathon minutes] PV frontends/backends and NUMA machines

Hi all,
these are my notes from the discussion that we had at the Hackathon
regarding PV frontends and backends running on NUMA machines.


---

The problem: how can we make sure that frontends and backends run in the
same NUMA node?

We would need to run one backend kthread per NUMA node: we have already
one kthread per netback vif (one per guest), we could pin each of them
on a different NUMA node, the same one the frontend is running on.

But that means that dom0 would be running on several NUMA nodes at once,
how much of a performance penalty would that be?
We would need to export NUMA information to dom0, so that dom0 can make
smart decisions on memory allocations and we would also need to allocate
memory for dom0 from multiple nodes.

We need a way to automatically allocate the initial dom0 memory in Xen
in a NUMA-aware way and we need Xen to automatically create one dom0 vcpu
per NUMA node.

After dom0 boots, the toolstack is going to decide where to place any
new guests: it allocates the memory from the NUMA node it wants to run
the guest on and it is going to ask dom0 to allocate the kthread from
that node too. (Maybe writing the NUMA node on xenstore.)

We need to make sure that the interrupts/MSIs coming from the NIC arrive
on the same pcpu that is running the vcpu that needs to receive it.
We need to do irqbalacing in dom0, then Xen automatically will make the
physical MSIs follow the vcpu automatically.

If the card is multiqueue we need to make sure that we use the multiple
queues so that we can have difference sources of interrupts/MSIs for
each vif. This allows us to independently notify each dom0 vcpu.

_______________________________________________
Xen-devel mailing list
Xen-devel [at] lists
http://lists.xen.org/xen-devel

Subject User Time
[Hackathon minutes] PV frontends/backends and NUMA machines stefano.stabellini at eu May 20, 2013, 6:44 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines dunlapg at umich May 20, 2013, 6:48 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines tim at xen May 21, 2013, 1:32 AM
        Re: [Hackathon minutes] PV frontends/backends and NUMA machines George.Dunlap at eu May 21, 2013, 1:47 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines roger.pau at citrix May 21, 2013, 1:44 AM
        Re: [Hackathon minutes] PV frontends/backends and NUMA machines wei.liu2 at citrix May 21, 2013, 2:24 AM
            Re: [Hackathon minutes] PV frontends/backends and NUMA machines George.Dunlap at eu May 21, 2013, 2:53 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines George.Dunlap at eu May 21, 2013, 1:49 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines tim at xen May 21, 2013, 2:20 AM
        Re: [Hackathon minutes] PV frontends/backends and NUMA machines george.dunlap at eu May 21, 2013, 2:45 AM
            Re: [Hackathon minutes] PV frontends/backends and NUMA machines tim at xen May 21, 2013, 3:24 AM
                Re: [Hackathon minutes] PV frontends/backends and NUMA machines george.dunlap at eu May 21, 2013, 3:28 AM
                    Re: [Hackathon minutes] PV frontends/backends and NUMA machines dario.faggioli at citrix May 21, 2013, 4:12 AM
        Re: [Hackathon minutes] PV frontends/backends and NUMA machines dario.faggioli at citrix May 21, 2013, 2:53 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines raistlin at linux May 21, 2013, 3:03 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines JBeulich at suse May 21, 2013, 3:06 AM
        Re: [Hackathon minutes] PV frontends/backends and NUMA machines raistlin at linux May 21, 2013, 3:30 AM
            Re: [Hackathon minutes] PV frontends/backends and NUMA machines JBeulich at suse May 21, 2013, 3:43 AM
                Re: [Hackathon minutes] PV frontends/backends and NUMA machines raistlin at linux May 21, 2013, 3:58 AM
                    Re: [Hackathon minutes] PV frontends/backends and NUMA machines JBeulich at suse May 21, 2013, 4:47 AM
                        Re: [Hackathon minutes] PV frontends/backends and NUMA machines dario.faggioli at citrix May 21, 2013, 6:43 AM
                            Re: [Hackathon minutes] PV frontends/backends and NUMA machines george.dunlap at eu May 24, 2013, 9:00 AM
                                Re: [Hackathon minutes] PV frontends/backends and NUMA machines dario.faggioli at citrix May 25, 2013, 6:57 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines raistlin at linux May 21, 2013, 3:17 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines dario.faggioli at citrix May 21, 2013, 4:10 AM
        Re: [Hackathon minutes] PV frontends/backends and NUMA machines raistlin at linux May 23, 2013, 10:21 AM
    Re: [Hackathon minutes] PV frontends/backends and NUMA machines konrad.wilk at oracle May 21, 2013, 6:28 PM
        Re: [Hackathon minutes] PV frontends/backends and NUMA machines dario.faggioli at citrix May 22, 2013, 12:44 AM

  Index | Next | Previous | View Flat
 
 


Interested in having your list archived? Contact Gossamer Threads
 
  Web Applications & Managed Hosting Powered by Gossamer Threads Inc.