North American Network Operators Group

Date Prev | Date Next | Date Index | Thread Index | Author Index | Historical

RE: 10GE router resource

  • From: Ray Burkholder
  • Date: Wed Mar 26 09:18:12 2008

Is there a multiport card out there on to which some of the forwarding
responsibilities can be offloaded?  Perhaps the CPU doesn't need to see
every packet that arrives on the machine.

-----Original Message-----
From: [email protected] [mailto:[email protected]] On Behalf Of
Adrian Chadd
Sent: Wednesday, March 26, 2008 09:30
To: [email protected]
Cc: [email protected]
Subject: Re: 10GE router resource

On Wed, Mar 26, 2008, [email protected] wrote:
> >  He hit a 
> > wall at 700K pps and was using two dual core Intel Xeon 64bit 
> > 2.33GHz CPUs and 2GB of RAM in a Dell PowerEdge 1950.
> Unless I am misreading this, he did not hit a wall. What he did was
> test a design that was scalable to multiple cores and show that the
> two core version could not go beyond 700k pps. The next logical question
> is how much more can you push with larger numbers of cores. The key
> thing is to use a recent Linux kernel that can share interrupts among
> multiple cores and to run it on a CPU using MSI interrupts. Since this
> was written up in January of 2007, 
> There are people who use Linux for load balancing who also are working
> on finding how well it can cope with 10G of traffic and they have some
> anecdotal evidence of 800k pps.

I didn't think the hardware quite worked like that :)

The paper doesn't cover -why- he hit a limit on a single core and why two
are any faster. He didn't do any benchmarking, no oprofile traces, etc.

What would be much more interesting is to see where its running out of
and why more L1 cache helps. The AMD/Intel difference could be due to how
the memory systems operate/differ, but its all conjecture from me at this
I haven't looked into it in depth.

Just a random datapoint, some FreeBSD related people working on commercial
systems have noted they were able to achieve 1mil pps on intel gige
Its just not in open source. :)


Scanned for viruses and dangerous content at and is believed to be clean.

Scanned for viruses and dangerous content at and is believed to be clean.