North American Network Operators Group

Date Prev | Date Next | Date Index | Thread Index | Author Index | Historical

RE: NNTP feed.

  • From: John van Oppen
  • Date: Tue Sep 05 19:49:10 2006

I guess I should say that most people are outsourcing to the bigger news shops (at least the people I know are) due to the hardware demands of today's news volumes.

john :)

-----Original Message-----
From: Jeroen Massar [mailto:[email protected]]
Sent: Tue 9/5/2006 4:10 PM
To: John van Oppen
Cc: [email protected]; Drew Weaver; [email protected]
Subject: Re: NNTP feed.
 
John van Oppen wrote:
> we don't run one either...  :)
> 
> The last person I know who was running one, was in the proccess of killing it.  

Apparently you found some people killing it off, while there are 
actually companies who specialize in NNTP access. It seems that for 
mysterious reasons which the RIAA and other such organizations 
apparently don't seem to understand that these companies are also 
causing quite a lot of traffic to be shifted over the internet.

Peeking at for instance http://www.nextfeed.nl/ reveals that there is 
one ISP having 40 days retention which apparently maps to 6*50 TB (that 
is 300 Terabytes indeed) of storage space, while there are also another 
having 50 days of retention, most likely mapping to somewhat like 400 
Tb. On average they seem to be shifting in the vicinity of 15Tb/day 
though, looking at the number 14 of the top1000.org list.

For hardware freaks it of course gives some nice things like the dutch 
newszilla installation: http://wa.ter.net/gallery2/images/newszilla
That single setup already makes quite some small hosting companies drool 
out of both corners ;) Networking freaks will love the "Core Juniper 640 
handles newszilla traffic" comment <grin>

Otherwise said: if you are setting up a full-nntp-feed capable box, 
you'll have to dig nice and deep into that money bag but on the other 
hand there seems to be loads of people doing a lot of posting and 
reading, where else would the volume of that traffic come from?

For the people trying to find peers, check:
http://www.usenet.com/peering/peeringpage.cfm
and of course also: http://www.top1000.org/ where even google pops up in 
a 4th place.

Greets,
  Jeroen