<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:st1="urn:schemas-microsoft-com:office:smarttags" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<title>Some info on my experiences with 10GbE</title>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="place"/>
<o:SmartTagType namespaceuri="urn:schemas-microsoft-com:office:smarttags"
name="PersonName"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS Mincho";
panose-1:2 2 6 9 4 2 5 8 3 4;}
@font-face
{font-family:"Palatino Linotype";
panose-1:2 4 5 2 5 5 5 3 3 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"\@MS Mincho";
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;}
p
{mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>7500 MB/s! That’s the most
impressive numbers I’ve ever seen by FAR. I may have to take back my “10
GbE is a Lie!” blog post, and I’d be happy to do so.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Can you share things besides the T2000? For
example, <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>what OS and patch levels are you running?<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Any IP patches?<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Any IP-specific patches?<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>What ndd settings are you using?<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Is rss enabled?<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>“Input, I need Input!”<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<p class=MsoNormal><font size=3 color=navy face="Palatino Linotype"><span
style='font-size:12.0pt;font-family:"Palatino Linotype";color:navy'>---<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=3 color=navy face="Palatino Linotype"><span
style='font-size:12.0pt;font-family:"Palatino Linotype";color:navy'>W. <st1:PersonName
w:st="on">Curtis Preston</st1:PersonName></span></font><font color=navy><span
style='color:navy'><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=3 color=navy face="Palatino Linotype"><span
style='font-size:12.0pt;font-family:"Palatino Linotype";color:navy'>Backup Blog
@ <a href="http://www.backupcentral.com">www.backupcentral.com</a></span></font><font
color=navy><span style='color:navy'><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=3 color=navy face="Palatino Linotype"><span
style='font-size:12.0pt;font-family:"Palatino Linotype";color:navy'>VP Data
Protection, GlassHouse Technologies</span></font><o:p></o:p></p>
</div>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font size=2
face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'> veritas-bu-bounces@mailman.eng.auburn.edu
[mailto:veritas-bu-bounces@mailman.eng.auburn.edu] <b><span style='font-weight:
bold'>On Behalf Of </span></b>Peters, Devon C<br>
<b><span style='font-weight:bold'>Sent:</span></b> Wednesday, October 17, 2007
12:12 PM<br>
<b><span style='font-weight:bold'>To:</span></b>
VERITAS-BU@mailman.eng.auburn.edu<br>
<b><span style='font-weight:bold'>Subject:</span></b> [Veritas-bu] Some info on
my experiences with 10GbE</span></font><o:p></o:p></p>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
<p><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>Since
I've seen a little bit of talk about 10GbE on here in the past I figured I'd
share some of my experiences...</span></font> <o:p></o:p></p>
<p><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>I've
recently been testing some of Sun's dual-port 10GbE NICs on some small T2000's
(1Ghz, 4-core). I'm only using a single port on each card, and the
servers are currently directly connected to each other (waiting for my network
team to get switches and fibre in place).</span></font><o:p></o:p></p>
<p><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>So
far, I've been able to drive throughput between these two systems to about
7500Mbit/sec using iperf. When the throughput gets this high, all the
cores/threads on the receiving T2000 become saturated and TCP retransmits start
climbing, but both systems remain quite responsive. Since these are only
4-core T2000's, I would guess that the 6 or 8-core T2000's (especially with
1.2Ghz or 1.4Ghz processors) should be capable of more throughput, possibly
near line speed.</span></font><o:p></o:p></p>
<p><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>The
down side achieving this high of throughput is that it requires lots of data
streams. When transmitting with a single data stream, the most throughput
I've gotten is about 1500Mbit/sec. I only got up to 7500Mbit/s when using
64 data streams… Also, the biggest gains seem to be in the jump
from 1 to 8 data streams; with 8 streams I was able to get throughput up
to 6500Mbit/sec.</span></font><o:p></o:p></p>
<p><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>Our
goal for 10GbE, is to be able to restore data from tape at a speed of at least
2400Mbit/sec (300MB/sec). We have large daily backups (3-4TB) that we
would like to be able to restore (not backup) in a reasonable amount of
time. These restores are used to refresh our test and development environments
with current data. The actual backups are done with array based snapshots
(HDS ShadowCopy), which then get mounted and backed up by a dedicated media
server (6-core T2000). We're currently getting about 650MB/sec of
throughput with the backups (9 streams on 3 LTO3 tape drives - MPX=3 and it's
very compressible data).</span></font><o:p></o:p></p>
<p><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>Going
off my iperf results, the restoring this data using 9 streams should get us
well over 2400Mbit/sec. But - we haven't installed the cards on our media
servers yet, so I have yet to see what the actual performanee of netbackup and
LTO3 over 10GbE is. I'm hopeful it'll be close to the iperf results, but
if it doesn't meet the goal then we'll be looking at other options.</span></font><o:p></o:p></p>
<p><font size=2 face=Arial><span style='font-size:10.0pt;font-family:Arial'>--</span></font>
<br>
<st1:place w:st="on"><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Devon</span></font></st1:place><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'> Peters</span></font> <o:p></o:p></p>
</div>
</body>
</html>