<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:st1="urn:schemas-microsoft-com:office:smarttags" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]--><o:SmartTagType
namespaceuri="urn:schemas-microsoft-com:office:smarttags" name="place"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;}
tt
{font-family:"Courier New";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=purple>
<div class=Section1>
<p class=MsoNormal><st1:place w:st="on"><font size=2 color=navy face=Arial><span
style='font-size:10.0pt;font-family:Arial;color:navy'>Devon</span></font></st1:place><font
size=2 color=navy face=Arial><span style='font-size:10.0pt;font-family:Arial;
color:navy'>, <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>What is your data type your backing up?
How much data? <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Thanks,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Chris Hall <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font size=2
face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'>
veritas-bu-bounces@mailman.eng.auburn.edu
[mailto:veritas-bu-bounces@mailman.eng.auburn.edu] <b><span style='font-weight:
bold'>On Behalf Of </span></b>Peters, Devon C<br>
<b><span style='font-weight:bold'>Sent:</span></b> Thursday, October 18, 2007
3:10 PM<br>
<b><span style='font-weight:bold'>To:</span></b> Karl.Rossing@federated.ca;
VERITAS-BU@mailman.eng.auburn.edu<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [Veritas-bu] Some
info on my experiences with 10GbE</span></font><o:p></o:p></p>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=blue face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:blue'>We've been pretty happy with the T2000's.</span></font><o:p></o:p></p>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'> <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=blue face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:blue'>The tape library is an IBM 3584, the tape
drives are IBM's 4Gb FC LTO-3 drives, there's a dedicated 4Gb HBA for each
drive, and everything is connected to 4Gb McData switches.</span></font><o:p></o:p></p>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'> <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=blue face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:blue'>We used to have IBM's 2Gb FC LTO-3 drives,
and with those the peak performance was around 165MB/s per drive. These
4Gb drives peak at around 265MB/s per drive, though with all 3 tape drives
active, we see throughput closer to 220MB/s per drive...I'm guessing we're
bottlenecked by the ports on our disk subsystem at the moment, but since
performance is more than acceptable we're not looking to tune this any further
- at least not until our LTO-4 drives are installed next month ;).</span></font><o:p></o:p></p>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'> <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=blue face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:blue'>-devon</span></font><o:p></o:p></p>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'> <o:p></o:p></span></font></p>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabIndex=-1>
</span></font></div>
<p class=MsoNormal style='margin-bottom:12.0pt'><b><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</span></font></b><font
size=2 face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'>
Karl.Rossing@Federated.CA [mailto:Karl.Rossing@Federated.CA] <br>
<b><span style='font-weight:bold'>Sent:</span></b> Thursday, October 18, 2007
6:10 AM<br>
<b><span style='font-weight:bold'>To:</span></b> Peters, Devon C;
VERITAS-BU@mailman.eng.auburn.edu<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [Veritas-bu] Some
info on my experiences with 10GbE</span></font><o:p></o:p></p>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><br>
</span></font><st1:place w:st="on"><tt><font size=2 face="Courier New"><span
style='font-size:10.0pt'>Devon</span></font></tt></st1:place><tt><font size=2
face="Courier New"><span style='font-size:10.0pt'>,</span></font></tt> <br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>Good to hear
that T2000's are screamers.</span></font></tt> <br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>What are the
library/tape drive specs. Are the drives FC attached? or are they attached via
scsi to the media server?</span></font></tt> <br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>Thanks,</span></font></tt>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>Karl</span></font></tt>
<br>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> From:
veritas-bu-bounces@mailman.eng.auburn.edu [mailto:veritas-bu-</span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> bounces@mailman.eng.auburn.edu] On Behalf Of
Peters, Devon C</font></tt><br>
<tt><font face="Courier New">> Sent: Wednesday, October 17, 2007 12:12 PM</font></tt><br>
<tt><font face="Courier New">> To: VERITAS-BU@mailman.eng.auburn.edu</font></tt><br>
<tt><font face="Courier New">> Subject: [Veritas-bu] Some info on my
experiences with 10GbE</font></tt></span></font> <br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> </span></font></tt>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> Since
I've seen a little bit of talk about 10GbE on here in the past</span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> I figured I'd share some of my experiences...
</font></tt></span></font><br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> I've
recently been testing some of Sun's dual-port 10GbE NICs on </span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> some small T2000's (1Ghz, 4-core). I'm
only using a single port on </font></tt><br>
<tt><font face="Courier New">> each card, and the servers are currently
directly connected to each </font></tt><br>
<tt><font face="Courier New">> other (waiting for my network team to get
switches and fibre in place).</font></tt></span></font> <br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> So far,
I've been able to drive throughput between these two systems</span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> to about 7500Mbit/sec using iperf. When
the throughput gets this </font></tt><br>
<tt><font face="Courier New">> high, all the cores/threads on the receiving
T2000 become saturated </font></tt><br>
<tt><font face="Courier New">> and TCP retransmits start climbing, but both
systems remain quite </font></tt><br>
<tt><font face="Courier New">> responsive. Since these are only 4-core
T2000's, I would guess that</font></tt><br>
<tt><font face="Courier New">> the 6 or 8-core T2000's (especially with
1.2Ghz or 1.4Ghz </font></tt><br>
<tt><font face="Courier New">> processors) should be capable of more
throughput, possibly near line speed.</font></tt></span></font> <br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> The
down side achieving this high of throughput is that it requires </span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> lots of data streams. When transmitting
with a single data stream, </font></tt><br>
<tt><font face="Courier New">> the most throughput I've gotten is about
1500Mbit/sec. I only got </font></tt><br>
<tt><font face="Courier New">> up to 7500Mbit/s when using 64 data
streams… Also, the biggest </font></tt><br>
<tt><font face="Courier New">> gains seem to be in the jump from 1 to 8 data
streams; with 8 </font></tt><br>
<tt><font face="Courier New">> streams I was able to get throughput up to
6500Mbit/sec.</font></tt></span></font> <br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> Our
goal for 10GbE, is to be able to restore data from tape at a </span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> speed of at least 2400Mbit/sec (300MB/sec).
We have large daily </font></tt><br>
<tt><font face="Courier New">> backups (3-4TB) that we would like to be able
to restore (not </font></tt><br>
<tt><font face="Courier New">> backup) in a reasonable amount of time.
These restores are used to </font></tt><br>
<tt><font face="Courier New">> refresh our test and development environments
with current data. </font></tt><br>
<tt><font face="Courier New">> The actual backups are done with array based
snapshots (HDS </font></tt><br>
<tt><font face="Courier New">> ShadowCopy), which then get mounted and
backed up by a dedicated </font></tt><br>
<tt><font face="Courier New">> media server (6-core T2000). We're
currently getting about </font></tt><br>
<tt><font face="Courier New">> 650MB/sec of throughput with the backups (9
streams on 3 LTO3 tape </font></tt><br>
<tt><font face="Courier New">> drives - MPX=3 and it's very compressible
data).</font></tt></span></font> <br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> Going
off my iperf results, the restoring this data using 9 streams </span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> should get us well over 2400Mbit/sec.
But - we haven't installed </font></tt><br>
<tt><font face="Courier New">> the cards on our media servers yet, so I have
yet to see what the </font></tt><br>
<tt><font face="Courier New">> actual performanee of netbackup and LTO3 over
10GbE is. I'm hopeful</font></tt><br>
<tt><font face="Courier New">> it'll be close to the iperf results, but if
it doesn't meet the goal</font></tt><br>
<tt><font face="Courier New">> then we'll be looking at other options.</font></tt></span></font>
<br>
<tt><font size=2 face="Courier New"><span style='font-size:10.0pt'>> -- </span></font></tt><font
size=2 face="Courier New"><span style='font-size:10.0pt;font-family:"Courier New"'><br>
<tt><font face="Courier New">> <st1:place w:st="on">Devon</st1:place> Peters
_______________________________________________</font></tt><br>
<tt><font face="Courier New">> Veritas-bu maillist -
Veritas-bu@mailman.eng.auburn.edu</font></tt><br>
<tt><font face="Courier New">> http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu</font></tt></span></font><o:p></o:p></p>
</div>
</body>
</html>