<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns="http://www.w3.org/TR/REC-html40" xmlns:v =
"urn:schemas-microsoft-com:vml" xmlns:o =
"urn:schemas-microsoft-com:office:office" xmlns:w =
"urn:schemas-microsoft-com:office:word" xmlns:st1 =
"urn:schemas-microsoft-com:office:smarttags"><HEAD>
<META http-equiv=Content-Type content="text/html; charset=us-ascii">
<META content="MSHTML 6.00.3790.4064" name=GENERATOR><!--[if !mso]>
<STYLE>v\:* {
BEHAVIOR: url(#default#VML)
}
o\:* {
BEHAVIOR: url(#default#VML)
}
w\:* {
BEHAVIOR: url(#default#VML)
}
.shape {
BEHAVIOR: url(#default#VML)
}
</STYLE>
<![endif]--><o:SmartTagType name="place"
namespaceuri="urn:schemas-microsoft-com:office:smarttags"></o:SmartTagType><!--[if !mso]>
<STYLE>st1\:* {
BEHAVIOR: url(#default#ieooui)
}
</STYLE>
<![endif]-->
<STYLE>@font-face {
font-family: Tahoma;
}
@page Section1 {size: 8.5in 11.0in; margin: 1.0in 1.25in 1.0in 1.25in; }
P.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
COLOR: purple; TEXT-DECORATION: underline
}
TT {
FONT-FAMILY: "Courier New"
}
SPAN.EmailStyle18 {
COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal-reply
}
DIV.Section1 {
page: Section1
}
</STYLE>
</HEAD>
<BODY lang=EN-US vLink=purple link=blue>
<DIV dir=ltr align=left><SPAN class=753180420-18102007><FONT face=Arial
color=#0000ff size=2>The data is oracle database files and archive logs, and
they compress real well. The largest single database is about
4TB.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=753180420-18102007><FONT face=Arial
color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=753180420-18102007><FONT face=Arial
color=#0000ff size=2>-devon</FONT></SPAN></DIV><BR>
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Hall, Christian N. [mailto:HallC@SEC.GOV]
<BR><B>Sent:</B> Thursday, October 18, 2007 12:22 PM<BR><B>To:</B> Peters, Devon
C; Karl.Rossing@federated.ca;
VERITAS-BU@mailman.eng.auburn.edu<BR><B>Subject:</B> RE: [Veritas-bu] Some info
on my experiences with 10GbE<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV class=Section1>
<P class=MsoNormal><st1:place w:st="on"><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Devon</SPAN></FONT></st1:place><FONT
face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">,
<o:p></o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"><o:p> </o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">What is your data type
your backing up? How much data? <o:p></o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"><o:p> </o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Thanks,<o:p></o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Chris Hall
<o:p></o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"><o:p> </o:p></SPAN></FONT></P>
<DIV>
<DIV class=MsoNormal style="TEXT-ALIGN: center" align=center><FONT
face="Times New Roman" size=3><SPAN style="FONT-SIZE: 12pt">
<HR tabIndex=-1 align=center width="100%" SIZE=2>
</SPAN></FONT></DIV>
<P class=MsoNormal><B><FONT face=Tahoma size=2><SPAN
style="FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">From:</SPAN></FONT></B><FONT
face=Tahoma size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">
veritas-bu-bounces@mailman.eng.auburn.edu
[mailto:veritas-bu-bounces@mailman.eng.auburn.edu] <B><SPAN
style="FONT-WEIGHT: bold">On Behalf Of </SPAN></B>Peters, Devon C<BR><B><SPAN
style="FONT-WEIGHT: bold">Sent:</SPAN></B> Thursday, October 18, 2007 3:10
PM<BR><B><SPAN style="FONT-WEIGHT: bold">To:</SPAN></B>
Karl.Rossing@federated.ca; VERITAS-BU@mailman.eng.auburn.edu<BR><B><SPAN
style="FONT-WEIGHT: bold">Subject:</SPAN></B> Re: [Veritas-bu] Some info on my
experiences with 10GbE</SPAN></FONT><o:p></o:p></P></DIV>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><o:p> </o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">We've been pretty happy
with the T2000's.</SPAN></FONT><o:p></o:p></P>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"> <o:p></o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">The tape library is an
IBM 3584, the tape drives are IBM's 4Gb FC LTO-3 drives, there's a dedicated 4Gb
HBA for each drive, and everything is connected to 4Gb McData
switches.</SPAN></FONT><o:p></o:p></P>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"> <o:p></o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">We used to have IBM's
2Gb FC LTO-3 drives, and with those the peak performance was around 165MB/s per
drive. These 4Gb drives peak at around 265MB/s per drive, though with all
3 tape drives active, we see throughput closer to 220MB/s per drive...I'm
guessing we're bottlenecked by the ports on our disk subsystem at the
moment, but since performance is more than acceptable we're not looking to tune
this any further - at least not until our LTO-4 drives are installed next month
;).</SPAN></FONT><o:p></o:p></P>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"> <o:p></o:p></SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=blue size=2><SPAN
style="FONT-SIZE: 10pt; COLOR: blue; FONT-FAMILY: Arial">-devon</SPAN></FONT><o:p></o:p></P>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"> <o:p></o:p></SPAN></FONT></P>
<DIV class=MsoNormal style="TEXT-ALIGN: center" align=center><FONT
face="Times New Roman" size=3><SPAN style="FONT-SIZE: 12pt">
<HR tabIndex=-1 align=center width="100%" SIZE=2>
</SPAN></FONT></DIV>
<P class=MsoNormal style="MARGIN-BOTTOM: 12pt"><B><FONT face=Tahoma size=2><SPAN
style="FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">From:</SPAN></FONT></B><FONT
face=Tahoma size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">
Karl.Rossing@Federated.CA [mailto:Karl.Rossing@Federated.CA] <BR><B><SPAN
style="FONT-WEIGHT: bold">Sent:</SPAN></B> Thursday, October 18, 2007 6:10
AM<BR><B><SPAN style="FONT-WEIGHT: bold">To:</SPAN></B> Peters, Devon C;
VERITAS-BU@mailman.eng.auburn.edu<BR><B><SPAN
style="FONT-WEIGHT: bold">Subject:</SPAN></B> Re: [Veritas-bu] Some info on my
experiences with 10GbE</SPAN></FONT><o:p></o:p></P>
<P class=MsoNormal><FONT face="Times New Roman" size=3><SPAN
style="FONT-SIZE: 12pt"><BR></SPAN></FONT><st1:place w:st="on"><TT><FONT
face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt">Devon</SPAN></FONT></TT></st1:place><TT><FONT
face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">,</SPAN></FONT></TT>
<BR><BR><TT><FONT face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">Good
to hear that T2000's are screamers.</SPAN></FONT></TT> <BR><BR><TT><FONT
face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">What are the
library/tape drive specs. Are the drives FC attached? or are they attached via
scsi to the media server?</SPAN></FONT></TT> <BR><BR><TT><FONT
face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt">Thanks,</SPAN></FONT></TT> <BR><TT><FONT
face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">Karl</SPAN></FONT></TT>
<BR><BR><TT><FONT face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">>
From: veritas-bu-bounces@mailman.eng.auburn.edu
[mailto:veritas-bu-</SPAN></FONT></TT><FONT face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> bounces@mailman.eng.auburn.edu] On Behalf Of Peters,
Devon C</FONT></TT><BR><TT><FONT face="Courier New">> Sent: Wednesday,
October 17, 2007 12:12 PM</FONT></TT><BR><TT><FONT face="Courier New">> To:
VERITAS-BU@mailman.eng.auburn.edu</FONT></TT><BR><TT><FONT
face="Courier New">> Subject: [Veritas-bu] Some info on my experiences with
10GbE</FONT></TT></SPAN></FONT> <BR><TT><FONT face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt">> </SPAN></FONT></TT> <BR><TT><FONT
face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">> Since I've seen a
little bit of talk about 10GbE on here in the past</SPAN></FONT></TT><FONT
face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> I figured I'd share some of my experiences...
</FONT></TT></SPAN></FONT><BR><TT><FONT face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt">> I've recently been testing some of Sun's dual-port
10GbE NICs on </SPAN></FONT></TT><FONT face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> some small T2000's (1Ghz, 4-core). I'm only using
a single port on </FONT></TT><BR><TT><FONT face="Courier New">> each card,
and the servers are currently directly connected to each
</FONT></TT><BR><TT><FONT face="Courier New">> other (waiting for my network
team to get switches and fibre in place).</FONT></TT></SPAN></FONT>
<BR><TT><FONT face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">> So
far, I've been able to drive throughput between these two
systems</SPAN></FONT></TT><FONT face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> to about 7500Mbit/sec using iperf. When the
throughput gets this </FONT></TT><BR><TT><FONT face="Courier New">> high, all
the cores/threads on the receiving T2000 become saturated
</FONT></TT><BR><TT><FONT face="Courier New">> and TCP retransmits start
climbing, but both systems remain quite </FONT></TT><BR><TT><FONT
face="Courier New">> responsive. Since these are only 4-core T2000's, I
would guess that</FONT></TT><BR><TT><FONT face="Courier New">> the 6 or
8-core T2000's (especially with 1.2Ghz or 1.4Ghz </FONT></TT><BR><TT><FONT
face="Courier New">> processors) should be capable of more throughput,
possibly near line speed.</FONT></TT></SPAN></FONT> <BR><TT><FONT
face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">> The down side
achieving this high of throughput is that it requires </SPAN></FONT></TT><FONT
face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> lots of data streams. When transmitting with a
single data stream, </FONT></TT><BR><TT><FONT face="Courier New">> the most
throughput I've gotten is about 1500Mbit/sec. I only got
</FONT></TT><BR><TT><FONT face="Courier New">> up to 7500Mbit/s when using 64
data streams… Also, the biggest </FONT></TT><BR><TT><FONT
face="Courier New">> gains seem to be in the jump from 1 to 8 data streams;
with 8 </FONT></TT><BR><TT><FONT face="Courier New">> streams I was
able to get throughput up to 6500Mbit/sec.</FONT></TT></SPAN></FONT>
<BR><TT><FONT face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">> Our
goal for 10GbE, is to be able to restore data from tape at a
</SPAN></FONT></TT><FONT face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> speed of at least 2400Mbit/sec (300MB/sec). We
have large daily </FONT></TT><BR><TT><FONT face="Courier New">> backups
(3-4TB) that we would like to be able to restore (not </FONT></TT><BR><TT><FONT
face="Courier New">> backup) in a reasonable amount of time. These
restores are used to </FONT></TT><BR><TT><FONT face="Courier New">> refresh
our test and development environments with current data.
</FONT></TT><BR><TT><FONT face="Courier New">> The actual backups are
done with array based snapshots (HDS </FONT></TT><BR><TT><FONT
face="Courier New">> ShadowCopy), which then get mounted and backed up by a
dedicated </FONT></TT><BR><TT><FONT face="Courier New">> media server (6-core
T2000). We're currently getting about </FONT></TT><BR><TT><FONT
face="Courier New">> 650MB/sec of throughput with the backups (9 streams on 3
LTO3 tape </FONT></TT><BR><TT><FONT face="Courier New">> drives - MPX=3 and
it's very compressible data).</FONT></TT></SPAN></FONT> <BR><TT><FONT
face="Courier New" size=2><SPAN style="FONT-SIZE: 10pt">> Going off my iperf
results, the restoring this data using 9 streams </SPAN></FONT></TT><FONT
face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> should get us well over 2400Mbit/sec. But - we
haven't installed </FONT></TT><BR><TT><FONT face="Courier New">> the cards on
our media servers yet, so I have yet to see what the </FONT></TT><BR><TT><FONT
face="Courier New">> actual performanee of netbackup and LTO3 over 10GbE is.
I'm hopeful</FONT></TT><BR><TT><FONT face="Courier New">> it'll be
close to the iperf results, but if it doesn't meet the
goal</FONT></TT><BR><TT><FONT face="Courier New">> then we'll be looking at
other options.</FONT></TT></SPAN></FONT> <BR><TT><FONT face="Courier New"
size=2><SPAN style="FONT-SIZE: 10pt">> -- </SPAN></FONT></TT><FONT
face="Courier New" size=2><SPAN
style="FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'"><BR><TT><FONT
face="Courier New">> <st1:place w:st="on">Devon</st1:place> Peters
_______________________________________________</FONT></TT><BR><TT><FONT
face="Courier New">> Veritas-bu maillist -
Veritas-bu@mailman.eng.auburn.edu</FONT></TT><BR><TT><FONT
face="Courier New">>
http://mailman.eng.auburn.edu/mailman/listinfo/veritas-bu</FONT></TT></SPAN></FONT><o:p></o:p></P></DIV></BODY></HTML>