c********r
发帖数: 649 | 1 13 WD3000BLFS 300GB Hard Drive $152 $1,976
1 SC216A-R900LPB 24 Bay Chassis $785 $785
1 SUPERMICRO X8DTL-iF Motherboard $305 $305
1 Intel Xeon E5620 CPU $395 $395
1 Patriot Signature 12GB (3 x 4GB) $429 $429
2 SAS3081E-R SAS HBA $190 $380
1 Supermicro SNK-P0038P Heatsink $20 $20
0 Intel x25-e SSD $349 $0
2 2.5 HARD DRIVE $50 $100
$4,390
4 x 3 RaidZ
1 x Raid Mirror
1 x Hot Spare
2.4TB Storage
performance: ( benchmark from one of the VMs )
sequential read ---- 106 mbytes/sec
sequential write---- 106.2 mbytes/sec
random seek +RW --- 154.6 mbytes/sec
OS: Opensolaris, configured to run from RAM and boot from a USB flash drive
(mirrored).
use it as a iscsi target for few Xenservers, got few dozen VMs access it.
zpool status:
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
XXXX ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
c0t0d0p0 ONLINE 0 0 0
c1t0d0p0 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
c0t1d0p0 ONLINE 0 0 0
c1t1d0p0 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
c0t4d0p0 ONLINE 0 0 0
c2t2d0p0 ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
c0t5d0p0 ONLINE 0 0 0
c2t3d0p0 ONLINE 0 0 0
mirror-4 ONLINE 0 0 0
c1t6d0p0 ONLINE 0 0 0
c2t4d0p0 ONLINE 0 0 0
mirror-5 ONLINE 0 0 0
c1t7d0p0 ONLINE 0 0 0
c2t5d0p0 ONLINE 0 0 0
spares
c2t6d0p0 AVAIL
BOOM~~~ |
c********r
发帖数: 649 | 2 still need to add two SSDs as separate cache and log devices to make it
totally awesome |
g**t
发帖数: 1872 | 3 你的zpool status只有mirror，没有raidz吧。你的OpenSolaris是b134还是更新的？ |
c********r
发帖数: 649 | 4 mirror has much better performance than raidz but consumes more disk space
my Opensolaris is snv_129 |
g**t
发帖数: 1872 | 5 为什么还用b129?该用OI b147。
Turn on了compression吗？为什么RAIDZ会慢很多？才多了一个checksum的。 |
c********r
发帖数: 649 | 6 mirrored pool performs better with small random reads, well, snv_129 works
pretty well.
compression is on, not only increasing effective capacity but improving
performance |
S***Z
发帖数: 1029 | 7 How to configure to run from RAM and boot from a USB flash drive? |
g**t
发帖数: 1872 | 8 但b129是没有upgrade path或security patch的，长远来说还是从OI开始好一点吧。有
比较过raidz或raidz2跟mirrored pool的performance吗？买这么多HDD，解决heat和
dust的问题也很头痛，还有就是electric bill是多少，不知SDD raidz{,2,3}与HDD
mirrored pool那个性价比更好。
boot from RAM是用EON的script自已build的OS吧？ |
w******s
发帖数: 16209 | 9 very nice!
I plan to try build intel ssd based iscsi SAN in the next two months to
achieve some really high I/O
drive
【在 c********r 的大作中提到】
: 13 WD3000BLFS 300GB Hard Drive $152 $1,976
: 1 SC216A-R900LPB 24 Bay Chassis $785 $785
: 1 SUPERMICRO X8DTL-iF Motherboard $305 $305
: 1 Intel Xeon E5620 CPU $395 $395
: 1 Patriot Signature 12GB (3 x 4GB) $429 $429
: 2 SAS3081E-R SAS HBA $190 $380
: 1 Supermicro SNK-P0038P Heatsink $20 $20
: 0 Intel x25-e SSD $349 $0
: 2 2.5 HARD DRIVE $50 $100
:
|
c********r
发帖数: 649 | 10 yup, use EON's script to build the OS.
below is something abt pool configuration and performance.
Should I Configure a RAIDZ, RAIDZ-2, RAIDZ-3, or a Mirrored Storage Pool?
A general consideration is whether your goal is to maximum disk space or
maximum performance.
* A RAIDZ configuration maximizes disk space and generally performs well
when data is written and read in large chunks (128K or more).
* A RAIDZ-2 configuration offers better data availability, and performs
similarly to RAIDZ. RAIDZ-2 has significantly better mean time to data loss
(MTTDL) than either RAIDZ or 2-way mirrors.
* A RAIDZ-3 configuration maximizes disk space and offers excellent
availability because it can withstand 3 disk failures.
* A mirrored configuration consumes more disk space but generally
performs better with small random reads.
* If your I/Os are large, sequential, or write-mostly, then ZFS's I/O
scheduler aggregates them in such a way that you'll get very efficient use
of the disks regardless of the data replication model.
For better performance, a mirrored configuration is strongly favored over a
RAIDZ configuration particularly for large, uncacheable, random read loads
http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide#Should_I_Configure_a_RAIDZ.2C_RAIDZ-2.2C_RAIDZ-3.2C_or_a_Mirrored_Storage_Pool.3F |
|
|
c********r
发帖数: 649 | 11 crossing fingers that wont be issues with heat and dust,besides, "SC216A-
R900LPB 24 Bay Chassis" looks as good as a dell equallogic chassis to me.
since this SAN is hosted in a colo data center, no need to worry abt
electric bill. |
r*****d
发帖数: 922 | 12 牛人.
顺便问一下linux现在对iSCSI target的support怎么样呀?
【在 c********r 的大作中提到】
: 13 WD3000BLFS 300GB Hard Drive $152 $1,976
: 1 SC216A-R900LPB 24 Bay Chassis $785 $785
: 1 SUPERMICRO X8DTL-iF Motherboard $305 $305
: 1 Intel Xeon E5620 CPU $395 $395
: 1 Patriot Signature 12GB (3 x 4GB) $429 $429
: 2 SAS3081E-R SAS HBA $190 $380
: 1 Supermicro SNK-P0038P Heatsink $20 $20
: 0 Intel x25-e SSD $349 $0
: 2 2.5 HARD DRIVE $50 $100
:
|
c********r
发帖数: 649 | 13 Xenserver (CentOS based?) ISCSI initiator works great with MPIO enabled, but
has issue with jumbo frame ( not supported for xenserver5.6, supported in
the new xenserver beta, but havent tried it yet) |
g**t
发帖数: 1872 | |
c********r
发帖数: 649 | 15 nope， i know it is awesome, especially for my set up that I use the SAN
mainly for VMs, dedup suppose to save lots disk space and improve
performance.
but i have few concerns,
1. memory requirement.
2. if it runs well with compression.
3. the feature is too new, concern abt bugs etc.
【在 g**t 的大作中提到】
: 有没有turn on dedup?
|
c********r
发帖数: 649 | |
