Configuration:

Node 1-12 on sb9 is an lv-67g. It has an edge boost pro as the boot disk and two samsung 840 PRO ssds in motherboard based hardware raid

Rebuilding with Asus Node

modprobe mlnx-en to bring up 10g card will test raid with 1,2,and 3 disks.

todo, implement changes from: ​http://dak1n1.com/blog/7-performance-tuning-intel-10gbe

setting up fakeraid ​https://help.ubuntu.com/community/FakeRaidHowto

setting up software raid ​https://raid.wiki.kernel.org/index.php/RAID_setup

Commands used:

Raid Creation

mdadm —create —verbose /dev/md0 —chunk=8 —level=stripe —raid-devices=2 /dev/sda /dev/sdb

mdadm —misc —stop /dev/md0

Write:

time sh -c "dd if=/dev/zero of=/mnt/bigfile bs=8k count=2000000 && sync"

2000000+0 records in 2000000+0 records out 16384000000 bytes (16 GB) copied, 15.7342 s, 1.0 GB/s

real 0m16.021s user 0m0.644s sys 0m11.293s

Read:

time sh -c "dd if=/mnt/bigfile of=/dev/null bs=8k"

2000000+0 records in 2000000+0 records out 16384000000 bytes (16 GB) copied, 20.4297 s, 802 MB/s

real 0m20.434s user 0m0.728s sys 0m9.849s

Test results for SSD raid

Single disk Write: 529 MB/s

Single disk Read: 539 MB/s

Fakeraid Write: 1.0 GB/s

Fakeraid Read: 802 MB/s

	FakeRaid		Software Raid
Block Size	Write	Read	Write	Read
4k
8k	1.0 GB/s	802 MB/s	1.1 GB/s	965 MB/s
16k
32k
64k
128k			1.1 GB/s	1.1 GB/s