Pengaruh Disk I/O Speed

paijo2 · 18 Feb 2015

coba cek i/o ping, iops (https://www.cammckenzie.com/blog/index.php/2014/02/25/how-to-measure-iops-with-linux/) .

cache controller disk juga ngaruh,

ga pake cache:

Code:

root@sd-71939:~# ioping / -c 10
4096 bytes from / (ext4 /dev/mapper/system-root): request=1 time=15.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=2 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=3 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=4 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=5 time=14.3 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=6 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=7 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=8 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=9 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=10 time=0.1 ms

pake cache

Code:

root@sd-46406:~# ioping / -c 10
4096 bytes from / (ext4 /dev/mapper/system-root): request=1 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=2 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=3 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=4 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=5 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=6 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=7 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=8 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=9 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=10 time=0.1 ms

ini tower server atau rack server ya ? model nya apa ?

Zhad · 24 Feb 2015

paijo2 said:

coba cek i/o ping, iops (https://www.cammckenzie.com/blog/index.php/2014/02/25/how-to-measure-iops-with-linux/) .

cache controller disk juga ngaruh,

ga pake cache:

Code:

root@sd-71939:~# ioping / -c 10
4096 bytes from / (ext4 /dev/mapper/system-root): request=1 time=15.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=2 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=3 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=4 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=5 time=14.3 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=6 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=7 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=8 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=9 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=10 time=0.1 ms

pake cache

Code:

root@sd-46406:~# ioping / -c 10
4096 bytes from / (ext4 /dev/mapper/system-root): request=1 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=2 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=3 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=4 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=5 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=6 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=7 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=8 time=0.1 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=9 time=0.2 ms
4096 bytes from / (ext4 /dev/mapper/system-root): request=10 time=0.1 ms

ini tower server atau rack server ya ? model nya apa ?

Thanks buat commandnya.
Kayaknya harus DL dulu ya toolnya.

soal tower atau rack? tahunya seperti apa?

https://www.wiredtree.com/products/managed-dedicated-servers/

@winnervps

kemarin tanya soal ini.
doi nanya kenapa lambat kah websitenya? dia nyaranin memcache.

======

kalau mau dibuat hosting yang powerful.

konfigurasi I/O yang pasnya seperti apa ya?

paijo2 · 25 Feb 2015

cob

Zhad said:
Thanks buat commandnya.
Kayaknya harus DL dulu ya toolnya.

soal tower atau rack? tahunya seperti apa?

https://www.wiredtree.com/products/managed-dedicated-servers/

@winnervps

kemarin tanya soal ini.
doi nanya kenapa lambat kah websitenya? dia nyaranin memcache.

======

kalau mau dibuat hosting yang powerful.

konfigurasi I/O yang pasnya seperti apa ya?

yang saya tahu, yang paling ngaruh nanti method cache disknya mau seperti apa.. apa itu write back, write through..
coba kita investigasi bareng2,.. ini mesin kira2 punya cache disk controller ga ?
klo ga ya mungkin bisa aja seperti yang dibicarakan @winnervps ,cmn sgitu2 aja speednya...

btw ini mau dibuat hosting langsung ke mesin fisik atau di vm ?
tapi kaga ngaruh jg sih, biasanya test speednya hasilnya kurang lebih sama di vm ataupun langsung fisik..

ref:
https://communities.vmware.com/thread/496301
http://www.supermicro.com/products/motherboard/Xeon/C220/X10SLM-F.cfm

Zhad · 26 Feb 2015

yang saya tahu, yang paling ngaruh nanti method cache disknya mau seperti apa.. apa itu write back, write through..
coba kita investigasi bareng2,.. ini mesin kira2 punya cache disk controller ga ?

Tahunya gimana? Ada command khusus kah-?

Ya hostingnya langsung ke mesin, ga displit ke vps begitu

BennyKusman · 26 Feb 2015

Zhad said:
yang saya tahu, yang paling ngaruh nanti method cache disknya mau seperti apa.. apa itu write back, write through..
coba kita investigasi bareng2,.. ini mesin kira2 punya cache disk controller ga ?

Tahunya gimana? Ada command khusus kah-?

Ya hostingnya langsung ke mesin, ga displit ke vps begitu

dmesg | grep -i cache

Zhad · 26 Feb 2015

Makasih mas BK.

root@server [1845 23:09:37 ~]# dmesg | grep -i cache
root@server [1846 23:09:53 ~]# dmesg | grep -i cache
root@server [1846 23:09:56 ~]# dmesg | grep -i cache

Blank aja, no response.

BennyKusman · 26 Feb 2015

Zhad said:
Makasih mas BK.

root@server [1845 23:09:37 ~]# dmesg | grep -i cache
root@server [1846 23:09:53 ~]# dmesg | grep -i cache
root@server [1846 23:09:56 ~]# dmesg | grep -i cache

Blank aja, no response.

coba ditanyakan aja ke tempat beli.. mungkin bisa reboot dan masuk ke raid controller properties nya.

paijo2 · 26 Feb 2015

BennyKusman said:
coba ditanyakan aja ke tempat beli.. mungkin bisa reboot dan masuk ke raid controller properties nya.

@ops
ada fitur ILO / IPMI nya ga ? semua nya nanti ketahuan di situ.. termasuk raid..

paijo2 · 27 Feb 2015

sebagai sample/contoh saja raid hw dari mesin HP dengan disk cache enabled.

Code:

root@sd-46406:~# lspci -v | grep RAID -A 1
04:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers (rev 01)
    Subsystem: Hewlett-Packard Company Smart Array P410
root@sd-46406:~# hpacucli ctrl all show config detail | grep -i drive
   Drive Write Cache: Enabled
      Logical Drive: 1
         Logical Drive Label: A545833DPACCRID122805YT0557
            physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SATA, 2 TB, OK)
            physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SATA, 2 TB, OK)
         Drive Type: Data
      physicaldrive 1I:1:1
         Drive Type: Data Drive
      physicaldrive 1I:1:2
         Drive Type: Data Drive
root@sd-46406:~#

test :

Code:

root@sd-46406:~# dd bs=1M count=256 if=/dev/zero of=test conv=fdatasync
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 1.41236 s, 190 MB/s
root@sd-46406:~# dd if=/dev/zero of=test bs=16k count=64k conv=fdatasync
65536+0 records in
65536+0 records out
1073741824 bytes (1.1 GB) copied, 9.17862 s, 117 MB/s
root@sd-46406:~# dd bs=1M count=256 if=/dev/zero of=test conv=fdatasync
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 1.65806 s, 162 MB/s
root@sd-46406:~# dd bs=1M count=256 if=/dev/zero of=test conv=fdatasync
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 1.53772 s, 175 MB/s
root@sd-46406:~# dd bs=1M count=256 if=/dev/zero of=test conv=fdatasync
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 1.59625 s, 168 MB/s
root@sd-46406:~# bash ioping.sh

Sequential disk speed test (dd)
===============================
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB) copied, 9.4207 s, 114 MB/s

Disk latency tests (ioping)
===========================
Test                                req       ms   iops   mb/s    min    avg    max   mdev
Disk I/O rate (1024KB)                5   4006.2    938  937.9    1.1    1.1    1.1    0.0
Disk I/O rate (4KB)                   5   4000.9   9488   37.1    0.1    0.1    0.1    0.0
Disk I/O rate (32KB)                  5   4001.2   6588  205.9    0.1    0.2    0.2    0.0
Disk I/O rate (64KB)                  5   4001.4   5382  336.4    0.1    0.2    0.2    0.0
Disk I/O rate (256KB)                 5   4002.7   2474  618.5    0.4    0.4    0.4    0.0
Seek rate (1024KB)                 2592   3000.0    996  995.6    0.9    1.0    1.2    0.0
Seek rate (4KB)                   28620   3000.0  21033   82.2    0.0    0.0    0.7    0.0
Seek rate (32KB)                  20015   3000.0  11363  355.1    0.1    0.1    0.4    0.0
Seek rate (64KB)                  15863   3000.1   8089  505.6    0.1    0.1    1.3    0.0
Seek rate (256KB)                  7000   3000.1   2926  731.5    0.3    0.3    0.8    0.0
Sequential seek rate               7028   3000.3   2937  734.2    0.3    0.3    0.8    0.0
Sequential cached seek rate       27073   3000.1  17908 4477.0    0.0    0.1    0.2    0.0

root@sd-46406:~#

ioping.sh

Code:

#!/usr/bin/env bash

DEV=${1-/}
REQUESTSIZE="1024 4 32 64 256"
COUNT=5

if [[ ! $(which ioping) ]]; then
    apt-get install ioping
fi

function drop_cache {
    echo 3 > /proc/sys/vm/drop_caches
    sleep 4
}

function stats {
    local str=$(echo "$2" | grep -E '(iops|mdev)')
    if [[ $str =~ ([0-9]+)\ requests\ completed\ in\ ([0-9\.]+)\ ms,\ ([0-9]+)\ iops,\ ([0-9\.]+)\ mb\/s.*min\/avg\/max\/mdev\ =\ ([0-9\.]+)\/([0-9\.]+)\/([0-9\.]+)\/([0-9\.]+)\ ms ]]; then
        printf '%-32s %6d %8s %6d %6s %6s %6s %6s %6s \n' "$1" ${BASH_REMATCH[1]} ${BASH_REMATCH[2]} ${BASH_REMATCH[3]} ${BASH_REMATCH[4]} ${BASH_REMATCH[5]} ${BASH_REMATCH[6]} ${BASH_REMATCH[7]} ${BASH_REMATCH[8]}
    fi
}

echo ""
echo "Sequential disk speed test (dd)"
echo "==============================="
cd /tmp
drop_cache
dd if=/dev/zero of=testfilex bs=64k count=16k conv=fdatasync
rm -rf testfilex

echo ""
echo "Disk latency tests (ioping)"
echo "==========================="
printf "%-32s %6s %8s %6s %6s %6s %6s %6s %6s \n" Test req ms iops mb/s min avg max mdev

for WSIZE in $REQUESTSIZE; do
    drop_cache
    stats "Disk I/O rate (${WSIZE}KB)" "$(ioping -c ${COUNT} -s ${WSIZE}K ${DEV})"
done

for WSIZE in $REQUESTSIZE; do
    drop_cache
    stats "Seek rate (${WSIZE}KB)" "$(ioping -R -s ${WSIZE}K ${DEV})"
done

drop_cache
stats "Sequential seek rate" "$(ioping -RL ${DEV})"

stats "Sequential cached seek rate" "$(ioping -RLC ${DEV})"

echo ""

Pengaruh Disk I/O Speed

paijo2

Apprentice 1.0

Zhad

Poster 1.0

paijo2

Apprentice 1.0

Zhad

Poster 1.0

BennyKusman

Hosting Guru

Zhad

Poster 1.0

BennyKusman

Hosting Guru

paijo2

Apprentice 1.0

paijo2

Apprentice 1.0