Testing Azure Blob Storage

This is an example of testing the performance of attached Azure Blob Storage.

Command

cloud_stor_perf_testcli -t Azure -a <storage_account_name> -s <secret_key> -b <bucket_name> -m 64 -c 4

cloud_stor_perf_testcli -t Azure -a jsscusblobstorhot -s GhhVvPOPtghFdAEc5djwFRARZZAacR+CudWFxxxxxxxxxxxxxxxxxxxxxxxxxxx -b test-bucket -m 64 -c 4

Output

[root@bw-tester ~]# cloud_stor_perf_testcli -t Azure -a jsazweuhotblobstor -s GhhVvPOPtghFdAEc5djwFRARZZAacR+CudWFxxxxxxxxxxxxxxxxxxxxxxxxxxx -b test-bucket -m 64 -c 4

JSS:PLATFORM:fio_pool_thread_func_(97): worker 0 in pool 0xc6ae10 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 1 in pool 0xc6ae10 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 2 in pool 0xc6ae10 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 3 in pool 0xc6ae10 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 4 in pool 0xc6ae10 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 0 in pool 0xc6f3f0 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 1 in pool 0xc6f3f0 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 2 in pool 0xc6f3f0 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 3 in pool 0xc6f3f0 started

JSS:PLATFORM:fio_pool_thread_func_(97): worker 4 in pool 0xc6f3f0 started

JSS:MAIN:main(258): ver. 3.2.0.0x903e3c0d built on May 21 2021 at 15:48:21 from ga_v32@903e3c0df4fe09b7e7cf91730e28922f78a9b2ff as release build

JSS:MAIN:application_logic(184): Open channel with bktname test-bucket, keys jsazweuhotblobstor GhhVvPOPtghFdAEc5djwFRARZZAacR+CudWFxxxxxxxxxxxxxxxxxxxxxxxxxxx, passed

JSS:MAIN:application_logic(192): Starting cloudAdapter performance test with 64 buffers and 4 threads.

JSS:MAIN:FioStartCstorPerfThreadsAndWait(64): Iteration 0, Starting 1000 object uploads...

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 100, UploadSpeed = 213 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 166, max 1284, avg 419

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 200, UploadSpeed = 241 MBps, MaxBufsUsed = 64, NumBufsInUse = 64

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 166, max 2091, avg 557

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 300, UploadSpeed = 263 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 166, max 3446, avg 645

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 400, UploadSpeed = 270 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 166, max 3446, avg 693

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 500, UploadSpeed = 280 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 166, max 4776, avg 733

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 600, UploadSpeed = 283 MBps, MaxBufsUsed = 64, NumBufsInUse = 62

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 166, max 4776, avg 727

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 700, UploadSpeed = 288 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 144, max 4776, avg 744

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 800, UploadSpeed = 290 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 144, max 4776, avg 750

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 900, UploadSpeed = 292 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 144, max 4776, avg 750

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 1000, UploadSpeed = 300 MBps, MaxBufsUsed = 64, NumBufsInUse = 0

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 144, max 4776, avg 779

JSS:MAIN:FioStartCstorPerfThreadsAndWait(72): Iteration 0, Starting 1000 object downloads...

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 100, DownloadSpeed = 258 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 248, max 1535, avg 568

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 200, DownloadSpeed = 285 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 239, max 1736, avg 580

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 300, DownloadSpeed = 303 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 175, max 1841, avg 584

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 400, DownloadSpeed = 310 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 135, max 4263, avg 605

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 500, DownloadSpeed = 309 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 135, max 4263, avg 598

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 600, DownloadSpeed = 311 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 135, max 4263, avg 602

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 700, DownloadSpeed = 315 MBps, MaxBufsUsed = 64, NumBufsInUse = 62

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 135, max 8788, avg 660

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 800, DownloadSpeed = 316 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 135, max 10079, avg 689

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 900, DownloadSpeed = 317 MBps, MaxBufsUsed = 64, NumBufsInUse = 63

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 135, max 10079, avg 693

JSS:OC:FioPrintDownloadPerfStats(97): TotalObjsDownloaded = 1000, DownloadSpeed = 323 MBps, MaxBufsUsed = 64, NumBufsInUse = 0

JSS:OC:FioPrintDownloadPerfStats(102): Obj download latency (msec) stats: min 135, max 12366, avg 772

^CJSS:PLATFORM:main_signal_handler(42): Shutdown requested

JSS:MAIN:FioStartCstorPerfThreadsAndWait(72): Iteration 1, Starting 1000 object downloads...

JSS:MAIN:application_shutdown(107): Waiting for inflight uploads/downloads to finish...

JSS:OC:FioPrintUploadPerfStats(82): TotalObjsUploaded = 100, UploadSpeed = 252 MBps, MaxBufsUsed = 0, NumBufsInUse = 26

JSS:OC:FioPrintUploadPerfStats(87): Obj upload latency (msec) stats: min 117, max 1530, avg 597

JSS:MAIN:application_shutdown(116): Close channel bktname test-bucket return status = 0

JSS:PLATFORM:fio_pool_thread_func_(122): worker 1 in pool 0xc6ae10 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 3 in pool 0xc6ae10 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 4 in pool 0xc6ae10 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 0 in pool 0xc6ae10 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 2 in pool 0xc6ae10 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 4 in pool 0xc6f3f0 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 0 in pool 0xc6f3f0 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 1 in pool 0xc6f3f0 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 2 in pool 0xc6f3f0 stopped

JSS:PLATFORM:fio_pool_thread_func_(122): worker 3 in pool 0xc6f3f0 stopped