NVIDIA Tegra Jetson TX2 Development Kit Storage Testing

Notice: Page may contain affiliate links for which we may earn a small commission through services like Amazon Affiliates or Skimlinks.
Patrick

Patrick

Administrator
Staff member
Dec 21, 2010
12,513
5,804
113
Doing a bit of fun testing with the NVIDIA Tegra Jetson TX2.

First off, the installed Ubuntu 16.04 image will boot and be SSH-able without hooking up a keyboard monitor as the setup guide suggests. It will grab a DHCP address and register as "tegra-ubuntu" in the DHCP server so you can find it.

Storage Testing What Works
Doing a quick round of seeing what works.

SATA SSD via onboard header: Yes
3.5" SATA HDD via onboard header: Somewhat - needs a support mechanism
2.5" SATA HDD via onboard header: Somewhat - needs a support mechanism
USB 3.0 drive: Yes
PCIe AIC NVMe: Yes (at reduced speeds due to PCIe electrical constraints)
Intel Optane Memory: Yes!*
upload_2017-5-12_11-5-36.png
*Utilizing PCIe 2.0 so speeds will be somewhat impacted.
 
Last edited:
Patrick

Patrick

Administrator
Staff member
Dec 21, 2010
12,513
5,804
113
Quick FIO 4K random write / read at on the eMMC module:
Code: 
nvidia@tegra-ubuntu:~$ sudo fio --name=randwrite --ioengine=libaio --iodepth=2 --rw=randwrite --bs=4k --direct=1 --size=256M --filename=/dev/mmcblk0 --numjobs=8 --runtime=60 --group_reporting
randwrite: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2
...
fio-2.2.10
Starting 8 processes
Jobs: 8 (f=8): [w(8)] [100.0% done] [0KB/46960KB/0KB /s] [0/11.8K/0 iops] [eta 00m:00s]
randwrite: (groupid=0, jobs=8): err= 0: pid=20917: Fri May 12 18:37:35 2017
  write: io=2048.0MB, bw=36075KB/s, iops=9018, runt= 58133msec
    slat (usec): min=6, max=8548, avg=24.87, stdev=13.09
    clat (usec): min=155, max=18744, avg=1733.33, stdev=1263.70
     lat (usec): min=204, max=18768, avg=1760.08, stdev=1263.82
    clat percentiles (usec):
     |  1.00th=[ 1048],  5.00th=[ 1208], 10.00th=[ 1224], 20.00th=[ 1224],
     | 30.00th=[ 1240], 40.00th=[ 1256], 50.00th=[ 1336], 60.00th=[ 1368],
     | 70.00th=[ 1400], 80.00th=[ 1464], 90.00th=[ 3312], 95.00th=[ 4768],
     | 99.00th=[ 7520], 99.50th=[ 8256], 99.90th=[10688], 99.95th=[11328],
     | 99.99th=[13760]
    bw (KB  /s): min= 4264, max= 6792, per=12.51%, avg=4512.54, stdev=260.30
    lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.68%
    lat (msec) : 2=86.69%, 4=5.02%, 10=7.41%, 20=0.16%
  cpu          : usr=2.11%, sys=4.71%, ctx=521829, majf=0, minf=147
  IO depths    : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=524288/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=2

Run status group 0 (all jobs):
  WRITE: io=2048.0MB, aggrb=36075KB/s, minb=36075KB/s, maxb=36075KB/s, mint=58133msec, maxt=58133msec

Disk stats (read/write):
  mmcblk0: ios=0/520906, merge=0/710, ticks=0/902980, in_queue=902616, util=99.78%
nvidia@tegra-ubuntu:~$ sudo fio --name=randread --ioengine=libaio --iodepth=2 --rw=randread --bs=4k --direct=1 --size=256M --filename=/dev/mmcblk0 --numjobs=8 --runtime=60 --group_reporting
randwrite: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2
...
fio-2.2.10
Starting 8 processes
Jobs: 8 (f=8): [r(8)] [100.0% done] [20699KB/0KB/0KB /s] [5174/0/0 iops] [eta 00m:00s]
randwrite: (groupid=0, jobs=8): err= 0: pid=20929: Fri May 12 18:38:57 2017
  read : io=1179.2MB, bw=20122KB/s, iops=5030, runt= 60003msec
    slat (usec): min=16, max=262, avg=33.27, stdev= 5.86
    clat (usec): min=633, max=4578, avg=3123.67, stdev=104.67
     lat (usec): min=666, max=4614, avg=3160.24, stdev=104.32
    clat percentiles (usec):
     |  1.00th=[ 2864],  5.00th=[ 2960], 10.00th=[ 2992], 20.00th=[ 3024],
     | 30.00th=[ 3088], 40.00th=[ 3088], 50.00th=[ 3120], 60.00th=[ 3152],
     | 70.00th=[ 3184], 80.00th=[ 3216], 90.00th=[ 3248], 95.00th=[ 3280],
     | 99.00th=[ 3312], 99.50th=[ 3344], 99.90th=[ 3376], 99.95th=[ 3440],
     | 99.99th=[ 4384]
    bw (KB  /s): min= 2462, max= 2608, per=12.51%, avg=2516.96, stdev=44.59
    lat (usec) : 750=0.01%, 1000=0.01%
    lat (msec) : 2=0.01%, 4=99.97%, 10=0.02%
  cpu          : usr=2.29%, sys=3.70%, ctx=301812, majf=0, minf=149
  IO depths    : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=301852/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=2

Run status group 0 (all jobs):
   READ: io=1179.2MB, aggrb=20122KB/s, minb=20122KB/s, maxb=20122KB/s, mint=60003msec, maxt=60003msec

Disk stats (read/write):
  mmcblk0: ios=301712/9, merge=75/2, ticks=940068/12, in_queue=939656, util=99.98%
 
Last edited:
Patrick

Patrick

Administrator
Staff member
Dec 21, 2010
12,513
5,804
113
And compare that to 16GB Optane Memory module:
Code: 
nvidia@tegra-ubuntu:~$ sudo fio --name=randwrite --ioengine=libaio --iodepth=2 --rw=randwrite --bs=4k --direct=1 --size=256M --filename=/dev/nvme0n1 --numjobs=8 --runtime=60 --group_reporting
randwrite: (g=0): rw=randwrite, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2
...
fio-2.2.10
Starting 8 processes
Jobs: 8 (f=6): [w(8)] [100.0% done] [0KB/143.2MB/0KB /s] [0/36.7K/0 iops] [eta 00m:00s]
randwrite: (groupid=0, jobs=8): err= 0: pid=20943: Fri May 12 18:41:30 2017
  write: io=2048.0MB, bw=149636KB/s, iops=37409, runt= 14015msec
    slat (usec): min=9, max=30882, avg=17.94, stdev=106.61
    clat (usec): min=33, max=31428, avg=400.40, stdev=145.99
     lat (usec): min=50, max=31441, avg=419.33, stdev=177.96
    clat percentiles (usec):
     |  1.00th=[  258],  5.00th=[  274], 10.00th=[  306], 20.00th=[  318],
     | 30.00th=[  334], 40.00th=[  350], 50.00th=[  378], 60.00th=[  406],
     | 70.00th=[  446], 80.00th=[  486], 90.00th=[  540], 95.00th=[  580],
     | 99.00th=[  668], 99.50th=[  692], 99.90th=[  740], 99.95th=[  764],
     | 99.99th=[ 1032]
    bw (KB  /s): min=16840, max=20344, per=12.57%, avg=18803.01, stdev=634.98
    lat (usec) : 50=0.03%, 100=0.11%, 250=0.49%, 500=81.89%, 750=17.42%
    lat (usec) : 1000=0.07%
    lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
  cpu          : usr=4.73%, sys=12.15%, ctx=513772, majf=0, minf=151
  IO depths    : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=524288/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=2

Run status group 0 (all jobs):
  WRITE: io=2048.0MB, aggrb=149636KB/s, minb=149636KB/s, maxb=149636KB/s, mint=14015msec, maxt=14015msec

Disk stats (read/write):
  nvme0n1: ios=92/521063, merge=0/0, ticks=12/208444, in_queue=208668, util=99.33%
nvidia@tegra-ubuntu:~$ sudo fio --name=randwrite --ioengine=libaio --iodepth=2 --rw=randread --bs=4k --direct=1 --size=256M --filename=/dev/nvme0n1 --numjobs=8 --runtime=60 --group_reporting
randwrite: (g=0): rw=randread, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=2
...
fio-2.2.10
Starting 8 processes
Jobs: 2 (f=2): [r(1),_(3),r(1),_(3)] [100.0% done] [657.1MB/0KB/0KB /s] [168K/0/0 iops] [eta 00m:00s]
randwrite: (groupid=0, jobs=8): err= 0: pid=20958: Fri May 12 18:41:51 2017
  read : io=2048.0MB, bw=699284KB/s, iops=174820, runt=  2999msec
    slat (usec): min=6, max=40603, avg=15.62, stdev=165.25
    clat (usec): min=1, max=46740, avg=63.26, stdev=341.93
     lat (usec): min=24, max=49342, avg=79.69, stdev=409.59
    clat percentiles (usec):
     |  1.00th=[   16],  5.00th=[   18], 10.00th=[   19], 20.00th=[   22],
     | 30.00th=[   34], 40.00th=[   44], 50.00th=[   51], 60.00th=[   57],
     | 70.00th=[   66], 80.00th=[   77], 90.00th=[   97], 95.00th=[  120],
     | 99.00th=[  185], 99.50th=[  231], 99.90th=[  908], 99.95th=[ 4320],
     | 99.99th=[18560]
    bw (KB  /s): min=36864, max=109832, per=13.13%, avg=91793.65, stdev=14207.27
    lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=10.19%, 50=37.84%
    lat (usec) : 100=42.72%, 250=8.83%, 500=0.24%, 750=0.06%, 1000=0.02%
    lat (msec) : 2=0.03%, 4=0.02%, 10=0.03%, 20=0.01%, 50=0.01%
  cpu          : usr=13.79%, sys=45.84%, ctx=192351, majf=0, minf=149
  IO depths    : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=524288/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=2

Run status group 0 (all jobs):
   READ: io=2048.0MB, aggrb=699283KB/s, minb=699283KB/s, maxb=699283KB/s, mint=2999msec, maxt=2999msec

Disk stats (read/write):
  nvme0n1: ios=518793/0, merge=0/0, ticks=21944/0, in_queue=21960, util=96.73%
 
You must log in or register to reply here.
Top Bottom