[分享] MxNet CSVIter

作者: celestialgod (天)   2017-04-16 00:42:31
[關鍵字]: MxNet, deep learning, large dataset, mx.io.CSVIter
[出處]:
http://chingchuan-chen.github.io/posts/2017/04/16/mxnet-io-csviter
[重點摘要]:
本篇的重點在於下面這段R,用MxNet提供的mx.io.CSVIter去batch的訓練Net模型
而這裡的`train-64x64-data.csv`,每一行都是經過resized的30`張圖片
所以`data.shape`是`64 x 64 x 30`
而label則每一行是長度600的binary vector,其`shape`設定成`600`
然後給好`batch.size`,MxNet就可以批次的從csv抓資料出來train模型了
不用一股腦地把資料全部匯入到R/gpu裡面跑,不然再多的記憶體也用不完Orz
``` R
data_train <- mx.io.CSVIter(
data.csv = "train-64x64-data.csv", data.shape = c(64, 64, 30),
label.csv = "train-systole.csv", label.shape = 600,
batch.size = batch_size
)
```

Links booklink

Contact Us: admin [ a t ] ucptt.com