Environment setup

Add path to libprotobuf.so and libnvdla_compiler.so in LD_LIBRARY_PATH

Compilation Command

Compilation script : miniera-hpvm/src/compile_benchmark.sh

Command:

python3 /home/hsharif3/Gitlab/hpvm_release_nvdla/hpvm/build/tools/hpvm/tools/hpvm-clang/main.py -t nvdla --conf-file data/tuner_confs.txt -DMODEL_PARAMS_DIR=${PATH_TO_MODELPARAMS} -fno-exceptions miniera-hpvm.cpp miniera-hpvm

NOTE: by default hpvm-clang is configured to read calibration inputs from a calib.txt file plaed in the current build directoy (see main.py.in in hpvm-clang). Default compilation mode is INT8 - modify main.py in build directory to use FP16 mode (easily configurable)

Running on EPOCHS chip

The compilation creates an nvdla module named hpvm-mod.nvdla

Connect to EPOCHS chip:

ssh -q -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -p 5506 root@ espgate.cs.columbia.edu

password: openesp

More instructions on EPOCHS chip here:

https://docs.google.com/document/d/1rQa6sIDKtYHGKmWg5bPROJ_FijDUnaVEWkckLWtpHFU/edit?usp=sharing

Running on EPOCHS chip:

cd NV_NVDLA/

./nvdla_runtime  --loadable  hpvm-mod.nvdla --image  ${test_image}  --rawdump

NOTE --normalize not neeed here -- input should be INT8

Images to use for Testing

Images to use for testing under /benchmarks/miniera-hpvm/data/images

The ground truth class of the image is part of the file name. For instance, *_1.jpg indicates file with target class 1.

Frontend/Source changes required

• Weights must be FP16!

• Weights for FC layers need to be tranposed

• Modify paths to readTrainedWeights to pass constant file path -- use MODEL_PARAMS_STR as part of string (see miniera-hpvm.cpp as example)

Missing Support

** BatchNorm support missing (better to try on small example first)