README.md

# Environment setup 

Add path to `libprotobuf.so` and `libnvdla_compiler.so` in LD_LIBRARY_PATH



# Compilation Command 

Compilation script : `miniera-hpvm/src/compile_benchmark.sh`

Command:

```
python3 /home/hsharif3/Gitlab/hpvm_release_nvdla/hpvm/build/tools/hpvm/tools/hpvm-clang/main.py -t nvdla --conf-file data/tuner_confs.txt -DMODEL_PARAMS_DIR=${PATH_TO_MODELPARAMS} -fno-exceptions miniera-hpvm.cpp miniera-hpvm

```

*NOTE*: by default hpvm-clang is configured to read calibration inputs from a `calib.txt` file plaed in the current build directoy (see main.py.in in hpvm-clang). Default compilation mode is INT8 - modify `main.py` in build directory to use FP16 mode (easily configurable)


# Running on EPOCHS chip 

The compilation creates an nvdla module named `hpvm-mod.nvdla` 

Connect to EPOCHS chip:

```
ssh -q -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -p 5506 root@ espgate.cs.columbia.edu

```

*password*: `openesp` 

More instructions on EPOCHS chip here: 

https://docs.google.com/document/d/1rQa6sIDKtYHGKmWg5bPROJ_FijDUnaVEWkckLWtpHFU/edit?usp=sharing


Running on EPOCHS chip:

```

cd NV_NVDLA/

./nvdla_runtime  --loadable  hpvm-mod.nvdla --image  ${test_image}  --rawdump

```

*NOTE*  --normalize not neeed here -- input should be INT8

# Images to use for Testing 

Images to use for testing under `/benchmarks/miniera-hpvm/data/images` 

The ground truth class of the image is part of the file name. For instance, `*_1.jpg` indicates file with target class `1`.


# Frontend/Source changes required

* Weights must be FP16!

* Weights for FC layers need to be tranposed 

* Modify paths to readTrainedWeights to pass constant file path -- use MODEL_PARAMS_STR as part of string (see `miniera-hpvm.cpp` as example) 



# Missing Support 

** BatchNorm support missing (better to try on small example first)