-
- Downloads
Word-level language model compression
Added an implementation of Baidu’s RNN pruning scheme: Narang, Sharan & Diamos, Gregory & Sengupta, Shubho & Elsen, Erich. (2017). Exploring Sparsity in Recurrent Neural Networks. (https://arxiv.org/abs/1704.05119) Added an example of word-level language model compression. The language model is based on PyTorch’s example: https://github.com/pytorch/examples/tree/master/word_language_model Added an AGP pruning schedule and RNN pruning schedule to demonstrate compression of the language model.
Showing
- distiller/pruning/__init__.py 1 addition, 0 deletionsdistiller/pruning/__init__.py
- distiller/pruning/baidu_rnn_pruner.py 66 additions, 0 deletionsdistiller/pruning/baidu_rnn_pruner.py
- examples/agp-pruning/word_lang_model.schedule_agp.yaml 57 additions, 0 deletionsexamples/agp-pruning/word_lang_model.schedule_agp.yaml
- examples/baidu-rnn-pruning/word_lang_model.schedule_baidu_rnn.yaml 112 additions, 0 deletions...baidu-rnn-pruning/word_lang_model.schedule_baidu_rnn.yaml
- examples/word_language_model/README.md 56 additions, 0 deletionsexamples/word_language_model/README.md
- examples/word_language_model/data.py 48 additions, 0 deletionsexamples/word_language_model/data.py
- examples/word_language_model/data/wikitext-2/README 3 additions, 0 deletionsexamples/word_language_model/data/wikitext-2/README
- examples/word_language_model/data/wikitext-2/test.txt 4358 additions, 0 deletionsexamples/word_language_model/data/wikitext-2/test.txt
- examples/word_language_model/data/wikitext-2/train.txt 36718 additions, 0 deletionsexamples/word_language_model/data/wikitext-2/train.txt
- examples/word_language_model/data/wikitext-2/valid.txt 3760 additions, 0 deletionsexamples/word_language_model/data/wikitext-2/valid.txt
- examples/word_language_model/generate.py 82 additions, 0 deletionsexamples/word_language_model/generate.py
- examples/word_language_model/logging.conf 38 additions, 0 deletionsexamples/word_language_model/logging.conf
- examples/word_language_model/main.py 376 additions, 0 deletionsexamples/word_language_model/main.py
- examples/word_language_model/model.py 63 additions, 0 deletionsexamples/word_language_model/model.py
Loading
Please register or sign in to comment