schihei/llama2.c
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Zero'ing params docs

Browse Source
This commit is contained in:
Michael Cusack
2023-08-04 17:33:23 +07:00
parent dfff7812db
commit 305d920862
1 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
save_model.py
+4 -4
View File
@@ -6,10 +6,10 @@ inference with:
#include <torch/script.h>
torch::jit::Module module = torch::jit::load("model.pt")
Note that the model includes the initial parameters and with default ModelArgs the
serialized model is 59M and gzips down to 55M. If you want to serialize/distribute the
model parameters separately and the size of the model file you can zero out the
parameters before saving it and it will gzip down to 780K:
Note that the serialized model includes the initial parameters and with the default
ModelArgs the file is 59M and gzips down to 55M. If you want to serialize/distribute
the model parameters separately and you can zero out the parameters before saving it
and it will gzip down to 780K:
for p in model.parameters():
p.detach().zero_()
"""