diff --git a/save_model.py b/save_model.py index f3b7539..de102c7 100644 --- a/save_model.py +++ b/save_model.py @@ -2,14 +2,15 @@ #!/usr/bin/env python """Saves the model as a TorchScript. -The resulting file can be loaded in C++ code and then used for training or inference with: +The resulting file can be loaded in C++ code and then used for training or +inference with: #include torch::jit::Module module = torch::jit::load("model.pt") -Note that the model includes the initial parameters and with default ModelArgs the serialized model -is 59M and gzips down to 55M. If you want to serialize/distribute the model parameters separately -and the size of the model file you can zero out the parameters before saving it and it will gzip -down to 780K: +Note that the model includes the initial parameters and with default ModelArgs the +serialized model is 59M and gzips down to 55M. If you want to serialize/distribute the +model parameters separately and the size of the model file you can zero out the +parameters before saving it and it will gzip down to 780K: for p in model.parameters(): p.detach().zero_() """