Merge pull request #284 from karpathy/feature/customtokenizer

multiquery support add
2023-08-13 12:38:06 -07:00
parent b28c1e26c5 38bfac90a8
commit 1bcb2d18d6
5 changed files with 33 additions and 26 deletions
@@ -297,7 +297,6 @@ If your candidate PRs have elements of these it doesn't mean they won't get merg

 - revive tests; train a tiny Llama test model (committed to repo) and use it as reference in unit tests
 - make it easier to add a new dataset with not too much pain
- add multiquery support into run.c
 - should calculate freq_cis online in the script run.c instead of loading them
 - int4/8 quantization
 - export the model in a more sensible output format with a proper header, etc.