Commit Graph

54 Commits

Author SHA1 Message Date
Andrej Karpathy fe96775e6e fix issues and improve logic of removing tags 2021-11-30 22:57:59 -08:00
Andrej Karpathy 9c00c8dacd disallow the special tag null, which can result if user escapes the prompt 2021-11-30 22:51:16 -08:00
Andrej Karpathy a01c637cc8 tweak email sending 2021-11-29 20:45:24 -08:00
Andrej Karpathy d5b91270a9 allow to use fewer documents for training tfidf features to prevent OOMs 2021-11-29 15:38:36 -08:00
Andrej Karpathy e182dda381 make send_emails into a proper script and add a few more widgets 2021-11-29 09:29:59 -08:00
Andrej Karpathy 6d7f648384 visually distinguish the special 'all' tag 2021-11-28 08:23:51 -08:00
Andrej Karpathy 8947dd3fc5 tweak search scoring for better results, i think 2021-11-27 18:09:17 -08:00
Andrej Karpathy aff7c89695 use the older arxiv-sanity colorscheme for header 2021-11-27 17:15:40 -08:00
Andrej Karpathy a83dbb2138 it doesn't align, the ocd is killing me 2021-11-27 14:53:14 -08:00
Andrej Karpathy 5990a938a4 add few more stats 2021-11-27 14:47:28 -08:00
Andrej Karpathy 1769b7b02f minor profile page html/css cleanup 2021-11-27 14:31:18 -08:00
Andrej Karpathy d236a5dff9 small tweaks to not do useless work in special cases 2021-11-27 13:06:00 -08:00
Andrej Karpathy a169f0fa61 adding an about page as well 2021-11-27 11:47:17 -08:00
Andrej Karpathy 6c87055349 slight readme tweak 2021-11-27 11:41:04 -08:00
Andrej Karpathy 6d4d1eb78d tweak readme 2021-11-27 11:38:31 -08:00
Andrej Karpathy 6685b0a05f i think this detail matters... 2021-11-27 11:23:35 -08:00
Andrej Karpathy 5eece3f992 add email sending script to repo 2021-11-27 11:19:55 -08:00
Andrej Karpathy 49995465df add ability to store an email for a user for recommendations 2021-11-27 11:04:36 -08:00
Andrej Karpathy 970a9e24cf maintain last active state for users 2021-11-27 09:37:02 -08:00
Andrej Karpathy 47fba66712 add a new stats page 2021-11-26 21:57:48 -08:00
Andrej Karpathy 6a0ff6a9bf clarify even further 2021-11-26 21:10:22 -08:00
Andrej Karpathy b52b64e0f7 don't show the +/- controls for tags when a person is not logged in, it's confusing 2021-11-26 21:09:10 -08:00
Andrej Karpathy e4fe77d118 show user warning if they are not logged in that things won't work 2021-11-26 20:57:20 -08:00
Andrej Karpathy c3ce3e3f70 update the screenshot since the interface changed quite a bit 2021-11-26 20:33:10 -08:00
Andrej Karpathy 4538eedb84 update the readme 2021-11-26 20:31:57 -08:00
Andrej Karpathy 9c88a4eea4 use the process exit code to communicate whether any updates successfully made it into the database at all 2021-11-26 20:19:48 -08:00
Andrej Karpathy d2582c5b77 if the very first API call fails it is very unlikely that there are new papers at all, no need to try multiple pages 2021-11-26 20:10:32 -08:00
Andrej Karpathy aa877c9397 when writing features do it safely and atomically 2021-11-26 20:00:37 -08:00
Andrej Karpathy c3161b2a49 do not reveal username since they are kind of secret now 2021-11-26 17:11:19 -08:00
Andrej Karpathy 5b5b503a93 let things breathe a bit more 2021-11-26 16:44:21 -08:00
Andrej Karpathy c5b5c7833c and i think that's it, we now support user accounts (lite)git commit -m 'and i think that\'s it, we now support user accounts litegit status sweet.'! sweet. 2021-11-26 16:38:36 -08:00
Andrej Karpathy 54157c6e9c ok here we go, the beginning of user profiles. for now we assume there is a single hard-coded user root 2021-11-26 11:07:16 -08:00
Andrej Karpathy dc55146e03 few notes on some outstanding todos 2021-11-26 10:28:49 -08:00
Andrej Karpathy 3e2d1248d8 speed up time filtering by 20X by loading all of metas into memory once instead of querying it item by item in a massive loop 2021-11-26 10:22:52 -08:00
Andrej Karpathy 3d5bbb9851 optimization: read only metas if that's all that we need to complete the request. that said, i expected this to run much faster and it doesn't. i think the way i'm using sqlites here is not exactly efficient or appropriate and i have to re-think the database schema. e.g. getting random papers over the last 7 days should be almost instantaneous, but currently this request takes like 3 seconds. have to better understand why this is happening 2021-11-26 09:51:48 -08:00
Andrej Karpathy b283c85c72 this was bothering me 2021-11-26 09:36:09 -08:00
Andrej Karpathy 8c74150337 eliminate a whole spurious endpoint of /search and remove code duplication 2021-11-26 09:31:06 -08:00
Andrej Karpathy 470bd00563 refactor and clean up the code in preparation for some consolidation, coming up 2021-11-26 09:10:35 -08:00
Andrej Karpathy f565eba1c7 use jinja templates so there's no copy paste code all over the place 2021-11-25 14:45:08 -08:00
Andrej Karpathy 46f556caf6 example makefile 2021-11-25 13:51:52 -08:00
Andrej Karpathy 1ed6e3f1b0 ok now we can sequester all the database files into data/ folder so everything is nice and clean yay 2021-11-25 13:47:45 -08:00
Andrej Karpathy 77279e1777 sequester all file sytem IO ops only to db.py, so it's not total chaos 2021-11-25 13:28:04 -08:00
Andrej Karpathy bd11865a49 add an option to break out early when we've pulled in all new papers most likely 2021-11-24 09:15:36 -08:00
Andrej Karpathy cf1bef6f53 big new feature: ability to inspect any paper to see the raw tfidf tokens and their weights that summarize the paper, and which powers the SVM recommendation engine. basically a bit of a debugging / insight feature, but a really good sanity check that papers are being properly represented 2021-11-21 20:51:01 -08:00
Andrej Karpathy e5798ddb2f make the header link to root of the site as the case should always be ok cool 2021-11-21 14:03:17 -08:00
Andrej Karpathy 548ee210df better default parameters, based on qualitative inspection of tfidf features and word vectors 2021-11-21 13:46:14 -08:00
Andrej Karpathy 8be24dae43 allow for full sorting, slice and dicing with all options in the UI, and the previous shortcuts. now have a lot more flexibility to slice and dice as desired 2021-11-16 21:39:43 -08:00
Andrej Karpathy abb83effed add ability to remove a tag from a paper as well 2021-11-14 21:49:34 -08:00
Andrej Karpathy 7cbb90a480 minor logging changes 2021-11-12 22:49:29 -08:00
Andrej Karpathy 158ced647b add a screenshot and rearrange the readme a bit 2021-11-12 21:36:45 -08:00