Aaron Miller b19a3e5b2c add requiredMem method to llmodel impls ...

most of these can just shortcut out of the model loading logic llama is a bit worse to deal with because we submodule it so I have to at least parse the hparams, and then I just use the size on disk as an estimate for the mem size (which seems reasonable since we mmap() the llama files anyway)

2023-06-26 18:27:58 -03:00

1.4 KiB

Raw Blame History

View Raw