4 Commits

Author	SHA1	Message	Date
Jared Van Bortel	f07e2e63df	Use the token cache to infer greater n_past and reuse results (#3073) ... Signed-off-by: Jared Van Bortel <jared@nomic.ai>	2024-10-31 11:19:12 -04:00
Jared Van Bortel	f9d6be8afb	backend: rebase llama.cpp on upstream as of Sep 26th (#2998) ... Signed-off-by: Jared Van Bortel <jared@nomic.ai>	2024-09-27 12:05:59 -04:00
Jared Van Bortel	39005288c5	server: improve correctness of request parsing and responses (#2929) ... Signed-off-by: Jared Van Bortel <jared@nomic.ai>	2024-09-09 10:48:57 -04:00
Jared Van Bortel	ca151f3519	repo: organize sources, headers, and deps into subdirectories (#2917) ... Signed-off-by: Jared Van Bortel <jared@nomic.ai>	2024-08-27 17:22:40 -04:00