chrisbarrera
f8b1069a1c
add min_p sampling parameter ( #2014 )
...
Signed-off-by: Christopher Barrera <cb@arda.tx.rr.com >
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com >
2024-02-24 17:51:34 -05:00
Jared Van Bortel
059afb8ee8
csharp: update README to reflect new NuGet package
...
Signed-off-by: Jared Van Bortel <jared@nomic.ai >
2024-02-09 15:01:00 -05:00
Jared Van Bortel
5dd7378db4
csharp: fix NuGet package build ( #1951 )
...
Signed-off-by: Jared Van Bortel <jared@nomic.ai >
Signed-off-by: Konstantin Semenenko <mail@ksemenenko.com >
Co-authored-by: Konstantin Semenenko <mail@ksemenenko.com >
2024-02-09 14:58:28 -05:00
Jared Van Bortel
061d1969f8
expose n_gpu_layers parameter of llama.cpp ( #1890 )
...
Also dynamically limit the GPU layers and context length fields to the maximum supported by the model.
Signed-off-by: Jared Van Bortel <jared@nomic.ai >
2024-01-31 14:17:44 -05:00
Jared Van Bortel
03a9f0bedf
csharp: update C# bindings to work with GGUF ( #1651 )
2024-01-16 14:33:41 -05:00
Jared Van Bortel
d1c56b8b28
Implement configurable context length ( #1749 )
2023-12-16 17:58:15 -05:00
cebtenzzre
79a5522931
fix references to old backend implementations
2023-10-30 10:37:05 -04:00
cebtenzzre
e90263c23f
make scripts executable ( #1555 )
2023-10-24 09:28:21 -04:00
cebtenzzre
017c3a9649
python: prepare version 2.0.0rc1 ( #1529 )
2023-10-18 20:24:54 -04:00
cebtenzzre
fd3014016b
docs: clarify Vulkan dep in build instructions for bindings ( #1525 )
2023-10-18 12:09:52 -04:00
mvenditto
8a31239e90
bump version
2023-07-11 18:09:39 -04:00
mvenditto
7efb43c2e4
copy metal kernels on macos builds
2023-07-11 18:09:39 -04:00
mvenditto
991b7468c9
fix native lib loader tests
2023-07-11 18:09:39 -04:00
mvenditto
c92c1af697
nuget pack and push
2023-07-11 18:09:39 -04:00
mvenditto
4b7b9975c5
add lib loading tests + remove dummy test
2023-07-11 18:09:39 -04:00
mvenditto
c3ad76dcd1
update deps for test project
2023-07-11 18:09:39 -04:00
mvenditto
1d570bfe76
bump test to net 7
2023-07-11 18:09:39 -04:00
mvenditto
d3831f7dbe
first attempt to store test results
2023-07-11 18:09:39 -04:00
mvenditto
5fe4f25d64
fix curr working directory
2023-07-11 18:09:39 -04:00
mvenditto
7c67134b8c
try to sort out ci only error on build related to CA2101
2023-07-11 18:09:39 -04:00
mvenditto
2cbe791e5c
add a SkipOnCI trait fore tests
2023-07-11 18:09:39 -04:00
Tim Miller
797891c995
Initial Library Loader for .NET Bindings / Update bindings to support newest changes ( #763 )
...
* Initial Library Loader
* Load library as part of Model factory
* Dynamically search and find the dlls
* Update tests to use locally built runtimes
* Fix dylib loading, add macos runtime support for sample/tests
* Bypass automatic loading by default.
* Only set CMAKE_OSX_ARCHITECTURES if not already set, allow cross-compile
* Switch Loading again
* Update build scripts for mac/linux
* Update bindings to support newest breaking changes
* Fix build
* Use llmodel for Windows
* Actually, it does need to be libllmodel
* Name
* Remove TFMs, bypass loading by default
* Fix script
* Delete mac script
---------
Co-authored-by: Tim Miller <innerlogic4321@ghmail.com >
2023-06-13 14:05:34 +02:00
mvenditto
8e89ceb54b
C# Bindings - improved logging ( #714 )
...
* added optional support for .NET logging
* bump version and add missing alpha suffix
* avoid creating additional namespace for extensions
* prefer NullLogger/NullLoggerFactory over null-conditional ILogger to avoid errors
---------
Signed-off-by: mvenditto <venditto.matteo@gmail.com >
2023-06-01 21:01:27 +01:00
Tim Miller
87cb3505d3
Fix MSVC Build, Update C# Binding Scripts
2023-06-01 14:24:23 -04:00
mvenditto
9eb81cb549
C# Bindings - Prompt formatting ( #712 )
...
* Added support for custom prompt formatting
* more docs added
* bump version
2023-05-28 19:57:00 -04:00
redthing1
63f57635d8
make sample print usage and cleaner
2023-05-25 11:34:21 -04:00
redthing1
dec8546abe
create test project and basic model loading tests
2023-05-25 11:34:07 -04:00
redthing1
0cc86d19be
ignore rider and vscode dirs
2023-05-25 11:34:07 -04:00
redthing1
4864053a33
make build_linux.sh have +x permission
2023-05-22 18:10:30 -04:00
mvenditto
8119ff4df0
C# bindings ( #650 )
...
* First workin version of the C# bindings
* Update README.md
Signed-off-by: mvenditto <venditto.matteo@gmail.com >
* Added more docs + fixed prompt callback signature
* build scripts revision
* Added .editorconfig + fixed style issues
---------
Signed-off-by: mvenditto <venditto.matteo@gmail.com >
2023-05-22 12:56:49 -07:00