Whitelist OLMoE and Granite MoE (#3449)

Signed-off-by: ThiloteE <73715071+ThiloteE@users.noreply.github.com>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
This commit is contained in:
ThiloteE 2025-02-05 00:00:07 +01:00 committed by GitHub
parent 04dc157b98
commit 6ef0bd518e
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 6 additions and 1 deletions

@ -1 +1 @@
Subproject commit b06658d366abe3cea92f4e868db72165531a74da Subproject commit 3ebb3603e807d74a16f061c46d2925a1653e7a93

View File

@ -53,6 +53,7 @@ static const std::vector<const char *> KNOWN_ARCHES {
"gpt2", "gpt2",
// "gptj", -- no inference code // "gptj", -- no inference code
"gptneox", "gptneox",
"granitemoe",
"mpt", "mpt",
"baichuan", "baichuan",
"starcoder", "starcoder",
@ -80,6 +81,7 @@ static const std::vector<const char *> KNOWN_ARCHES {
"command-r", "command-r",
// "dbrx", -- 16x12B parameters // "dbrx", -- 16x12B parameters
"olmo", "olmo",
"olmoe",
"openelm", "openelm",
// "arctic", -- 10B+128x3.66B parameters // "arctic", -- 10B+128x3.66B parameters
"deepseek2", "deepseek2",

View File

@ -6,6 +6,9 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/).
## [Unreleased] ## [Unreleased]
### Added
- Whitelist OLMoE and Granite MoE model architectures (no Vulkan) ([#3449](https://github.com/nomic-ai/gpt4all/pull/3449))
### Fixed ### Fixed
- Fix "index N is not a prompt" when using LocalDocs with reasoning ([#3451](https://github.com/nomic-ai/gpt4all/pull/3451) - Fix "index N is not a prompt" when using LocalDocs with reasoning ([#3451](https://github.com/nomic-ai/gpt4all/pull/3451)
- Work around rendering artifacts on Snapdragon SoCs with Windows ([#3450](https://github.com/nomic-ai/gpt4all/pull/3450)) - Work around rendering artifacts on Snapdragon SoCs with Windows ([#3450](https://github.com/nomic-ai/gpt4all/pull/3450))