Skip to content

Commit 889df1d

Browse files
committed
chore(model gallery): add openai_gpt-oss-20b-neo
Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent b9a25b1 commit 889df1d

File tree

1 file changed

+24
-0
lines changed

1 file changed

+24
-0
lines changed

gallery/index.yaml

Lines changed: 24 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -127,6 +127,30 @@
127127
- filename: gpt-oss-120b-mxfp4-00003-of-00003.gguf
128128
sha256: b326bfd8ac696c4b9a14e9e84d5529b2bb86847aea0e65443cbf075accba8b71
129129
uri: huggingface://ggml-org/gpt-oss-120b-GGUF/gpt-oss-120b-mxfp4-00003-of-00003.gguf
130+
- !!merge <<: *gptoss
131+
name: "openai_gpt-oss-20b-neo"
132+
icon: https://huggingface.co/DavidAU/Openai_gpt-oss-20b-NEO-GGUF/resolve/main/matrix1.gif
133+
urls:
134+
- https://huggingface.co/DavidAU/Openai_gpt-oss-20b-NEO-GGUF
135+
description: |
136+
These are NEO Imatrix GGUFs, NEO dataset by DavidAU.
137+
138+
NEO dataset improves overall performance, and is for all use cases.
139+
140+
Example output below (creative), using settings below.
141+
142+
Model also passed "hard" coding test too (6 experts); no issues (IQ4_NL).
143+
144+
(Forcing the model to create code with no dependencies and limits of coding short cuts, with multiple loops, and in real time with no blocking in a language that does not support it normally.)
145+
146+
Due to quanting issues with this model (which result in oddball quant sizes / mixtures), only TESTED quants will be uploaded (at the moment).
147+
overrides:
148+
parameters:
149+
model: OpenAI-20B-NEO-MXFP4_MOE4.gguf
150+
files:
151+
- filename: OpenAI-20B-NEO-MXFP4_MOE4.gguf
152+
sha256: 066c84a0844b1f1f4515e5c64095fe4c67e86d5eb70db4e368e283b1134d9c1e
153+
uri: huggingface://DavidAU/Openai_gpt-oss-20b-NEO-GGUF/OpenAI-20B-NEO-MXFP4_MOE4.gguf
130154
- &afm
131155
name: "arcee-ai_afm-4.5b"
132156
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"

0 commit comments

Comments
 (0)