Skip to content

Commit dbcf5fb

Browse files
authored
chore(model gallery): add gemma-3-4b-it-max-horror-uncensored-dbl-x-imatrix (#5751)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 2633137 commit dbcf5fb

File tree

1 file changed

+29
-0
lines changed

1 file changed

+29
-0
lines changed

gallery/index.yaml

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2257,6 +2257,35 @@
22572257
- filename: gemma-3n-E4B-it-Q8_0.gguf
22582258
sha256: 9f74079242c765116bd1f33123aa07160b5e93578c2d0032594b7ed97576f9c3
22592259
uri: huggingface://ggml-org/gemma-3n-E4B-it-GGUF/gemma-3n-E4B-it-Q8_0.gguf
2260+
- !!merge <<: *gemma3
2261+
name: "gemma-3-4b-it-max-horror-uncensored-dbl-x-imatrix"
2262+
icon: https://huggingface.co/DavidAU/Gemma-3-4b-it-MAX-HORROR-Uncensored-DBL-X-Imatrix-GGUF/resolve/main/gemma4-horror-max2.jpg
2263+
urls:
2264+
- https://huggingface.co/DavidAU/Gemma-3-4b-it-MAX-HORROR-Uncensored-DBL-X-Imatrix-GGUF
2265+
description: |
2266+
Google's newest Gemma-3 model that has been uncensored by David_AU (maintains instruction following / model performance and adds 4 layers to the model) and re-enforced with a system prompt (optional) - see below.
2267+
The "Horror Imatrix" was built using Grand Horror 16B (at my repo). This adds a "tint" of horror to the model.
2268+
2269+
5 examples provided (NSFW / F-Bombs galore) below with prompts at IQ4XS (56 t/s on mid level card).
2270+
2271+
Context: 128k.
2272+
2273+
"MAXED"
2274+
2275+
This means the embed and output tensor are set at "BF16" (full precision) for all quants. This enhances quality, depth and general performance at the cost of a slightly larger quant.
2276+
2277+
"HORROR IMATRIX"
2278+
2279+
A strong, in house built, imatrix dataset built by David_AU which results in better overall function, instruction following, output quality and stronger connections to ideas, concepts and the world in general.
2280+
2281+
This combines with "MAXing" the quant to improve preformance.
2282+
overrides:
2283+
parameters:
2284+
model: Gemma-3-4b-it-MAX-HORROR-Uncensored-D_AU-Q4_K_M-imat.gguf
2285+
files:
2286+
- filename: Gemma-3-4b-it-MAX-HORROR-Uncensored-D_AU-Q4_K_M-imat.gguf
2287+
sha256: 1c577e4c84311c39b3d54b0cef12857ad46e88755f858143accbfcca7cc9fc6b
2288+
uri: huggingface://DavidAU/Gemma-3-4b-it-MAX-HORROR-Uncensored-DBL-X-Imatrix-GGUF/Gemma-3-4b-it-MAX-HORROR-Uncensored-D_AU-Q4_K_M-imat.gguf
22602289
- &llama4
22612290
url: "github:mudler/LocalAI/gallery/llama3.1-instruct.yaml@master"
22622291
icon: https://avatars.githubusercontent.com/u/153379578

0 commit comments

Comments
 (0)