Skip to content

Commit 9725bb4

Browse files
authored
chore(model gallery): add gemma-3n-e4b-it (#5731)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 33b4275 commit 9725bb4

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

gallery/index.yaml

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1991,6 +1991,21 @@
19911991
- filename: gemma-3n-E2B-it-Q8_0.gguf
19921992
sha256: 038a47c482e7af3009c462b56a7592e1ade3c7862540717aa1d9dee1760c337b
19931993
uri: huggingface://ggml-org/gemma-3n-E2B-it-GGUF/gemma-3n-E2B-it-Q8_0.gguf
1994+
- !!merge <<: *gemma3
1995+
name: "gemma-3n-e4b-it"
1996+
urls:
1997+
- https://huggingface.co/google/gemma-3n-E4B-it
1998+
- https://huggingface.co/ggml-org/gemma-3n-E4B-it-GGUF
1999+
description: |
2000+
Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. Gemma 3n models are designed for efficient execution on low-resource devices. They are capable of multimodal input, handling text, image, video, and audio input, and generating text outputs, with open weights for pre-trained and instruction-tuned variants. These models were trained with data in over 140 spoken languages.
2001+
Gemma 3n models use selective parameter activation technology to reduce resource requirements. This technique allows the models to operate at an effective size of 2B and 4B parameters, which is lower than the total number of parameters they contain. For more information on Gemma 3n's efficient parameter management technology, see the Gemma 3n page.
2002+
overrides:
2003+
parameters:
2004+
model: gemma-3n-E4B-it-Q8_0.gguf
2005+
files:
2006+
- filename: gemma-3n-E4B-it-Q8_0.gguf
2007+
sha256: 9f74079242c765116bd1f33123aa07160b5e93578c2d0032594b7ed97576f9c3
2008+
uri: huggingface://ggml-org/gemma-3n-E4B-it-GGUF/gemma-3n-E4B-it-Q8_0.gguf
19942009
- &llama4
19952010
url: "github:mudler/LocalAI/gallery/llama3.1-instruct.yaml@master"
19962011
icon: https://avatars.githubusercontent.com/u/153379578

0 commit comments

Comments
 (0)