Skip to content

Commit 7a00729

Browse files
authored
chore(model gallery): add trappu_magnum-picaro-0.7-v2-12b (#5153)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent d484028 commit 7a00729

File tree

1 file changed

+19
-0
lines changed

1 file changed

+19
-0
lines changed

gallery/index.yaml

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9837,6 +9837,25 @@
98379837
- filename: Eurydice-24b-v2.i1-Q4_K_M.gguf
98389838
sha256: fb4104a1b33dd860e1eca3b6906a10cacc5b91a2534db72d9749652a204fbcbf
98399839
uri: huggingface://mradermacher/Eurydice-24b-v2-i1-GGUF/Eurydice-24b-v2.i1-Q4_K_M.gguf
9840+
- !!merge <<: *mistral03
9841+
name: "trappu_magnum-picaro-0.7-v2-12b"
9842+
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
9843+
urls:
9844+
- https://huggingface.co/Trappu/Magnum-Picaro-0.7-v2-12b
9845+
- https://huggingface.co/bartowski/Trappu_Magnum-Picaro-0.7-v2-12b-GGUF
9846+
description: |
9847+
This model is a merge between Trappu/Nemo-Picaro-12B, a model trained on my own little dataset free of synthetic data, which focuses solely on storywriting and scenrio prompting (Example: [ Scenario: bla bla bla; Tags: bla bla bla ]), and anthracite-org/magnum-v2-12b.
9848+
9849+
The reason why I decided to merge it with Magnum (and don't recommend Picaro alone) is because that model, aside from its obvious flaws (rampant impersonation, stupid, etc...), is a one-trick pony and will be really rough for the average LLM user to handle. The idea was to have Magnum work as some sort of stabilizer to fix the issues that emerge from the lack of multiturn/smart data in Picaro's dataset. It worked, I think. I enjoy the outputs and it's smart enough to work with.
9850+
9851+
But yeah the goal of this merge was to make a model that's both good at storytelling/narration but also fine when it comes to other forms of creative writing such as RP or chatting. I don't think it's quite there yet but it's something for sure.
9852+
overrides:
9853+
parameters:
9854+
model: Trappu_Magnum-Picaro-0.7-v2-12b-Q4_K_M.gguf
9855+
files:
9856+
- filename: Trappu_Magnum-Picaro-0.7-v2-12b-Q4_K_M.gguf
9857+
sha256: 989839dd7eab997a70eb8430b9df1138f9b0f35d58299d5007e6555a4a4a7f4c
9858+
uri: huggingface://bartowski/Trappu_Magnum-Picaro-0.7-v2-12b-GGUF/Trappu_Magnum-Picaro-0.7-v2-12b-Q4_K_M.gguf
98409859
- &mudler
98419860
url: "github:mudler/LocalAI/gallery/mudler.yaml@master" ### START mudler's LocalAI specific-models
98429861
name: "LocalAI-llama3-8b-function-call-v0.2"

0 commit comments

Comments
 (0)