michael/AI-Profile-Router
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Use embedded MTP tensor for IQ4-MIX profiles

Browse Source
This commit is contained in:
Mikei386
2026-08-21 13:18:45 +02:00
parent 057920b941
commit 42e2aad3a6
4 changed files with 3 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.env.example
-1
View File
@@ -12,7 +12,6 @@ MEDIUM_MODEL_FILE=qwen/Qwen3.8-27B-UD-IQ4_XS.gguf
LONG_MODEL_FILE=qwen/Qwen3.8-27B-UD-IQ4_XS.gguf
EXPERIMENTAL_MODEL_FILE=qwen/Qwen3.8-27B-UD-IQ4_XS.gguf
VISION_PROJECTOR_FILE=qwen/mmproj-BF16.gguf
MTP_MODEL_FILE=qwen/mtp-Qwen3.8-27B-Q4_0.gguf
FAST_CONTEXT=76800
MEDIUM_CONTEXT=94208