michael/AI-Profile-Router
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Offload vision projector to RTX 3060

Browse Source
This commit is contained in:
Mikei386
2026-08-22 17:19:56 +02:00
parent 7513a0c912
commit 8267a85a96
6 changed files with 119 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.env.example
+1 -1
View File
@@ -21,7 +21,7 @@ MEDIUM_CONTEXT=160000
LARGE_CONTEXT=192000
ULTRA_CONTEXT=262144
EXPERIMENTAL_CONTEXT=76800
FAST_GPU_DEVICES=0
FAST_GPU_DEVICES=0,1
MEDIUM_GPU_DEVICES=0,1
MEDIUM_TENSOR_SPLIT=90,10
LARGE_GPU_DEVICES=0,1