Default Athena profiles to one inference slot
This commit is contained in:
1 parent
014583e7f6
commit
8be1cd6a6f
4 files changed
+9
-11
No files matched your search
@@ -100,7 +100,7 @@ EXPERIMENTAL_CONTEXT=76800
|
||||
LLAMA_THREADS=6
|
||||
LLAMA_THREADS_BATCH=6
|
||||
FAST_PARALLEL_SLOTS=1
|
||||
MEDIUM_PARALLEL_SLOTS=2
|
||||
MEDIUM_PARALLEL_SLOTS=1
|
||||
LARGE_PARALLEL_SLOTS=1
|
||||
ULTRA_PARALLEL_SLOTS=1
|
||||
UNCENSORED_PARALLEL_SLOTS=1
|
||||
|
||||
Reference in new issue
Block a user