Document profile-wide GSQ-RCO A-B test

This commit is contained in:
Mikei386
2026-09-08 13:48:47 +02:00
parent edb845eb19
commit 3e3fbbe9bd
3 changed files with 193 additions and 0 deletions
+18
View File
@@ -0,0 +1,18 @@
# GSQ-RCO IQ3_S profile A/B test
`run-case.sh` starts one isolated llama.cpp test container for either the
current Q4 reference or GSQ-RCO IQ3_S. It refuses to start while a production
LLM container is running. Context, GPU split, vision projector, MTP depth and
batch sizes are explicit command-line arguments so every candidate can use the
same settings as its corresponding production profile.
The 2026-09-08 run used the existing dependency-free benchmark programs:
- `experiments/dirk-qwen38/bench-case.py`
- `experiments/dirk-qwen38/quality-ab.py`
- `dev/QWEN38-FINAL-ACCEPTANCE-v1.json`
Results are retained on Athena in
`/data/model-benchmarks/gsq-rco-iq3s-ab-v2-20260908/`. The conclusions and
aggregate measurements are documented in
`docs/GSQ_RCO_BETA1_20260904.md`.