[LLM] models update

2026-09-21 17:45:07 +02:00
parent e65d8e597a
commit 9fc7854751
11 changed files with 215 additions and 8 deletions
@@ -60,9 +60,11 @@ starves the desktop and freezes the PC (reboot). Hard-won rules:
 | `Qwen3.5-9B-UD-Q6_K_XL` | 32.1 | 32k | vision, MTP, reasoning | small Qwen, quick tasks |
 | `Qwen3-Coder-30B-Instruct-UD-Q3_K_XL` | **~30** clean / 27.0 evening @moe12 | 32k | — | **main agent coder** — won the 2026-08-06 quant race; moe12 verified evening 08-07 + clean 08-08 |
 | `GLM-4.7-Flash-UD-Q4_K_XL` | **21.5** @moe22 | 24k | reasoning | quality coder (opencode subagents); KV fix + moe22 ✓ verified clean 08-08 |
+| `GLM-4.7-Flash-UD-Q3_K_XL` | **26.0** @moe12 (2.0 daytime baseline; ~28 clean) | 24k | reasoning | **fast coder** — re-added 09-21 because Q4's 21.5 dragged in agent loops; 3-bit, evening-safe at moe12 (13.4 used / 3.8 free @2.0); Q4 stays for hard reviews |
 | `Qwen3-Coder-Next-UD-IQ3_XXS` | 16.0 | **128k** | 80B-A3B | long-session coder (128k ctx) |
 | `Qwen3.8-27B-UD-IQ3_XXS` | 14.5 (10.9 w/o MTP) | 24k | vision, MTP, hybrid reasoner | ⚠ **clean-desktop specialty** (kept 09-10 over the ≥22 gate) — dense-27B quality, slow: its Gated-DeltaNet layers are Vulkan-bound (prefill ~30). 2.5 GB free @1.6 baseline @24k (✓ 09-10); **never on a busy evening desktop** (~1 GB free = GTT freeze) |
 | `Qwen3-Embedding-0.6B` | 33 (CPU) | 8k | CPU-only, `/v1/embeddings` | RAG/search embedder (not a chat model) |
+| `Ornith-1.5-35B-A3B-IQ3_XXS` | **32.1** @moe16 | 24k | MTP, vision, thinking | **agentic coder** (added 09-21) — Qwen3.5-MoE derivative claiming +15 Terminal-Bench / +5.6 SWE-bench over Qwen3.6-35B; the only coder with MTP; 13.8 used / 3.3 free @2.0 |

 Expected run-to-run spread: MTP models swing ±15% with draft **acceptance rate** (content-
 dependent); CPU-heavy presets (Coder-Next, embedder) dip under daytime CPU contention.
@@ -72,6 +74,11 @@ Treat clean night runs as the reference; don't retune on daytime deltas.

 - **Agent coding loops** (edit/test cycles): `Qwen3-Coder-30B` — best speed/quality balance at 32k.
 - **Hard code, reviews, tricky bugs**: `GLM-4.7-Flash` — strongest 30B-class coder, slightly slower.
+- **GLM at agent-loop speed**: `GLM-4.7-Flash-UD-Q3_K_XL` — same model, 3-bit, ~28 t/s; pick it
+  when the Q4's 21 t/s drags, keep Q4 for the review that has to be right.
+- **Agentic coding with reasoning** (⚗ new, judge over the next weeks): `Ornith-1.5-35B-A3B` —
+  Qwen3.5-MoE derivative, 32 t/s *with* MTP and a thinking preamble (~4 s TTFT), vision. If its
+  launch numbers hold in practice it displaces GLM/Coder-30B for agent loops.
 - **Marathon sessions / huge conversation history**: `Qwen3-Coder-Next` — 128k ctx at only
  6 GB VRAM (hybrid attention). Caveat: ~33 t/s prefill means it's for *growing* sessions
  (`cache-reuse` makes turns incremental), **not** for cold-dumping 100k tokens.
@@ -131,6 +138,8 @@ the router, but chats/presets saved against the old id need re-picking.
 2026-08-16: `Qwen3.8-27B-UD-IQ3_XXS` (⚗ candidate) added to all six client files.
 2026-09-10: kept as ⚠ clean-desktop specialty after the gate bench finally ran on the v3 gguf
 (14.5 t/s MTP / 10.9 base, 2.8 GB free @1.5); server ctx restored to 24576 = client ctx, no client edits.
+2026-09-21: `GLM-4.7-Flash-UD-Q3_K_XL` (⚡ fast coder) added to all six client files next to the Q4.
+2026-09-21: `Ornith-1.5-35B-A3B-IQ3_XXS` (agentic coder, thinking + vision) added to all six client files after passing its gate (32.1 t/s @moe16).

 ## Tuning cheat-sheet