[Sync] LLM clients → Qwen3.6-35B-A3B-Thinking default, Ornith preset, fl GPU monitor abbrs
Re-export of private HEAD 73b4a65: default-model flip + 8k thinking budget in the aichat/opencode/pi client configs, the Ornith-1.5-35B-A3B preset and its gate bench in fl/.config/llamacpp, and the fl fish abbrs `vram` / `vramx` with the new gpumon.sh (sysfs VRAM/GTT monitor).
This commit is contained in:
1 parent
2fa113cd15
commit
93b4f695ce
15 files changed
+340
-18
No files matched your search
@@ -1,2 +1,11 @@
|
||||
# fl runs the llama.cpp router as a systemd service (llama.service) — no shell abbr needed.
|
||||
# fl runs the llama.cpp router as a systemd service (llama.service) — no launch abbr needed.
|
||||
# Presets: ~/.config/llamacpp/config.ini; see ~/.config/llamacpp/README.md.
|
||||
|
||||
## GPU monitors — the RX 7600 XT also drives the display, so VRAM headroom is a safety matter
|
||||
## (config.ini header: keep ≥ 2.5 GB free; GTT growth = VRAM spilling to RAM = the freeze precursor).
|
||||
# vram : quick rocm-smi % view + who holds the render node. fuser prints its table on STDERR,
|
||||
# so it must be 2>&1 — with 2>/dev/null the "LLM GPU usage" section is always empty.
|
||||
abbr vram 'watch -c -d -n 1 \'echo "=== VRAM ==="; rocm-smi --showmemuse --showuse 2>/dev/null | grep -E "GPU use|Allocated|Read/Write"; echo ""; echo "=== LLM GPU usage ==="; fuser -v /dev/dri/renderD128 2>&1 | grep -iE "COMMAND|llama"\''
|
||||
# vramx: absolute GiB used/free + GTT + temp straight from amdgpu sysfs (no ROCm), per-process VRAM
|
||||
# via fdinfo, and which preset the router has resident. Body = gpumon.sh (runs bare too).
|
||||
abbr vramx 'watch -c -d -n 1 ~/.config/llamacpp/gpumon.sh'
|
||||
Reference in new issue
Block a user