Coja
93b4f695ce
Re-export of private HEAD 73b4a65: default-model flip + 8k thinking budget in the aichat/opencode/pi client configs, the Ornith-1.5-35B-A3B preset and its gate bench in fl/.config/llamacpp, and the fl fish abbrs `vram` / `vramx` with the new gpumon.sh (sysfs VRAM/GTT monitor).
12 lines
1.0 KiB
Fish
12 lines
1.0 KiB
Fish
# fl runs the llama.cpp router as a systemd service (llama.service) — no launch abbr needed.
|
|
# Presets: ~/.config/llamacpp/config.ini; see ~/.config/llamacpp/README.md.
|
|
|
|
## GPU monitors — the RX 7600 XT also drives the display, so VRAM headroom is a safety matter
|
|
## (config.ini header: keep ≥ 2.5 GB free; GTT growth = VRAM spilling to RAM = the freeze precursor).
|
|
# vram : quick rocm-smi % view + who holds the render node. fuser prints its table on STDERR,
|
|
# so it must be 2>&1 — with 2>/dev/null the "LLM GPU usage" section is always empty.
|
|
abbr vram 'watch -c -d -n 1 \'echo "=== VRAM ==="; rocm-smi --showmemuse --showuse 2>/dev/null | grep -E "GPU use|Allocated|Read/Write"; echo ""; echo "=== LLM GPU usage ==="; fuser -v /dev/dri/renderD128 2>&1 | grep -iE "COMMAND|llama"\''
|
|
# vramx: absolute GiB used/free + GTT + temp straight from amdgpu sysfs (no ROCm), per-process VRAM
|
|
# via fdinfo, and which preset the router has resident. Body = gpumon.sh (runs bare too).
|
|
abbr vramx 'watch -c -d -n 1 ~/.config/llamacpp/gpumon.sh'
|