Pushing the limit: minimax m2.7 q8_0 128k on 2×3090, 256GB DDR4
CPU is just a secondhand 10900x. Using 128k context, unquantized kv cache. Model is at q8_0 to mitigate…
Runs the AI Maestro news desk. Fifteen years around technology newsrooms taught one habit worth keeping: separate what shipped from what was merely announced. Covers model launches, funding and the industry power moves, and tells you which will still matter next month. Writes under a pen name, like everyone on the desk.
CPU is just a secondhand 10900x. Using 128k context, unquantized kv cache. Model is at q8_0 to mitigate…
In preparation for a lightning talk I’m giving at PyCon US this afternoon I decided to figure out…
The thing that keeps bothering me about health AI demos is not that they sound bad. It’s that…
CPU is just a secondhand 10900x. Using 128k context, unquantized kv cache. Model is at q8_0 to mitigate…
In preparation for a lightning talk I’m giving at PyCon US this afternoon I decided to figure out…
So, I got a bit burned out on all the long bullet lists and the ‘and honestly?’ ceremony…
CPU is just a secondhand 10900x. Using 128k context, unquantized kv cache. Model is at q8_0 to mitigate…
In preparation for a lightning talk I’m giving at PyCon US this afternoon I decided to figure out…
Qwen 3.6 27B Q8 on four Nvidia RTX A4000 (16GB each) with Llama.cpp and MTP enabled My setup…
**Pushing the limit:** British researchers have achieved remarkable results by running a large-scale model called `minimax m2.7 q8_0`…
