AI News
I Let a Small Model Train on Its Own Mistakes. It Reached 80% on HumanEval and Beat GPT-3.5 on Math
“`html I Let a Small Model Train on Its Own Mistakes. It Reached 80% on HumanEval and Beat…
AI News
Gemma4 26b MoE running in MLX with turboquant (and custom kernel)
“`html A British AI enthusiast, maddie-lovelace, has successfully run the 26b-parameter Gemma MoE model on their MacBook Air…
AI News
China modded GPU (eg. 4090 48gb) –> I’m gonna figure it out. IS THERE NO ONE ELSE CURIOUS??
“`html There is a notable lack of information in English about Chinese-modded NVIDIA GPUs, particularly the RTX 4090…
AI News
2 old RTX 2080 Ti with 22GB vram each Qwen3.6 27B at 38 token/s with f16 kv cache
**What Happened:** A user named **snapo84** shared their current AI model setup on r/LocalLLaMA. They are running two…
AI News
I just bought Asus Ascent : Nvidia GB10 (DGX) and It is slower than my Ryzen Ai Max
“`html I just read a post on Reddit where someone mentioned they purchased an Asus Ascent with the…
AI News
Evaluated a RAG chatbot and the most expensive model was the worst performer. Notes on what actually moved the needle.
We had a customer support RAG bot. Standard setup: ChromaDB, system prompt, an LLM doing generation. Nobody had…
AI for Business
Business
Are the rich RAM /poor GPU people wrong here?
“`html Hello Guys, I know everyone has their own definition of local models, but for me I see…
AI News
ByteDance-Seed/Cola-DLM · Hugging Face
**What Happened:** A new model named **Cola DLM** has been made available by ByteDance-Seed on the Hugging Face…
AI News
[FOUNDING] SupraLabs – real open-source AI models for you!
**What Happened:** A new British AI research company called SupraLabs has been founded and is now offering a…
AI News
China modded GPU (eg. 4090 48gb) –> I’m gonna figure it out. IS THERE NO ONE ELSE CURIOUS??
“`html The post highlights a lack of information about Chinese-modified GPUs, particularly the RTX 4090 with 48GB memory.…