gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

💻🤖 Gemma4-12B **v2** — Coding + Agentic Edition ✨ 🐣 Tiny footprint, big brain — a local **coding & tool-using agent** for *everyone* **No matter your GPU. No matter your RAM.** With **~4.5 GB** of VRAM *or* unified memory free, you can run your own private, offline coding **agent** right now. 🚀 v2 is the big **agentic** upgrade — it reads, reasons, *uses tools*, and works through multi-step technical tasks before it acts. 🧠🛠️ All local, all yours, no API, no cloud. 📊 The headline — it works as an agent (tau2-bench) v2 is built for **coding + agentic** work — writing code, running commands, using tools, debugging, multi-step technical tasks. The clearest signal is **tau2-bench `telecom`**, an agentic tool-use benchmark whose diagnose → fix → verify* loop mirrors real terminal/debugging work: | tau2-bench **telecom** · 20 tasks · local, same harness, **all Q8_0** | score | |---|---| | official `gemma-4-12B-it` (base) | **~15%** | | 🟢 **Gemma4-12B v2 (this model)** | **~55%** | → Roughly **3.5× higher** than the base model on technical-agentic tasks. 🎯 **Want the full story** — *why* telecom, how* the two models fail differently, the honest caveats, and the trade-offs (including general knowledge)? It's all broken down further below. 👇** 🚀 Announcements 📌 Hitting a problem? Please check my pinned discussion first.** **~99% of issues are a client/sampler config, not the weights** — and they have a quick fix there. For example: garbled or **repeating `0000…`** output almost always means **no repetition penalty** (set `rep_pen 1.1`, `temp 1.0`); and leaked ` ` / ` ` tokens mean your front-end isn't parsing Gemma 4's **native tool format** (use llama.cpp `--jinja`). If your question isn't covered, don't hesitate to open a discussion** — I read them and reply as fast as I can. 💬 📦 No Q2_K this release.** I finished a Q2_K (imatrix) build, but it didn't hold up under real stress-testing, so I'm holding it back — **I only ship a quant once I'm confident it's genuinely good.**