DiffusionGemma is Google's first open-weight diffusion language model — text generated by denoising blocks in parallel instead of one token at a time. How it differs from autoregressive Gemma, the real speed win and the honest benchmark tax, and exactly what it takes to run the thing on your own GPU.
Local-Llm
-
DiffusionGemma: When the LLM Stops Writing Left to Right -
Local Speech-to-Text With Whisper A deep technical guide to running OpenAI's Whisper ASR model entirely on your own hardware — covering architecture, model size trade-offs, every major implementation, GPU sizing, quantization, VAD, speaker diarization, and real command examples.
-
Making Tool Calling Reliable on Local Models Locally-hosted open models frequently botch function calls in ways cloud APIs hide. This post diagnoses every failure mode and walks through the concrete reliability stack — constrained decoding, correct chat templates, validate-retry loops, and measurement — that actually fixes it.
-
Preserving a Voice: Fine-Tuning a Local LLM on a Loved One's Writing A careful, end-to-end guide to building a private, local language model that writes in a late parent's voice — from recovering and cleaning years of blog posts, to QLoRA fine-tuning on an RTX 5090, to grounding it with retrieval, packaging it as a GGUF, and sharing it with siblings over Tailscale. Includes the honest limits and the ethics that should shape every decision.
-
Hermes Agent Comes to the Desktop: Install, Optimization, and the Best Local Models Nous Research just shipped Hermes Desktop, a native front end for its self-improving Hermes Agent. A hands-on guide to installing it, wiring it to local models via Ollama, choosing the right model for agentic tool use, and tuning the whole thing for real work.
-
Jan: The Open-Source Local LLM Runner Coming for Ollama and LM Studio Jan bundles a chat UI, a model hub, and an OpenAI-compatible server on top of a Cortex/llama.cpp engine — Apache 2.0, no account, no telemetry. A hands-on look at where it beats Ollama and LM Studio, where it doesn't, and how to tune it.
-
The Local Coding Agent Stack: Aider, Continue, Cline, and OpenHands Pure-local and BYOK coding assistants compared head-to-head: architecture, model support, what works at the 32B–70B tier, and where each tool breaks down in practice.
-
Hermes Agent: Setup, Local Models, and How It Compares to OpenClaw Hermes Agent from Nous Research has quietly become the fastest-growing open-source agent framework of 2026. This is a hands-on setup guide — including Ollama configuration for fully local operation — a head-to-head comparison with OpenClaw, and a tour of the other agentic frameworks worth watching.
-
Google's TurboQuant: What It Means for Home AI Enthusiasts Google Research's TurboQuant compresses LLM KV cache memory by 4–5x with minimal accuracy loss. Two weeks in: real benchmarks, active framework integrations, controversies, and what you can actually run today.
-
OpenClaw: The Complete Guide to Self-Hosted AI Agents Everything you need to know about OpenClaw — the open-source, self-hosted AI agent that connects your messaging apps to real-world actions. Covers its origins and confusing rename history, the architecture, deployment on Docker, Mac mini, and a VPS, running it against local models with Ollama, the SOUL.md policy system, the serious security incidents you must understand before deploying, and an honest comparison against Claude Code.