#LLM

Gradience: a tool that audits whether your LoRA rank is actually necessary

An introduction to Gradience, a tool that quantifies whether a LoRA rank setting is excessive using singular value decomposition. In experiments on Mistral-7B, halving the rank improved accuracy.

Kimi K2.5: A 1-trillion-parameter MoE native multimodal agent model

An overview of Kimi K2.5’s technical highlights from Moonshot AI: a 1T-parameter MoE architecture, the MoonViT vision encoder, Agent Swarm (PARL), benchmark results, and more.

Not All Bits Are Equal: There is no universal solution for memory allocation in reasoning models

How should memory be allocated in reasoning models? This paper explains the trade-offs among quantization, KV cache, and test-time compute, based on 1,700 experiments.

Official guides for Claude Code best practices and the Agent SDK

Anthropic published official guides on how to use Claude Code effectively and how to build agents with the Agent SDK. This article summarizes the key points from both.

Building a Talkable AI Environment (3): Character Setup

Comparing how to give AI characters personality across the Gemini, Claude, and OpenAI APIs — covering System Prompts, Prefill, and structured output.

RAG: Building an Internal Help Desk with Mac mini M4 Pro + Dify (2025, Part 1)

A plan to build an internal help desk RAG system using a Mac mini M4 Pro and Dify. Highlights what's new in Dify circa 2025 and tips for running local LLMs.

Setting Up LLM/RAG for Work, So I Tried LoRA Training on the Side (Part 1)

Introducing a Mac mini M4 Pro to build an in-house RAG system. A plan for setting up a LoRA training environment during downtime while waiting for specs to be finalized.