Tech Jan 31, 2026 4 min Gradience: a tool that audits whether your LoRA rank is actually necessary An introduction to Gradience, a tool that quantifies whether a LoRA rank setting is excessive using singular value decomposition. In experiments on Mistral-7B, halving the rank improved accuracy. LoRA Machine Learning LLM Fine-Tuning
