Tested on M1 Max 64GB with MLX: LLaMA Pro-style block expansion on Qwen3-0.6B-Base vs LoRA vs full FT, trained on 722 blog posts. Held-out PPL drops 14.7 to 10.5, but Wikipedia-ja rises 13.5 to 17.9, more forgetting than full FT. A 20% Wikipedia mix nearly removes it, and renumbering 28-layer LoRA keys reproduces the Anima-2.9B result in numbers.
Tested on M1 Max 64GB: Qwen3.8-27B hits ~19 tok/s on both MLX and Ollama, but the default reasoning_effort=xhigh blew thinking up to 50,373 chars. Why Ollama dodges it.
Tested on M1 Max 64GB: hooked Qwen3.6-35B-A3B's MoE router in mlx-lm, pre-warmed the top-20 hot experts, still ~62 tok/s vs plain mmap cache. Plus the Metal OOM on Qwen3.5-122B.
Measured on M1 Max 64GB: weight-only INT8 runs 41% slower than fp16, a hand-written Metal int8 GEMM 15.6x slower, MPSMatrix int8 3x, and MLX 8-bit 9% slower.
Tested LFM2.5-1.2B-JP-202606 on M1 Max 64GB. llama.cpp Q4_K_M: 208 tok/s decode, JSON intact, model name hallucinated (LFM→FDM). Q8_0: 157 tok/s, no hallucination. Tool calls broken via GGUF.
oMLX 0.3.9.dev2 release notes from the angle of Codex/Copilot on Mac local LLMs: Gemma 4 VLM MTP, DFlash, omlx launch copilot, SSD KV cache — what each changes for agent workflows.
Tested Klein 9B + 9B NSFW LoRA on M1 Max 64GB via mflux 0.17.5: 1m51s/512, 5m37s/1024 q4, 224/224 LoRA keys match, NSFW prompts uncensored, Japanese subjects work with helper tokens.
Tested Gemma 4 MTP drafter on M1 Max 64GB with mlx-vlm 0.5.0. Only the 26B A4B MoE got +13%; 31B Dense and E4B got slower. Code gen vs short haiku prompts flip the result.
Klein 4B / 9B / Base LoRAs aren't cross-compatible — a 9B NSFW LoRA throws 'lora key not loaded' on mflux's 4B path. The variant map, what mflux runs today, and where the working hands-on test lives.
Pruna AI's FP8 speedup needs compute capability 8.9, so Apple Silicon is out. Measured what M1 Max 64GB actually does with MLX-based mflux and antirez's iris.c: install traps, real generation times, and a wrapper kit to skip the setup.
Hands-on running inclusionAI Ling-flash-2.0 (100B / 6.1B active, MXFP4 quant, 54.7GB) on SwiftLM via mlx-swift-lm on an M1 Max 64GB. Covers bailing_moe + MXFP4 support check in mlx-swift, the startup surprise, and what --stream-experts actually saves.
