On-Device AI for Apple Silicon: uzu & Models | Mirai Labs

trymirai.com

Mirai Labs builds uzu, a Rust LLM engine for iPhone, iPad and Mac, and 4-bit/8-bit Qwen, LFM and Muse-Glimmer models benchmarked vs MLX and llama.cpp.