The M-series is just so phenomenal for AI. Mixtral is my MacBook's daily driver, and will try the 8x22B variant soon. Being capable of that on a $3k-$4k laptop still blows my mind. I'm glad that Apple's leaning into AI.
(Aside: Apple's MLX framework is showing nice performance gains over PyTorch on their silicon. I'm excited to see that project evolve.)
(Aside: Apple's MLX framework is showing nice performance gains over PyTorch on their silicon. I'm excited to see that project evolve.)