🤖 Apple Introduces the AFM 3 Model Family
Apple has released the third generation of its Apple Foundation Models (AFM 3), including the multimodal AFM 3 Core Advanced. Thanks to an innovative architecture where 20B parameters are stored in flash memory and only 1–4B are activated upon request, the model achieves the speed of a 3B model with the quality of a 20B model.
🌍 Apple is setting a new standard for MoE (Mixture-of-Experts) optimization for consumer devices by implementing an efficient NAND-to-DRAM method and utilizing prompt-level routing instead of token-level routing.
👤 Your iPhone and Mac will be able to run powerful AI agents locally, ensuring high speed and data privacy despite limited RAM capacity.
Source 1: https://machinelearning.apple.com/research/introducing-third-generation-of-apple-foundation-models