Try On-Device AI with FM (eclecticlight.co)

Apple has announced a new on-device AI feature for Macs, allowing users to interact with its Foundation Model (AFM 3 Core) directly through the Terminal using a command called "fm." This development emphasizes Apple’s commitment to privacy by enabling AI processing locally rather than relying on cloud services, although future off-device tasks may carry a cost. Currently, users with Macs equipped with M3 chips and at least 12 GB of memory can begin exploring this feature, which does not require programming skills. The significance of this announcement lies in its potential to enhance user privacy and performance while simplifying access to AI capabilities. Although the initial responses from the AI have limitations—struggling with basic queries and often generating incorrect answers—it demonstrates a structured reasoning process when utilized in "Chat mode." Users can guide its responses with specific instructions, increasing the likelihood of obtaining accurate information. This development represents a significant step toward more powerful and user-friendly on-device AI, highlighting a growing trend within the AI/ML community to prioritize local data processing and enhance user control over their interactions with technology.