Apple has new Mac app coming to make running local AI models easy (9to5mac.com)

Apple is reportedly developing a new Mac application called Harbor, designed to simplify the process of running local AI models on Mac devices. Leaked by prominent leaker Aaron Perris, Harbor will convert Macs into private AI inference servers, allowing users to run open-weight models without sending data to the cloud. This initiative aligns with Apple’s push to enhance the functionality of Macs for AI applications amidst rising popularity, particularly with models like the MacBook Neo and Mac Studio. Harbor distinguishes itself with several key features, including the ability to form a cluster of Mac computers via Thunderbolt 5, pooling their unified memory to handle larger models and increased concurrency. Its user-friendly setup promises a seamless experience, allowing users to connect devices, download models directly, and manage them without extensive technical knowledge. Currently in private preview under Apple's Claris brand, Harbor is expected to launch publicly soon, marking a significant development within the AI/ML community by enabling more users to leverage local computing power for AI tasks effectively.