Hybrid Compute in Perplexity Computer (twitter.com)

Perplexity has announced the integration of hybrid compute capabilities into its Perplexity Computer, now available in the Perplexity Mac app. This innovation enables users to initiate tasks in the cloud and seamlessly transition to a local model running on their Mac for sensitive operations, such as handling private files. By orchestrating between powerful cloud models for tasks like search, planning, and reasoning and local computations for privacy-sensitive steps, this feature enhances both performance and security. This development is significant for the AI/ML community as it addresses a growing concern about data privacy in cloud computing. Users can benefit from the computational power of cloud resources while maintaining control over sensitive data that never leaves the local machine. The ability to merge outputs from both cloud-based and local models opens up new possibilities for creating applications that prioritize user data security without sacrificing the efficiency of AI-driven processes.