GhostOS – Lightweight, Offline Desktop AI Assistant (macOS/Win/Linux) (github.com)

GhostOS has launched as a lightweight, offline desktop AI assistant compatible with macOS, Windows, and Linux, designed to run smoothly on low-spec devices with just 4GB to 8GB of RAM. This innovative tool aims to tackle the resource-heavy demands of current local AI platforms, which often suffer from high memory consumption and operational failures due to "out-of-memory" issues. GhostOS provides a unique solution with a minimal memory footprint of approximately 35MB and features like a dynamic VRAM juggler that efficiently manages resources among different AI models, ensuring that peak VRAM usage stays below 3.5GB. This development is significant for the AI/ML community as it democratizes access to powerful AI tools on less capable hardware while prioritizing user privacy with zero telemetry and full offline functionality. Users can drag-and-drop files for instant indexing without requiring bulky external databases, benefiting from a user-friendly companion named Casper that interacts in real-time and learns from individual user preferences. With features ranging from inline ghostwriting and code diagnostics to structured meeting notes for virtual calls, GhostOS enriches the productivity landscape, making advanced AI capabilities more accessible and practical for everyday use.