I made an open-web protocol for local LLM storage sharing (joshuadd79.github.io)

A new open-web protocol for local LLM (Large Language Model) storage sharing has been introduced, powered by the Bring Your Own Brain (BYOB) framework. This platform enables AI-driven gaming to leverage local hardware, operating through a browser extension or web fallback. The protocol emphasizes resiliency by implementing design principles—such as ensuring games remain playable without AI, allowing immediate player interaction without delay, and preventing blocking of the event loop—to enhance performance across varying hardware capabilities. This development is significant for the AI/ML community as it represents a step towards making AI more accessible and performant in user-driven environments, particularly in gaming. The BYOB framework utilizes a queue system prioritizing compute tasks, employs cancellation strategies to manage GPU resources efficiently, and includes methods for validating AI-generated text. By addressing the challenges of local AI inference, BYOB could potentially transform the way interactive experiences are developed, enabling richer, more responsive gameplay while minimizing reliance on centralized compute resources.