Show HN: PoC to use the Chrome Prompt API on other people's machine (datm.nl)

A new proof-of-concept (PoC) leverages the Chrome Prompt API to facilitate interactive chat sessions on various systems, allowing users to engage in conversations with messages from random individuals. This innovative approach downloads a substantial 4GB large language model (LLM) to the local machine, enabling real-time message processing without any imposed censorship. Users can activate the tool with a simple load button, which can be employed at any interaction point on a website, including common prompts like cookie banners. The significance of this development lies in its implications for privacy and ethical considerations within the AI and machine learning community. By allowing direct interaction with messages from others without consent, it raises important questions about data security and user anonymity. Moreover, this PoC highlights the growing trend of utilizing powerful AI models in everyday web applications, pushing the boundaries of what is possible with client-side AI processing while also emphasizing the need for responsible AI deployment.