Chrismccord/Web - shell command for simple LLM web browsing (github.com)

🤖 AI Summary
Chrismccord/Web is a lightweight, shell-first web browser designed to make live web content consumable and interactable by LLMs and agent pipelines. Packaged as a single native Go binary (no runtime deps), it converts HTML to markdown, executes arbitrary JavaScript, takes full-page screenshots, fills and submits forms, and persists session profiles (cookies/auth) across runs. It auto-downloads a headless Firefox engine on first use, supports raw HTML output or truncated markdown, and exposes CLI flags like --js, --screenshot, --form, --profile and --after-submit. Binaries can be built for macOS (arm64/amd64) and Linux x86_64; builds require Go 1.21 and ~100MB free for Firefox assets. The tool is MIT-licensed. This matters for the AI/ML community because it bridges dynamic, interactive web content and LLM consumption without heavyweight dependencies: JS execution and full browser rendering let LLMs access SPAs and dynamic pages, while HTML→markdown conversion optimizes prompts and token usage. Special handling for Phoenix LiveView (auto-detect via data-phx-session, waits for .phx-connected and loading states, LiveView-aware form submissions) enables reliable scraping and interaction with realtime apps and authentication flows. For RAG systems, agents, or evaluation frameworks, Web simplifies retrieval, authenticated browsing, and interactive workflows into a reproducible CLI tool that can be embedded in pipelines or deployed cross-platform.
Loading comments...
loading comments...