Open Internet by MindsNet
Bonsai Demo
Repository: PrismML-Eng/Bonsai-demo Stars: 2031 Forks: 200 Primary language: Shell Discovery sources: trending:weekly Selection score: 75.82 Usefulness score: 9.7 Source confidence score: 3.5 Languages: Shell, Python, PowerShell Topics: bonsai, llamacpp, llm, mlx, prism-ml, small-models Summary: Bonsai Demo README excerpt: # Bonsai Demo <p align="center"> <img src="./assets/bonsai-logo.svg" width="280" alt="Bonsai"> </p> <p align="center"> <a href="https://prismml.com"><b>Website</b></a> | <a href="https://github.com/PrismML-Eng/Bonsai-demo"><b>GitHub</b></a> | <a href="https://discord.gg/prismml"><b>Discord</b></a> </p> <p align="center"> <b>HF Collections:</b> <a href="https://huggingface.co/collections/prism-ml/bonsai-27b">Bonsai 27B</a> 路 <a href="https://huggingface.co/collections/prism-ml/bonsai">Bonsai (1-bit)</a> 路 <a href="https://huggingface.co/collections/prism-ml/ternary-bonsai">Ternary-Bonsai</a> </p> <p align="center"> <b>Whitepapers:</b> <a href="bonsai-27b-whitepaper.pdf">Bonsai 27B</a> 路 <a href="1-bit-bonsai-8b-whitepaper.pdf">1-bit Bonsai 8B</a> 路 <a href="ternary-bonsai-8b-whitepaper.pdf">Ternary-Bonsai 8B</a> </p> --- Using this demo repository you can run **Bonsai** (1-bit) and **Ternary-Bonsai** language models locally on Mac (Metal), Linux/Windows (CUDA, Vulkan, ROCm), or CPU. ## 馃尡 New: Bonsai 27B The family's newest and largest generation, and its first **vision-language** models ([Bonsai 27B collection](https://huggingface.co/collections/prism-ml/bonsai-27b)): - **Vision:** send photos, screenshots, and PDFs; ask about them (see [VISION.md](VISION.md)). - **Agentic tool calling:** native OpenAI-style `tool_calls` with full round-trips, plus MCP servers in both demo UIs (see [TOOLS.md](TOOLS.md)). - **Thinking:** a reasoning model; pick the reasoning effort per chat in the UI or budget it per request. - **Long context:** 256k+ token conversatio
Computing & Technology, Computer Science, Artificial Intelligence