Open Internet by MindsNet

Omlx

Omlx: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar Language: Python. Stars: 13,877. Trending on GitHub this week.

Computing & Technology, Computer Science, Artificial Intelligence