Overview
A high-throughput and memory-efficient inference and serving engine for LLMs
Requirements, installation and quick start
Installation requirements are not stated in the repository metadata.
Usage
Usage is not stated in the repository metadata.
Model compatibility and use cases
Model compatibility is not stated in the repository metadata.
License and risk notes
Apache-2.0
ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending.