Overview
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Requirements, installation and quick start
Installation requirements are not stated in the repository metadata.
Usage
Usage is not stated in the repository metadata.
Model compatibility and use cases
Model compatibility is not stated in the repository metadata.
License and risk notes
Apache-2.0
ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending. Quality score was recomputed from live GitHub repository facts on 2026-08-22 UTC using the seven-dimension channel formula.