Ringkasan
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Persyaratan, instalasi, dan mulai cepat
Persyaratan instalasi tidak tercantum dalam metadata repositori.
Penggunaan
Penggunaan tidak dicantumkan dalam metadata repositori.
Kompatibilitas model dan kasus penggunaan
Kompatibilitas model tidak tercantum dalam metadata repositori.
Catatan lisensi dan risiko
Apache-2.0
ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending. Quality score was recomputed from live GitHub repository facts on 2026-08-22 UTC using the seven-dimension channel formula.