ইনফারেন্স, ডিপ্লয়মেন্ট ও রানটাইম
Xorbits Inference (Xinference)
xorbitsai/inference
A powerful and versatile library designed to serve language, speech recognition, and multimodal models. It allows users to swap GPT for any LLM by changing a single line of code and run models on cloud, on-prem, or locally via a unified, production-ready inference API.
★ 9.5K⑂ 853Python