ToolAI.io · Canale GitHub

Inferenza, distribuzione e runtime · Progetti AI open source su GitHub

Un indice basato sui fatti di progetti di sviluppo LLM, agenti, MCP, RAG e AI, con licenza, configurazione, download, screenshot e risorse correlate per ogni voce.

Dati del repository pubblico

Indice del progetto

3 Progetti
Screenshot di Hugging Face Transformers
Inferenza, distribuzione e runtime

Hugging Face Transformers

huggingface/transformers

A model-definition framework for state-of-the-art machine learning models across text, vision, audio, and multimodal domains, supporting both inference and training.

★ 163,3K⑂ 34,1KPython
Apache-2.0Q98
Inferenza, distribuzione e runtime

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 32,2K⑂ 8,1KPython
Apache-2.0Q98
Screenshot di Xorbits Inference (Xinference)
Inferenza, distribuzione e runtime

Xorbits Inference (Xinference)

xorbitsai/inference

A powerful and versatile library designed to serve language, speech recognition, and multimodal models. It allows users to swap GPT for any LLM by changing a single line of code and run models on cloud, on-prem, or locally via a unified, production-ready inference API.

★ 9,5K⑂ 853Python
Apache-2.0Q98

Aggiornato di recente

TypeSafe Python SDKtypesafe-ai/typesafe-sdk-python★ 218 TypeSafe JavaScript SDKtypesafe-ai/typesafe-sdk-js★ 231 TypeSafe Agent Skillstypesafe-ai/skills★ 2K cherry-studioCherryHQ/cherry-studio★ 51,5K onyxonyx-dot-app/onyx★ 32K siyuansiyuan-note/siyuan★ 46,2K

I più stellati

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K