ToolAI.io · Kanal GitHub

Inferensi, Deployment & Runtime · Proyek AI sumber terbuka di GitHub

Indeks berbasis fakta untuk proyek pengembangan LLM, agen, MCP, RAG, dan AI, dengan lisensi, pengaturan, unduhan, tangkapan layar, dan sumber daya terkait untuk setiap entri.

Data repositori publik

Indeks proyek

4 Proyek
Tangkapan layar Xorbits Inference (Xinference)
Inferensi, Deployment & Runtime

Xorbits Inference (Xinference)

xorbitsai/inference

A powerful and versatile library designed to serve language, speech recognition, and multimodal models. It allows users to swap GPT for any LLM by changing a single line of code and run models on cloud, on-prem, or locally via a unified, production-ready inference API.

★ 9,5K⑂ 853Python
Apache-2.0Q98
Tangkapan layar hal0
Inferensi, Deployment & Runtime

hal0

hal0ai/hal0

An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.

★ 68⑂ 7Python
Apache-2.0Q89
Inferensi, Deployment & Runtime

DeepInfer

deepseek-ai/DeepInfer

DeepSeek’s own high-performance inference framework, open-sourced for offline inference of DeepSeek-V4.1-Flash on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs.

★ 25,7K⑂ 3,2KPython
Apache-2.0Q82
Inferensi, Deployment & Runtime

jan

janhq/jan

A local AI chat application for running models on a personal computer.

★ 44,3K⑂ 3KTypeScript
Lisensi tidak terdeteksiQ80

Baru diperbarui

Craft Anythingstorytold/craft-anything★ 27,4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15,6K DeepInferdeepseek-ai/DeepInfer★ 25,7K ComfyUIComfy-Org/ComfyUI★ 136,7K CrewAICrewAIInc/crewAI★ 59,5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Paling banyak diberi bintang

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K