ToolAI.io · Kanal GitHub

Inferensi, Deployment & Runtime · Proyek AI sumber terbuka di GitHub

Indeks berbasis fakta untuk proyek pengembangan LLM, agen, MCP, RAG, dan AI, dengan lisensi, pengaturan, unduhan, tangkapan layar, dan sumber daya terkait untuk setiap entri.

Tag populer Agen LLM RAG MCP Pemrograman Inferensi Pemanggilan alat Embeddings Basis data vektor Multimodal Fine-tuning Evaluasi Buka kode sumber Dihosting sendiri Python TypeScript Rust Suara Visi Alur kerja

Data repositori publik

Indeks proyek

3 Proyek
Tangkapan layar Xorbits Inference (Xinference)
Inferensi, Deployment & Runtime

Xorbits Inference (Xinference)

xorbitsai/inference

A powerful and versatile library designed to serve language, speech recognition, and multimodal models. It allows users to swap GPT for any LLM by changing a single line of code and run models on cloud, on-prem, or locally via a unified, production-ready inference API.

★ 9,5K⑂ 853Python
Apache-2.0Q98
Tangkapan layar hal0
Inferensi, Deployment & Runtime

hal0

hal0ai/hal0

An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.

★ 68⑂ 7Python
Apache-2.0Q89
Inferensi, Deployment & Runtime

jan

janhq/jan

A local AI chat application for running models on a personal computer.

★ 44,3K⑂ 3KTypeScript
Lisensi tidak terdeteksiQ80

Baru diperbarui

TypeSafe Python SDKtypesafe-ai/typesafe-sdk-python★ 218 TypeSafe JavaScript SDKtypesafe-ai/typesafe-sdk-js★ 231 TypeSafe Agent Skillstypesafe-ai/skills★ 2K cherry-studioCherryHQ/cherry-studio★ 51,5K onyxonyx-dot-app/onyx★ 32K siyuansiyuan-note/siyuan★ 46,2K

Paling banyak diberi bintang

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K