추론, 배포 및 런타임
ollama
ollama/ollama
A tool for running and managing large language models locally.
★ 180.2K⑂ 17.7KGo
ToolAI.io · GitHub 채널
추론, 배포 및 런타임 · GitHub의 오픈 소스 AI 프로젝트
각 항목에 라이선스, 설정, 다운로드, 스크린샷 및 관련 리소스를 제공하는 LLM, 에이전트, MCP, RAG 및 AI 개발 프로젝트의 사실 기반 색인입니다.
공개 리포지토리 데이터
프로젝트 색인
추론, 배포 및 런타임
hal0
hal0ai/hal0
An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.
★ 68⑂ 7Python
추론, 배포 및 런타임
Model-Optimizer
NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
★ 3.3K⑂ 513Python
추론, 배포 및 런타임
LocalAI
mudler/LocalAI
A local inference engine for self-hosting models and AI services.
★ 48.9K⑂ 4.4KGo
추론, 배포 및 런타임
ray
ray-project/ray
A distributed computing runtime for machine learning training, tuning and model serving.
★ 43.7K⑂ 8KPython
추론, 배포 및 런타임
checkpoint-engine
MoonshotAI/checkpoint-engine
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
★ 982⑂ 100Python
추론, 배포 및 런타임
jan
janhq/jan
A local AI chat application for running models on a personal computer.
★ 44.3K⑂ 3KTypeScript
2 / 2페이지 · 프로젝트 19개