추론, 배포 및 런타임
ray
ray-project/ray
A distributed computing runtime for machine learning training, tuning and model serving.
★ 43.7K⑂ 8KPython
ToolAI.io · GitHub 채널
GitHub의 AI 프로젝트 디렉터리
GitHub의 전체 ToolAI 오픈 소스 AI 프로젝트 디렉터리를 주제, 언어 및 라이선스별로 살펴보세요.
공개 리포지토리 데이터
프로젝트 색인
멀티모달 AI
ComfyUI
Comfy-Org/ComfyUI
A node-based interface and execution engine for building image and other generative AI workflows.
★ 136.7K⑂ 16.3KPython
멀티모달 AI
TRELLIS.2: image-to-3D assets with materials
microsoft/TRELLIS.2
Microsoft’s 3D generation project with image-to-3D inference, PBR texturing and GLB export for GPU-equipped asset workflows.
★ 11.2K⑂ 1.4KPython
추론, 배포 및 런타임
NVIDIA Container Toolkit: NVIDIA GPU access for containers
NVIDIA/nvidia-container-toolkit
Configures NVIDIA GPU access for container runtimes such as Docker, supporting containerized inference, training and CUDA workloads.
★ 4.6K⑂ 589Go
로보틱스 및 엣지 AI
edgeai-for-beginners
microsoft/edgeai-for-beginners
This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.
★ 1.6K⑂ 362Jupyter Notebook
추론, 배포 및 런타임
checkpoint-engine
MoonshotAI/checkpoint-engine
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
★ 982⑂ 100Python
LLM 및 파운데이션 모델
Qwen3 — Open-weight multilingual language models
QwenLM/Qwen3
Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud
★ 27.5K⑂ 2KPython
LLM 및 파운데이션 모델
Qwen3-Coder — Code-focused language models
QwenLM/Qwen3-Coder
Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team
★ 16.8K⑂ 1.2KPython
추론, 배포 및 런타임
TensorRT-LLM — Optimized LLM inference
NVIDIA/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way
★ 14.4K⑂ 2.7KC++
추론, 배포 및 런타임
jan
janhq/jan
A local AI chat application for running models on a personal computer.
★ 44.3K⑂ 3KTypeScript
컴퓨터 비전
sam2
facebookresearch/sam2
The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
★ 19.6K⑂ 2.5KJupyter Notebook
4 / 4페이지 · 프로젝트 47개