ToolAI.io · Kênh GitHub

Các dự án AI mới trên GitHub

Khám phá các dự án AI nguồn mở mới được thêm trên GitHub, cùng thông tin kho lưu trữ, hướng dẫn thiết lập, giấy phép và tài nguyên liên quan.

Dữ liệu kho lưu trữ công khai

Mục lục dự án

48 Dự án
Suy luận, Triển khai & Thời gian chạy

ollama

ollama/ollama

A tool for running and managing large language models locally.

★ 180,2K⑂ 17,7KGo
MITQ90
Suy luận, Triển khai & Thời gian chạy

checkpoint-engine

MoonshotAI/checkpoint-engine

Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

★ 982⑂ 100Python
MITQ83
Robot và Edge AI

edgeai-for-beginners

microsoft/edgeai-for-beginners

This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.

★ 1,6K⑂ 362Jupyter Notebook
MITQ83
Suy luận, Triển khai & Thời gian chạy

Paddle-Lite

PaddlePaddle/Paddle-Lite

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎)

★ 7,3K⑂ 1,6KC++
Apache-2.0Q91
Thị giác máy tính

sam2

facebookresearch/sam2

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

★ 19,6K⑂ 2,5KJupyter Notebook
Apache-2.0Q79
Suy luận, Triển khai & Thời gian chạy

TensorRT

NVIDIA/TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

★ 13,2K⑂ 2,4KC++
Apache-2.0Q94
Suy luận, Triển khai & Thời gian chạy

Model-Optimizer

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

★ 3,3K⑂ 513Python
Apache-2.0Q86
Suy luận, Triển khai & Thời gian chạy

FastDeploy

PaddlePaddle/FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

★ 3,7K⑂ 755Python
Apache-2.0Q98
Suy luận, Triển khai & Thời gian chạy

llmgateway

theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

★ 1,6K⑂ 172TypeScript
NOASSERTIONQ98
Suy luận, Triển khai & Thời gian chạy

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 32,2K⑂ 8,1KPython
Apache-2.0Q98
Suy luận, Triển khai & Thời gian chạy

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 89,5K⑂ 21KPython
Apache-2.0Q98
Tinh chỉnh, huấn luyện & dữ liệu

DeepSpeed

deepspeedai/deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 43K⑂ 4,9KPython
Apache-2.0Q94

Trang 2 / 4 · 48 dự án

Đã cập nhật gần đây

Craft Anythingstorytold/craft-anything★ 27,4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15,6K DeepInferdeepseek-ai/DeepInfer★ 25,7K ComfyUIComfy-Org/ComfyUI★ 136,7K CrewAICrewAIInc/crewAI★ 59,5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Được gắn sao nhiều nhất

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K