ToolAI.io · GitHubチャンネル

GitHubの新しいAIプロジェクト

GitHubに新しく追加されたオープンソースAIプロジェクトを、リポジトリ情報、セットアップ手順、ライセンス、関連リソースとともに見つけましょう。

公開リポジトリのデータ

プロジェクトインデックス

48 プロジェクト
推論、デプロイ、ランタイム

ollama

ollama/ollama

A tool for running and managing large language models locally.

★ 180.2K⑂ 17.7KGo
MITQ90
推論、デプロイ、ランタイム

checkpoint-engine

MoonshotAI/checkpoint-engine

Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

★ 982⑂ 100Python
MITQ83
ロボティクス&エッジ AI

edgeai-for-beginners

microsoft/edgeai-for-beginners

This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.

★ 1.6K⑂ 362Jupyter Notebook
MITQ83
推論、デプロイ、ランタイム

Paddle-Lite

PaddlePaddle/Paddle-Lite

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎)

★ 7.3K⑂ 1.6KC++
Apache-2.0Q91
コンピュータビジョン

sam2

facebookresearch/sam2

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

★ 19.6K⑂ 2.5KJupyter Notebook
Apache-2.0Q79
推論、デプロイ、ランタイム

TensorRT

NVIDIA/TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

★ 13.2K⑂ 2.4KC++
Apache-2.0Q94
推論、デプロイ、ランタイム

Model-Optimizer

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

★ 3.3K⑂ 513Python
Apache-2.0Q86
推論、デプロイ、ランタイム

FastDeploy

PaddlePaddle/FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

★ 3.7K⑂ 755Python
Apache-2.0Q98
推論、デプロイ、ランタイム

llmgateway

theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

★ 1.6K⑂ 172TypeScript
NOASSERTIONQ98
推論、デプロイ、ランタイム

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 32.2K⑂ 8.1KPython
Apache-2.0Q98
推論、デプロイ、ランタイム

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 89.5K⑂ 21KPython
Apache-2.0Q98
ファインチューニング・トレーニング・データ

DeepSpeed

deepspeedai/deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 43K⑂ 4.9KPython
Apache-2.0Q94

2 / 4ページ · 48件のプロジェクト

最近更新

Craft Anythingstorytold/craft-anything★ 27.4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15.6K DeepInferdeepseek-ai/DeepInfer★ 25.7K ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

スター数が多い

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K