इन्फरेंस, डिप्लॉयमेंट और रनटाइम
checkpoint-engine
MoonshotAI/checkpoint-engine
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
★ 982⑂ 100Python
ToolAI.io · GitHub चैनल
GitHub पर नए AI प्रोजेक्ट्स
GitHub पर हाल ही में जोड़े गए ओपन-सोर्स AI प्रोजेक्ट खोजें—रिपॉज़िटरी की जानकारी, सेटअप नोट्स, लाइसेंस और संबंधित संसाधनों के साथ।
सार्वजनिक रिपॉज़िटरी का डेटा
प्रोजेक्ट इंडेक्स
रोबोटिक्स और एज AI
edgeai-for-beginners
microsoft/edgeai-for-beginners
This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.
★ 1.6K⑂ 362Jupyter Notebook
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
Paddle-Lite
PaddlePaddle/Paddle-Lite
PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）
★ 7.3K⑂ 1.6KC++
कंप्यूटर विज़न
sam2
facebookresearch/sam2
The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
★ 19.6K⑂ 2.5KJupyter Notebook
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
TensorRT
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
★ 13.2K⑂ 2.4KC++
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
Model-Optimizer
NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
★ 3.3K⑂ 513Python
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
FastDeploy
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
★ 3.7K⑂ 755Python
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1.6K⑂ 172TypeScript
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
sglang
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 32.2K⑂ 8.1KPython
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 89.5K⑂ 21KPython
फ़ाइन-ट्यूनिंग, प्रशिक्षण और डेटा
DeepSpeed
deepspeedai/deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43K⑂ 4.9KPython
एजेंट और मल्टी-एजेंट
CSGHub: Open-Source LLM Asset Management Platform
opencsgs/csghub
CSGHub is an open-source, on-premise platform for managing the full lifecycle of Large Language Model assets, including models, datasets, spaces, and code, offering functionality comparable to a private Hugging Face.
★ 4.2K⑂ 525Vue
पृष्ठ 2 / 4 · 47 प्रोजेक्ट