انفرنس، ڈپلائمنٹ اور رَن ٹائم
checkpoint-engine
MoonshotAI/checkpoint-engine
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
★ 982⑂ 100Python
ToolAI.io · GitHub چینل
GitHub پر نئے AI پروجیکٹس
GitHub پر حال ہی میں شامل کیے گئے اوپن سورس AI پروجیکٹس دریافت کریں، جن کے ساتھ ریپوزٹری کی معلومات، سیٹ اپ نوٹس، لائسنس اور متعلقہ وسائل بھی موجود ہیں۔
عوامی ریپوزٹری کا ڈیٹا
پروجیکٹ انڈیکس
روبوٹکس اور ایج AI
edgeai-for-beginners
microsoft/edgeai-for-beginners
This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.
★ 1.6K⑂ 362Jupyter Notebook
انفرنس، ڈپلائمنٹ اور رَن ٹائم
Paddle-Lite
PaddlePaddle/Paddle-Lite
PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）
★ 7.3K⑂ 1.6KC++
کمپیوٹر وژن
sam2
facebookresearch/sam2
The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
★ 19.6K⑂ 2.5KJupyter Notebook
انفرنس، ڈپلائمنٹ اور رَن ٹائم
TensorRT
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
★ 13.2K⑂ 2.4KC++
انفرنس، ڈپلائمنٹ اور رَن ٹائم
Model-Optimizer
NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
★ 3.3K⑂ 513Python
انفرنس، ڈپلائمنٹ اور رَن ٹائم
FastDeploy
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
★ 3.7K⑂ 755Python
انفرنس، ڈپلائمنٹ اور رَن ٹائم
llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1.6K⑂ 172TypeScript
انفرنس، ڈپلائمنٹ اور رَن ٹائم
sglang
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 32.2K⑂ 8.1KPython
انفرنس، ڈپلائمنٹ اور رَن ٹائم
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 89.5K⑂ 21KPython
فائن ٹیوننگ، تربیت اور ڈیٹا
DeepSpeed
deepspeedai/deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43K⑂ 4.9KPython
ایجنٹس اور ملٹی ایجنٹ
CSGHub: Open-Source LLM Asset Management Platform
opencsgs/csghub
CSGHub is an open-source, on-premise platform for managing the full lifecycle of Large Language Model assets, including models, datasets, spaces, and code, offering functionality comparable to a private Hugging Face.
★ 4.2K⑂ 525Vue
صفحہ 2 / 4 · 47 پروجیکٹس