ToolAI.io · GitHub Channel

Trending AI Projects on GitHub

Track active open-source AI repositories across LLM, agent, MCP, RAG and coding topics, with stars and verified project facts.

Public repository data

Project index

48 projects
Inference, Deployment & Runtime

DeepInfer

deepseek-ai/DeepInfer

DeepSeek’s own high-performance inference framework, open-sourced for offline inference of DeepSeek-V4.1-Flash on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs.

★ 25.7K⑂ 3.2KPython
Apache-2.0Q82
Multimodal AI

ComfyUI

Comfy-Org/ComfyUI

A node-based interface and execution engine for building image and other generative AI workflows.

★ 136.7K⑂ 16.3KPython
GPL-3.0Q84
Robotics & Edge AI

mediapipe

google-ai-edge/mediapipe

On-device ML libraries, models, and tools for vision, text, and audio across supported platforms.

★ 36.9K⑂ 6.2KC++
Apache-2.0Q90
Computer Vision

ultralytics

ultralytics/ultralytics

Training and inference tools for object detection, segmentation and pose estimation models.

★ 61.3K⑂ 11.7KPython
AGPL-3.0Q90
Inference, Deployment & Runtime

ray

ray-project/ray

A distributed computing runtime for machine learning training, tuning and model serving.

★ 43.7K⑂ 8KPython
Apache-2.0Q85
Inference, Deployment & Runtime

ollama

ollama/ollama

A tool for running and managing large language models locally.

★ 180.2K⑂ 17.7KGo
MITQ90
Inference, Deployment & Runtime

LocalAI

mudler/LocalAI

A local inference engine for self-hosting models and AI services.

★ 48.9K⑂ 4.4KGo
MITQ85
Inference, Deployment & Runtime

jan

janhq/jan

A local AI chat application for running models on a personal computer.

★ 44.3K⑂ 3KTypeScript
License not detectedQ80
Computer Vision

yolov5

ultralytics/yolov5

A PyTorch-based object detection project with training, inference and export workflows.

★ 58K⑂ 17.5KPython
AGPL-3.0Q90
Fine-tuning, Training & Data

ColossalAI

hpcaitech/ColossalAI

Distributed training and inference tools for parallelism and memory management in large-model workloads.

★ 41.4K⑂ 4.5KPython
Apache-2.0Q90
Inference, Deployment & Runtime

llmgateway

theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

★ 1.6K⑂ 172TypeScript
NOASSERTIONQ98

Page 1 / 4 · 48 projects

Recently updated

Craft Anythingstorytold/craft-anything★ 27.4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15.6K DeepInferdeepseek-ai/DeepInfer★ 25.7K ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K