ToolAI.io · GitHub Channel

Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Public repository data

Project index

41 projects
Computer Vision

ultralytics

ultralytics/ultralytics

Training and inference tools for object detection, segmentation and pose estimation models.

★ 61.3K⑂ 11.7KPython
AGPL-3.0Q90
Computer Vision

yolov5

ultralytics/yolov5

A PyTorch-based object detection project with training, inference and export workflows.

★ 58K⑂ 17.5KPython
AGPL-3.0Q90
Screenshot of hal0
Inference, Deployment & Runtime

hal0

hal0ai/hal0

An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.

★ 68⑂ 7Python
Apache-2.0Q89
Screenshot of tiktoken — Fast tokenization
Inference, Deployment & Runtime

tiktoken — Fast tokenization

openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models

★ 19K⑂ 1.6KRust
MITQ86
Inference, Deployment & Runtime

Model-Optimizer

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

★ 3.3K⑂ 513Python
Apache-2.0Q86
Inference, Deployment & Runtime

LocalAI

mudler/LocalAI

A local inference engine for self-hosting models and AI services.

★ 48.9K⑂ 4.4KGo
MITQ85
Inference, Deployment & Runtime

ray

ray-project/ray

A distributed computing runtime for machine learning training, tuning and model serving.

★ 43.7K⑂ 8KPython
Apache-2.0Q85
Robotics & Edge AI

edgeai-for-beginners

microsoft/edgeai-for-beginners

This course is designed to guide beginners through the exciting world of Edge AI, covering fundamental concepts, popular models, inference techniques, device-specific applications, model optimization, and the development of intelligent Edge AI agents.

★ 1.6K⑂ 362Jupyter Notebook
MITQ83
Inference, Deployment & Runtime

checkpoint-engine

MoonshotAI/checkpoint-engine

Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

★ 982⑂ 100Python
MITQ83

Page 3 / 4 · 41 projects

Recently updated

cherry-studioCherryHQ/cherry-studio★ 51.5K siyuansiyuan-note/siyuan★ 46.2K career-opscareer-ops-hq/career-ops★ 70.2K tensorflowtensorflow/tensorflow★ 198.8K streamlitstreamlit/streamlit★ 45.7K pytorchpytorch/pytorch★ 102.8K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K