ToolAI.io · Canale GitHub

Nuovi progetti AI su GitHub

Scopri i nuovi progetti AI open source aggiunti su GitHub, con informazioni sul repository, note di configurazione, licenze e risorse correlate.

Dati del repository pubblico

Indice del progetto

47 Progetti
Screenshot di memra
Inferenza, distribuzione e runtime

memra

avifenesh/memra

A from-scratch LLM inference engine built in Rust and CUDA, specifically optimized for RTX 5090 (sm_120a) and H100 (sm_90a) architectures, delivering exactness-gated performance without relying on frameworks like ggml.

★ 314⑂ 35Rust
MITQ92
Screenshot di hal0
Inferenza, distribuzione e runtime

hal0

hal0ai/hal0

An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.

★ 68⑂ 7Python
Apache-2.0Q89
Screenshot di Qwen3-Coder — Code-focused language models
LLM e modelli fondamentali

Qwen3-Coder — Code-focused language models

QwenLM/Qwen3-Coder

Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team

★ 16,8K⑂ 1,2KPython
Licenza non rilevataQ82
Screenshot di TensorRT-LLM — Optimized LLM inference
Inferenza, distribuzione e runtime

TensorRT-LLM — Optimized LLM inference

NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way

★ 14,4K⑂ 2,7KC++
NOASSERTIONQ82
Screenshot di tiktoken — Fast tokenization
Inferenza, distribuzione e runtime

tiktoken — Fast tokenization

openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models

★ 19K⑂ 1,6KRust
MITQ86

Pagina 4 / 4 · 47 progetti

Aggiornato di recente

ComfyUIComfy-Org/ComfyUI★ 136,7K CrewAICrewAIInc/crewAI★ 59,5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K TRLhuggingface/trl★ 19,5K mcp-usemcp-use/mcp-use★ 10,7K OpenLITopenlit/openlit★ 2,8K

I più stellati

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K