ToolAI.io · GitHub-Kanal

Neue AI-Projekte auf GitHub

Entdecke neu hinzugefügte Open-Source-AI-Projekte auf GitHub – mit Repository-Informationen, Einrichtungshinweisen, Lizenzen und verwandten Ressourcen.

Daten des öffentlichen Repositorys

Projektindex

47 Projekte
Screenshot von memra
Inferenz, Bereitstellung & Laufzeit

memra

avifenesh/memra

A from-scratch LLM inference engine built in Rust and CUDA, specifically optimized for RTX 5090 (sm_120a) and H100 (sm_90a) architectures, delivering exactness-gated performance without relying on frameworks like ggml.

★ 314⑂ 35Rust
MITQ92
Screenshot von hal0
Inferenz, Bereitstellung & Laufzeit

hal0

hal0ai/hal0

An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.

★ 68⑂ 7Python
Apache-2.0Q89
Screenshot von Qwen3-Coder — Code-focused language models
LLM & Basismodelle

Qwen3-Coder — Code-focused language models

QwenLM/Qwen3-Coder

Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team

★ 16,8K⑂ 1,2KPython
Lizenz nicht erkanntQ82
Screenshot von TensorRT-LLM — Optimized LLM inference
Inferenz, Bereitstellung & Laufzeit

TensorRT-LLM — Optimized LLM inference

NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way

★ 14,4K⑂ 2,7KC++
NOASSERTIONQ82
Screenshot von tiktoken — Fast tokenization
Inferenz, Bereitstellung & Laufzeit

tiktoken — Fast tokenization

openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models

★ 19K⑂ 1,6KRust
MITQ86

Seite 4 / 4 · 47 Projekte

Kürzlich aktualisiert

ComfyUIComfy-Org/ComfyUI★ 136,7K CrewAICrewAIInc/crewAI★ 59,5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K TRLhuggingface/trl★ 19,5K mcp-usemcp-use/mcp-use★ 10,7K OpenLITopenlit/openlit★ 2,8K

Mit den meisten Sternen

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K