ToolAI.io · GitHub Channel

Fine-tuning, Training & Data · Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Public repository data

Project index

16 projects
Fine-tuning, Training & Data

Langfuse

langfuse/langfuse

An open-source LLM engineering platform for tracing, evaluating, debugging, and improving AI applications, with prompt management, datasets, metrics, a playground, APIs, and managed or self-hosted deployment options.

★ 32.4K⑂ 3.5KTypeScript
NOASSERTIONQ98
Fine-tuning, Training & Data

Oumi: Open-Source Foundation Model Training, Evaluation, Inference, and Deployment

oumi-ai/oumi

Oumi is a Python-based platform for preparing data, training and fine-tuning open-weight foundation models, evaluating results, running inference, and deploying models. It provides configuration recipes and a consistent CLI for local, cluster, and cloud workflows.

★ 9.4K⑂ 784Python
Apache-2.0Q98
Fine-tuning, Training & Data

DeepSpeed

deepspeedai/deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 43K⑂ 4.9KPython
Apache-2.0Q94
Fine-tuning, Training & Data

aikit

kaito-project/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

★ 535⑂ 57Go
MITQ94
Fine-tuning, Training & Data

Hydra: Managing Training Configurations, Parameter Combinations, and Experiment Runs

hydra-ecosystem/hydra

A configuration framework for Python applications that manages experiments through configuration composition, command-line overrides, and multirun execution. It is suitable for organizing data, model, and training parameters into reusable configuration structures.

★ 10.6K⑂ 977Python
MITQ92
Fine-tuning, Training & Data

tensorflow

tensorflow/tensorflow

A machine learning framework for building, training and deploying models.

★ 198.8K⑂ 76.2KC++
Apache-2.0Q90
Fine-tuning, Training & Data

LlamaFactory

hiyouga/LlamaFactory

A unified fine-tuning toolkit for large language and vision-language models.

★ 74.6K⑂ 9.1KPython
Apache-2.0Q90
Fine-tuning, Training & Data

scikit-learn

scikit-learn/scikit-learn

A Python machine learning library for classification, regression, clustering and model evaluation.

★ 67.2K⑂ 27.4KPython
BSD-3-ClauseQ90
Fine-tuning, Training & Data

keras

keras-team/keras

A high-level API for building and training deep learning models.

★ 64.3K⑂ 19.8KPython
Apache-2.0Q90
Fine-tuning, Training & Data

ColossalAI

hpcaitech/ColossalAI

Distributed training and inference tools for parallelism and memory management in large-model workloads.

★ 41.4K⑂ 4.5KPython
Apache-2.0Q90
Fine-tuning, Training & Data

pytorch-lightning

Lightning-AI/pytorch-lightning

Organize PyTorch training with reusable loops, checkpoints, logging, and device strategies.

★ 31.3K⑂ 3.8KPython
Apache-2.0Q90
Fine-tuning, Training & Data

generative-ai-for-beginners

microsoft/generative-ai-for-beginners

21 Lessons, Get Started Building with Generative AI

★ 113.5K⑂ 60.9KJupyter Notebook
MITQ89

Page 1 / 2 · 16 projects

Recently updated

TypeSafe Python SDKtypesafe-ai/typesafe-sdk-python★ 218 TypeSafe JavaScript SDKtypesafe-ai/typesafe-sdk-js★ 231 TypeSafe Agent Skillstypesafe-ai/skills★ 2K cherry-studioCherryHQ/cherry-studio★ 51.5K onyxonyx-dot-app/onyx★ 32K siyuansiyuan-note/siyuan★ 46.2K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K