Инференс, развёртывание и среда выполнения

LocalAI

mudler/LocalAI

A local inference engine for self-hosting models and AI services.

★ 48,9KЗвёзды
⑂ 4,4KФорки
214Открытые проблемы
GoЯзык
MITЛицензия
Q85Редакционная оценка

Обзор

A local inference engine for self-hosting models and AI services. The repository is maintained under mudler on GitHub. Its primary language is Go. See the [project README](https://github.com/mudler/LocalAI#readme) for the supported workflows.

Основные функции

  • A local inference engine for self-hosting models and AI services.

Требования, установка и быстрый старт

Use the upstream download or installation instructions for your operating system. Check the model, memory and accelerator requirements for the workload you intend to run.

[Read the upstream installation and quickstart instructions](https://github.com/mudler/LocalAI#readme).

Использование

Start with the documented local example, confirm it runs with your resources, then connect it to your application using the supported interface.

[Usage examples and configuration reference](https://github.com/mudler/LocalAI#readme).

Совместимость моделей и варианты использования

В метаданных репозитория совместимость моделей не указана.

Лицензия и примечания о рисках

GitHub reports MIT for this repository. Review the upstream license file; model weights, datasets and dependencies may have separate terms.

Source review 2026-09-05: GitHub search metadata and repository README. No runtime benchmark performed. License metadata: MIT.

Релиз и сопровождение

[View upstream releases](https://github.com/mudler/LocalAI/releases).

vllm

vllm-project/vllm

★ 89,5KPython

sglang

sgl-project/sglang

★ 32,2KPython

OpenVINO

openvinotoolkit/openvino

★ 10,6KC++

GPUStack

gpustack/gpustack

★ 5,4KPython