Inferencia, implementación y tiempo de ejecución

LocalAI

mudler/LocalAI

A local inference engine for self-hosting models and AI services.

★ 48,9KEstrellas
⑂ 4,4KBifurcaciones
214Problemas abiertos
GoIdioma
MITLicencia
Q85Puntuación editorial

Resumen

A local inference engine for self-hosting models and AI services. The repository is maintained under mudler on GitHub. Its primary language is Go. See the [project README](https://github.com/mudler/LocalAI#readme) for the supported workflows.

Características principales

  • A local inference engine for self-hosting models and AI services.

Requisitos, instalación y guía rápida

Use the upstream download or installation instructions for your operating system. Check the model, memory and accelerator requirements for the workload you intend to run.

[Read the upstream installation and quickstart instructions](https://github.com/mudler/LocalAI#readme).

Uso

Start with the documented local example, confirm it runs with your resources, then connect it to your application using the supported interface.

[Usage examples and configuration reference](https://github.com/mudler/LocalAI#readme).

Compatibilidad de modelos y casos de uso

La compatibilidad del modelo no se indica en los metadatos del repositorio.

Notas sobre la licencia y los riesgos

GitHub reports MIT for this repository. Review the upstream license file; model weights, datasets and dependencies may have separate terms.

Source review 2026-09-05: GitHub search metadata and repository README. No runtime benchmark performed. License metadata: MIT.

Lanzamiento y mantenimiento

[View upstream releases](https://github.com/mudler/LocalAI/releases).

vllm

vllm-project/vllm

★ 89,5KPython

sglang

sgl-project/sglang

★ 32,2KPython

OpenVINO

openvinotoolkit/openvino

★ 10,6KC++

GPUStack

gpustack/gpustack

★ 5,4KPython