추론, 배포 및 런타임

LocalAI

mudler/LocalAI

A local inference engine for self-hosting models and AI services.

★ 48.9K별점
⑂ 4.4K포크 수
214미해결 이슈
Go언어
MIT라이선스
Q85편집 점수

개요

A local inference engine for self-hosting models and AI services. The repository is maintained under mudler on GitHub. Its primary language is Go. See the [project README](https://github.com/mudler/LocalAI#readme) for the supported workflows.

주요 기능

  • A local inference engine for self-hosting models and AI services.

요구 사항, 설치 및 빠른 시작

Use the upstream download or installation instructions for your operating system. Check the model, memory and accelerator requirements for the workload you intend to run.

[Read the upstream installation and quickstart instructions](https://github.com/mudler/LocalAI#readme).

사용 정보

Start with the documented local example, confirm it runs with your resources, then connect it to your application using the supported interface.

[Usage examples and configuration reference](https://github.com/mudler/LocalAI#readme).

모델 호환성 및 사용 사례

저장소 메타데이터에 모델 호환성이 명시되어 있지 않습니다.

라이선스 및 위험 참고 사항

GitHub reports MIT for this repository. Review the upstream license file; model weights, datasets and dependencies may have separate terms.

Source review 2026-09-05: GitHub search metadata and repository README. No runtime benchmark performed. License metadata: MIT.

릴리스 및 유지 관리

[View upstream releases](https://github.com/mudler/LocalAI/releases).

vllm

vllm-project/vllm

★ 89.5KPython

sglang

sgl-project/sglang

★ 32.2KPython

OpenVINO

openvinotoolkit/openvino

★ 10.6KC++

GPUStack

gpustack/gpustack

★ 5.4KPython