इन्फरेंस, डिप्लॉयमेंट और रनटाइम

LocalAI

mudler/LocalAI

A local inference engine for self-hosting models and AI services.

★ 48.9Kसितारे
⑂ 4.4Kफ़ोर्क्स
214खुले मुद्दे
Goभाषा
MITलाइसेंस
Q85संपादकीय स्कोर

अवलोकन

A local inference engine for self-hosting models and AI services. The repository is maintained under mudler on GitHub. Its primary language is Go. See the [project README](https://github.com/mudler/LocalAI#readme) for the supported workflows.

प्रमुख विशेषताएँ

  • A local inference engine for self-hosting models and AI services.

आवश्यकताएँ, इंस्टॉलेशन और त्वरित शुरुआत

Use the upstream download or installation instructions for your operating system. Check the model, memory and accelerator requirements for the workload you intend to run.

[Read the upstream installation and quickstart instructions](https://github.com/mudler/LocalAI#readme).

उपयोग

Start with the documented local example, confirm it runs with your resources, then connect it to your application using the supported interface.

[Usage examples and configuration reference](https://github.com/mudler/LocalAI#readme).

मॉडल संगतता और उपयोग के मामले

रिपॉज़िटरी मेटाडेटा में मॉडल संगतता का उल्लेख नहीं है।

लाइसेंस और जोखिम संबंधी टिप्पणियाँ

GitHub reports MIT for this repository. Review the upstream license file; model weights, datasets and dependencies may have separate terms.

Source review 2026-09-05: GitHub search metadata and repository README. No runtime benchmark performed. License metadata: MIT.

रिलीज़ और रखरखाव

[View upstream releases](https://github.com/mudler/LocalAI/releases).

vllm

vllm-project/vllm

★ 89.5KPython

sglang

sgl-project/sglang

★ 32.2KPython

OpenVINO

openvinotoolkit/openvino

★ 10.6KC++

GPUStack

gpustack/gpustack

★ 5.4KPython