Inferencia, implementación y tiempo de ejecución

Hugging Face Transformers

huggingface/transformers

A model-definition framework for state-of-the-art machine learning models across text, vision, audio, and multimodal domains, supporting both inference and training.

★ 163,3KEstrellas
⑂ 34,1KBifurcaciones
2343Problemas abiertos
PythonIdioma
Apache-2.0Licencia
Q@project.QualityScorePuntuación editorial

Capturas de pantalla del proyecto

Captura de pantalla de Hugging Face Transformers Captura de pantalla de Hugging Face Transformers

Resumen

Transformers serves as a centralized model-definition framework that ensures compatibility across the broader machine learning ecosystem. By standardizing model definitions, it allows seamless integration with various training frameworks like Axolotl, Unsloth, DeepSpeed, and PyTorch-Lightning, as well as inference engines such as vLLM, SGLang, and TGI. The library provides a unified API with minimal abstractions, making it accessible for researchers and developers to leverage over 1 million pretrained model checkpoints available on the Hugging Face Hub.

Características principales

  • Unified API for pretrained models across text, vision, audio, and multimodal tasks
  • Compatibility with major training frameworks and inference engines
  • Access to over 1 million model checkpoints on the Hugging Face Hub
  • High-level Pipeline API for easy inference across modalities
  • Support for model customization and exposure of model internals

Requisitos, instalación y guía rápida

Create and activate a virtual environment using venv or uv. Install Transformers with PyTorch support via pip using 'pip install "transformers[torch]"' or via uv using 'uv pip install "transformers[torch]"'. For the latest changes, install from source by cloning the repository and running 'pip install ".[torch]"'.

Uso

Instantiate a pipeline by specifying a task and model, then pass input data to get results. For example, use 'pipeline(task="text-generation", model="Qwen/Qwen2.5-1.5B")' for text generation. For chat-based interactions, construct a chat history and pass it to the pipeline.

Compatibilidad de modelos y casos de uso

Supports a wide range of models including Qwen, Llama, Whisper, DINOv2, BLIP, Mixtral, BART, T5, Gemma, and many others across various modalities.

Notas sobre la licencia y los riesgos

Licensed under the Apache License, Version 2.0.

Editorial verification 2026-08-09: repository URL, owner, description, license and repository statistics were reviewed. License metadata: Apache-2.0. README was fetched for the channel draft; re-check repository dependencies, releases and model terms before production use.

Lanzamiento y mantenimiento

Not stated in the repository metadata.

OpenVINO

openvinotoolkit/openvino

★ 10,6KC++

GPUStack

gpustack/gpustack

★ 5,4KPython