データエンジニアリングとパイプライン

spaCy

explosion/spaCy

An engineering-oriented NLP pipeline library for tokenization, entities, syntax, and classification.

★ 33.9Kスター
⑂ 4.7Kフォーク数
239未解決の問題
Python言語
MITライセンス
Q90編集部スコア

概要

spaCy packages explicit text tasks into reusable pipelines with structured outputs and training configuration. It is worth comparing with LLM extraction for stable labels and high-volume processing. Language support does not imply identical pretrained components for every language.

主な機能

  • Doc/Token structures
  • NER and syntax
  • Classification
  • Custom components
  • Training configuration

要件、インストール、クイックスタート

Install spacy and a matching language pipeline separately. Run python -m spacy validate after upgrades.

使用方法

Label a domain validation set, compare pretrained extraction and rule-assisted alternatives, and measure entity-boundary and label errors separately.

How it works
Tokenization builds a Doc; pipeline components add linguistic and classification annotations. Rules, models, and custom components can be combined.

Audience and requirements
NLP and data teams. Python, language model, and labeled data for customization.

Practical use cases
Entity indexing; classification; preprocessing for retrieval.

Limitations and selection
Domain shifts may require labeled training data. It is not a general conversational reasoning system.

Related projects and selection
google/langextract:Comparison: LLM examples suit flexible extraction; spaCy suits stable task pipelines.

qdrant/qdrant:Possible complement: use extracted entities as retrieval metadata through a custom ingestion pipeline.

Source review
Editorial analysis of upstream sources, without runtime or benchmark testing. Proposed workflows are editorial suggestions.

モデルの互換性とユースケース

Choose a language/task pipeline compatible with the installed spaCy version.

ライセンスとリスクに関する注意事項

The repository page identifies MIT. Read LICENSE; model weights and datasets may have separate terms.

Editorial source review 2026-09-09T05:00:00.950Z. README and live repository page verified; current stars/forks from GitHub HTML. Last-push metadata retained from 2026-09-05 discovery snapshot. No runtime benchmark. Integration proposals are editorial analysis.

リリースとメンテナンス

Reviewed 2026-09-09. Counters come from repository pages; features are based on upstream documentation. See Releases in the source links. Editorial analysis of upstream sources, without runtime or benchmark testing. Proposed workflows are editorial suggestions.

aistore

NVIDIA/aistore

★ 1.9KGo

OpenBB

OpenBB-finance/OpenBB

★ 72.7KPython

airflow

apache/airflow

★ 46.7KPython