Data Engineering & Pipelines

spaCy

explosion/spaCy

An engineering-oriented NLP pipeline library for tokenization, entities, syntax, and classification.

★ 33.9KStars
⑂ 4.7KForks
239Open issues
PythonLanguage
MITLicense
Q90Editorial score

Overview

spaCy packages explicit text tasks into reusable pipelines with structured outputs and training configuration. It is worth comparing with LLM extraction for stable labels and high-volume processing. Language support does not imply identical pretrained components for every language.

Key features

  • Doc/Token structures
  • NER and syntax
  • Classification
  • Custom components
  • Training configuration

Requirements, installation and quick start

Install spacy and a matching language pipeline separately. Run python -m spacy validate after upgrades.

Usage

Label a domain validation set, compare pretrained extraction and rule-assisted alternatives, and measure entity-boundary and label errors separately.

How it works
Tokenization builds a Doc; pipeline components add linguistic and classification annotations. Rules, models, and custom components can be combined.

Audience and requirements
NLP and data teams. Python, language model, and labeled data for customization.

Practical use cases
Entity indexing; classification; preprocessing for retrieval.

Limitations and selection
Domain shifts may require labeled training data. It is not a general conversational reasoning system.

Related projects and selection
google/langextract:Comparison: LLM examples suit flexible extraction; spaCy suits stable task pipelines.

qdrant/qdrant:Possible complement: use extracted entities as retrieval metadata through a custom ingestion pipeline.

Source review
Editorial analysis of upstream sources, without runtime or benchmark testing. Proposed workflows are editorial suggestions.

Model compatibility and use cases

Choose a language/task pipeline compatible with the installed spaCy version.

License and risk notes

The repository page identifies MIT. Read LICENSE; model weights and datasets may have separate terms.

Editorial source review 2026-09-09T05:00:00.950Z. README and live repository page verified; current stars/forks from GitHub HTML. Last-push metadata retained from 2026-09-05 discovery snapshot. No runtime benchmark. Integration proposals are editorial analysis.

Release and maintenance

Reviewed 2026-09-09. Counters come from repository pages; features are based on upstream documentation. See Releases in the source links. Editorial analysis of upstream sources, without runtime or benchmark testing. Proposed workflows are editorial suggestions.

aistore

NVIDIA/aistore

★ 1.9KGo

OpenBB

OpenBB-finance/OpenBB

★ 72.7KPython

airflow

apache/airflow

★ 46.7KPython