Kỹ thuật dữ liệu & pipeline

langextract

google/langextract

LLM-based structured extraction with source-text alignment and visualization for reviewable document processing.

★ 38,6KSố sao
⑂ 2,7KFork
135Vấn đề đang mở
PythonNgôn ngữ
Apache-2.0Giấy phép
Q90Điểm biên tập

Tổng quan

LangExtract turns text into entities and attributes while preserving where extracted spans came from. It fits after OCR or parsing and before business validation. Your team still defines schemas, examples, entity merging, and acceptable error rates.

Tính năng chính

  • Few-shot extraction
  • Source alignment
  • Long-document processing
  • JSONL and visualization
  • Provider flexibility

Yêu cầu, cài đặt và bắt đầu nhanh

Install langextract, configure a documented model provider, and run the short-text extraction and visualization examples. Local Ollama has a separate example.

Cách sử dụng

Extract equipment, reported fault, and corrective action from maintenance notes. Check negation, dates, source alignment, and cross-paragraph links against labeled samples.

How it works
Instructions and examples guide extraction. Outputs can be saved as JSONL and visualized against source spans. An unaligned extraction may have no char_interval and should be reviewed or filtered.

Audience and requirements
Document and data engineering teams. Python, text inputs, labeled examples, and a supported model.

Practical use cases
Report structuring; entity extraction; annotation assistance.

Limitations and selection
Alignment does not guarantee semantic correctness or completeness. OCR remains a separate step. Chunking and provider limits affect quality and cost.

Related projects and selection
JaidedAI/EasyOCR:Complement: OCR supplies text; recognition errors propagate downstream.

explosion/spaCy:Comparison: spaCy serves fixed-label NLP pipelines; LangExtract uses task-specific LLM instructions.

Source review
Editorial analysis of upstream sources, without runtime or benchmark testing. Proposed workflows are editorial suggestions.

Khả năng tương thích của mô hình và trường hợp sử dụng

README documents Gemini, other providers, and local Ollama; schema capabilities depend on the provider.

Ghi chú về giấy phép và rủi ro

The repository page identifies Apache-2.0. Read LICENSE; model weights and datasets may have separate terms.

Editorial source review 2026-09-09T05:00:00.950Z. README and live repository page verified; current stars/forks from GitHub HTML. Last-push metadata retained from 2026-09-05 discovery snapshot. No runtime benchmark. Integration proposals are editorial analysis.

Phát hành và bảo trì

Reviewed 2026-09-09. Counters come from repository pages; features are based on upstream documentation. See Releases in the source links. Editorial analysis of upstream sources, without runtime or benchmark testing. Proposed workflows are editorial suggestions.

aistore

NVIDIA/aistore

★ 1,9KGo

spaCy

explosion/spaCy

★ 33,9KPython

OpenBB

OpenBB-finance/OpenBB

★ 72,7KPython

airflow

apache/airflow

★ 46,7KPython