yams/src/extraction
trvon 66c21c0b25
perf(ingest): bypass GLiNER for zyp PDFs, preserve plugin metadata
- Add IContentExtractor::extractTextAndMetadata() to carry plugin metadata
- Add extractDocumentContent() in extraction_util for text+metadata
- PIQ uses plugin-provided title from PDF metadata, skipping GLiNER
  entirely when a title already exists (e.g. from zyp PDF parsing)
- Fix misleading 'parallel' naming in zyp wrapper/comments
  (zpdf_extract_all_parallel is actually sequential)

This removes the dominant slow-write source for paperbridge PDF
ingestion — title metadata batches that previously backed up the
WriteCoordinator with 34s queue waits.
2026-05-15 11:52:28 -04:00
..
format_handlers fix: cleaning up object references 2026-04-06 19:28:13 -04:00
external_plugin_extractor.cpp feat(linter): running linter on codebase 2026-04-20 16:13:30 -04:00
extraction_util.cpp perf(ingest): bypass GLiNER for zyp PDFs, preserve plugin metadata 2026-05-15 11:52:28 -04:00
html_text_extractor.cpp additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted 2025-11-04 14:43:42 -05:00
jsonrpc_client.cpp running linter 2025-12-13 16:27:07 -05:00
meson.build feat: adding additional tests, making the aggressive profile scaling better 2026-02-17 19:15:26 -05:00
plain_text_extractor.cpp additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted 2025-11-04 14:43:42 -05:00
plugin_process.cpp fix: improvements based on TSAN and strict quality gates 2026-03-18 20:55:56 -04:00
text_extractor_factory.cpp additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted 2025-11-04 14:43:42 -05:00
text_extractor_utils.cpp v0.6.12 experiemental 2025-09-11 11:28:42 -04:00
title_util.cpp fix: Copilot review feedback and gitignore for artifacts (#26) 2026-05-08 05:29:46 -04:00