Commit graph

606 commits

Author SHA1 Message Date
trevon
412ec6e435
yams-sdk bundling in main monorepo, updated metadata_repository logic for vectordb deadlock 2025-12-03 12:20:17 -05:00
trevon
2ec7ecff5a
addressing search regressions, crashes and linux build errors 2025-12-03 10:42:27 -05:00
trevon
1df3ccb9ee
removing search cache and introducing search performance optimizations 2025-12-02 16:53:43 -05:00
trevon
d24a961e2e
checkpoint system, removed hybrid search engine after its been deprecated, build updates 2025-12-02 15:21:31 -05:00
trevon
c4e8099f07
improvements for daemon service management 2025-12-02 12:03:40 -05:00
trevon
f5d570985d
new components now used 2025-11-30 16:02:51 -05:00
trevon
a7c61f9313
init updates, model defaults changes and stats improvements 2025-11-29 23:08:37 -05:00
trvon
c16939f482
linter 2025-11-28 20:30:41 -05:00
trevon
1de9e31a58
cleaning up tests and exposing windows packaging and builds in ci 2025-11-27 10:54:09 -05:00
trevon
3b58ac1743
test stabilizations for windows. search metadata/tags improvements 2025-11-26 21:45:50 -05:00
trevon
ebe81823db
improvements for daemon lifecycle, tree repair, and mcp regression 2025-11-26 14:22:35 -05:00
trevon
e41c06d6bc
improvements for lifecycle status and github action fixes 2025-11-26 00:28:30 -05:00
trevon
7fe8721c5b
daemon worker coordinator race condition fix for windows 2025-11-25 20:11:06 -05:00
trevon
2a3f5be870
Merge branch 'main' of https://github.com/trvon/yams 2025-11-25 13:18:24 -05:00
trevon
6b8084ec04
daemon improvements for windows 2025-11-25 13:16:04 -05:00
trvon
70e88af608
running linter 2025-11-25 13:10:29 -05:00
trevon
e6991b4813
Merge branch 'main' of https://github.com/trvon/yams 2025-11-25 10:41:19 -05:00
trevon
eb7e9c27e2
windows build running. resolving plugin loading 2025-11-25 09:56:50 -05:00
trevon
244cf02822
windows build stable on dev machine 2025-11-23 23:22:30 -05:00
trvon
c4c42e0266
additional streaming fixes for idle daemons 2025-11-18 16:16:39 -05:00
trvon
cbfca7ae23
resolve tuning manager bug that shrunk worker pool to 0 when daemon idle 2025-11-17 09:49:02 -05:00
trvon
f6b8334371
removing working pool and daemon cleanup 2025-11-16 22:42:56 -05:00
trvon
18b8be4fbf
removing unnecessary artifacts 2025-11-16 13:45:30 -05:00
trvon
5b23afa99d
adding dedicate graph component for graph operations, updating socket stale logic and fixing CI issues in release. 2025-11-16 13:31:04 -05:00
trvon
41bb390be9
hot fix v0.7.9 2025-11-15 11:02:30 -05:00
trvon
d9c7b14208
bug fixes. v0.7.8 2025-11-14 20:26:09 -05:00
trvon
7f763587be
compat fix for macos builds 2025-11-14 14:38:17 -05:00
trvon
3032d1747b
fixing worker calls that were deleted 2025-11-14 12:57:03 -05:00
trvon
faeb4ae82a
fixing syntax error of deleted class 2025-11-14 12:49:09 -05:00
trvon
2913adcd20
pre-release v0.7.8 2025-11-14 11:58:19 -05:00
trvon
b06e9335b9
staging v0.7.8. running benchmarks on updated search engine and improving code for testing/benchmarking 2025-11-13 10:27:10 -05:00
trvon
352ee45a69
updating files with linter run 2025-11-11 10:11:27 -05:00
trvon
12fc1b8a50
resolved concurrency bugs in daemon. added fuzzing work in progress per issue #8 2025-11-11 10:10:07 -05:00
trvon
ebd0701054
search and retrieval optimizations leveraging parallel processing introduced with grep 2025-11-09 08:42:21 -05:00
trvon
c1d6a992fc
feat(search): implement parallel post-processing (PBI-001 Phase 3)
Parallel Post-Processor with Threshold-Based Activation
--------------------------------------------------------
- New ParallelPostProcessor class (120 lines header, 247 lines impl)
- Uses std::async for concurrent facet/highlight/snippet generation
- Threshold = 100 results (sequential below, parallel at/above)
- Facets now operate on filtered results (fixed data flow bug)

Performance Results (100 iterations)
------------------------------------
- 100 results: 0.06ms (~1.66M ops/sec) - sequential path
- 500 results: 0.23ms (~2.21M ops/sec) - parallel path
- 1000 results: 0.43ms (~2.32M ops/sec) - parallel path
- Speedup: ~3.4x faster at 1000 results

Test Coverage
-------------
- 5 unit tests (threshold behavior, facets, snippets, edge cases)
- All tests passing (5/5 ✅)
- 3 benchmarks added to search_benchmarks.cpp

Files Changed
-------------
- include/yams/search/parallel_post_processor.hpp (NEW)
- src/search/parallel_post_processor.cpp (NEW)
- src/search/search_executor.cpp (integrated)
- tests/unit/search/search_executor_test.cpp (+6 tests)
- tests/benchmarks/search_benchmarks.cpp (+3 benchmarks)
- CHANGELOG.md (documented with measured results)
- docs/delivery/001/prd.md (Phase 3 → ✅ COMPLETED)

Technical Details
-----------------
- Parallel path: filtering → parallel(facets + highlights) → wait
- Sequential path: identical logic, no std::async overhead
- Correctness preserved: identical output to previous sequential impl
- Build: 46/46 targets compiling successfully
2025-11-09 08:04:15 -05:00
trvon
52d27169c9
re-running lint 2025-11-09 02:24:39 -05:00
trvon
66825f8219
grep bug fixes and performance improvements 2025-11-09 02:24:07 -05:00
trvon
4702a345ad
ci fixes, test updates and documentation imrpovements 2025-11-07 13:20:58 -05:00
trvon
eba47216a3
search engine improvements 2025-11-07 11:08:32 -05:00
trvon
c0fde23eb5
small bug fixes for retrieval 2025-11-06 17:00:34 -05:00
trvon
d989da66dd
fixing prune command and tests fixes 2025-11-06 12:19:08 -05:00
trvon
0cd1bd0b4c
stabilizations. removing http as I am not using it. Focusing on streamlining build and system 2025-11-05 10:52:27 -05:00
trvon
97cfe741e5
clang tidy fixes and macos crash fix 2025-11-04 18:31:58 -05:00
trvon
b9d73ea60e
additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted 2025-11-04 14:43:42 -05:00
trvon
166d8c520d
staging v0.7.7 2025-11-01 16:02:12 -04:00
trvon
bbf23bb190
test migrations to catch2, service manager + socket server refactor for better startup performance. search bug fixes 2025-10-29 23:08:09 -04:00
trvon
61d5074c8b
import and linux fixes for linux builds 2025-10-24 15:03:12 -04:00
trvon
4135535c31
linux build fixes 2025-10-24 14:13:20 -04:00
trvon
d19a5d7b64
bug fixes and optimizations for v0.7.7. Finalizing tests, benchmarks and bug fixes prior to release 2025-10-24 12:49:00 -04:00
trvon
027a99ceaa
adding additional headers 2025-10-20 16:12:01 -04:00