Commit graph

434 commits

Author SHA1 Message Date
trvon
18b8be4fbf
removing unnecessary artifacts 2025-11-16 13:45:30 -05:00
trvon
5b23afa99d
adding dedicate graph component for graph operations, updating socket stale logic and fixing CI issues in release. 2025-11-16 13:31:04 -05:00
trvon
41bb390be9
hot fix v0.7.9 2025-11-15 11:02:30 -05:00
trvon
d9c7b14208
bug fixes. v0.7.8 2025-11-14 20:26:09 -05:00
trvon
7f763587be
compat fix for macos builds 2025-11-14 14:38:17 -05:00
trvon
3032d1747b
fixing worker calls that were deleted 2025-11-14 12:57:03 -05:00
trvon
faeb4ae82a
fixing syntax error of deleted class 2025-11-14 12:49:09 -05:00
trvon
2913adcd20
pre-release v0.7.8 2025-11-14 11:58:19 -05:00
trvon
b06e9335b9
staging v0.7.8. running benchmarks on updated search engine and improving code for testing/benchmarking 2025-11-13 10:27:10 -05:00
trvon
352ee45a69
updating files with linter run 2025-11-11 10:11:27 -05:00
trvon
12fc1b8a50
resolved concurrency bugs in daemon. added fuzzing work in progress per issue #8 2025-11-11 10:10:07 -05:00
trvon
ebd0701054
search and retrieval optimizations leveraging parallel processing introduced with grep 2025-11-09 08:42:21 -05:00
trvon
c1d6a992fc
feat(search): implement parallel post-processing (PBI-001 Phase 3)
Parallel Post-Processor with Threshold-Based Activation
--------------------------------------------------------
- New ParallelPostProcessor class (120 lines header, 247 lines impl)
- Uses std::async for concurrent facet/highlight/snippet generation
- Threshold = 100 results (sequential below, parallel at/above)
- Facets now operate on filtered results (fixed data flow bug)

Performance Results (100 iterations)
------------------------------------
- 100 results: 0.06ms (~1.66M ops/sec) - sequential path
- 500 results: 0.23ms (~2.21M ops/sec) - parallel path
- 1000 results: 0.43ms (~2.32M ops/sec) - parallel path
- Speedup: ~3.4x faster at 1000 results

Test Coverage
-------------
- 5 unit tests (threshold behavior, facets, snippets, edge cases)
- All tests passing (5/5 ✅)
- 3 benchmarks added to search_benchmarks.cpp

Files Changed
-------------
- include/yams/search/parallel_post_processor.hpp (NEW)
- src/search/parallel_post_processor.cpp (NEW)
- src/search/search_executor.cpp (integrated)
- tests/unit/search/search_executor_test.cpp (+6 tests)
- tests/benchmarks/search_benchmarks.cpp (+3 benchmarks)
- CHANGELOG.md (documented with measured results)
- docs/delivery/001/prd.md (Phase 3 → ✅ COMPLETED)

Technical Details
-----------------
- Parallel path: filtering → parallel(facets + highlights) → wait
- Sequential path: identical logic, no std::async overhead
- Correctness preserved: identical output to previous sequential impl
- Build: 46/46 targets compiling successfully
2025-11-09 08:04:15 -05:00
trvon
52d27169c9
re-running lint 2025-11-09 02:24:39 -05:00
trvon
66825f8219
grep bug fixes and performance improvements 2025-11-09 02:24:07 -05:00
trvon
4702a345ad
ci fixes, test updates and documentation imrpovements 2025-11-07 13:20:58 -05:00
trvon
eba47216a3
search engine improvements 2025-11-07 11:08:32 -05:00
trvon
c0fde23eb5
small bug fixes for retrieval 2025-11-06 17:00:34 -05:00
trvon
d989da66dd
fixing prune command and tests fixes 2025-11-06 12:19:08 -05:00
trvon
0cd1bd0b4c
stabilizations. removing http as I am not using it. Focusing on streamlining build and system 2025-11-05 10:52:27 -05:00
trvon
97cfe741e5
clang tidy fixes and macos crash fix 2025-11-04 18:31:58 -05:00
trvon
b9d73ea60e
additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted 2025-11-04 14:43:42 -05:00
trvon
166d8c520d
staging v0.7.7 2025-11-01 16:02:12 -04:00
trvon
bbf23bb190
test migrations to catch2, service manager + socket server refactor for better startup performance. search bug fixes 2025-10-29 23:08:09 -04:00
trvon
61d5074c8b
import and linux fixes for linux builds 2025-10-24 15:03:12 -04:00
trvon
4135535c31
linux build fixes 2025-10-24 14:13:20 -04:00
trvon
d19a5d7b64
bug fixes and optimizations for v0.7.7. Finalizing tests, benchmarks and bug fixes prior to release 2025-10-24 12:49:00 -04:00
trvon
027a99ceaa
adding additional headers 2025-10-20 16:12:01 -04:00
trvon
b6ca31dfb0
adding symbol extraction work, simplying build with ./setup.sh, updated plugin tests with new meson shard and other goodies 2025-10-20 16:11:31 -04:00
trvon
8069318bf2
weekly update staged. 2025-10-18 00:39:19 -04:00
trvon
83fa1ad1ba
v0.7.5 staging and license updates 2025-10-13 17:07:31 -04:00
trvon
0aa529bd5e
improvements, benchmark updates and test improvements 2025-10-11 13:32:13 -04:00
trvon
b065e6a2c1
v0.7.5 2025-10-11 00:34:31 -04:00
trvon
ed676e5fe9
v0.7.4 2025-10-10 12:51:39 -04:00
trvon
5bb124a3c1
v0.7.3 2025-10-08 17:02:37 -04:00
trvon
b92603a4d3
linux compat fixes 2025-10-07 11:34:38 -04:00
trvon
7b9da100ff
v0.7.3 staging 2025-10-07 11:18:35 -04:00
trvon
ce3d9d526b
PBI-043: Integrate tree_diff benchmarks into nightly CI (Task 043-16)
- Add tree_diff benchmark run step to nightly workflow
- Add regression check against baseline thresholds
- Create baseline file with AC#7 metrics (tree_overhead ≤15%)
- Update artifact uploads to include tree_diff results

Validates:
- AC #2: Diff latency < 750ms p95 (10k entries)
- AC #7: Tree storage overhead ≤ 15%
- Task 043-07: Multi-snapshot dedup metrics

Progress: Task 043-16 in_progress
2025-10-07 10:52:11 -04:00
trvon
76be33677c
spec update for grep 2025-10-03 10:31:57 -04:00
trvon
72d04f66e0
v0.7.2 staging 2025-10-03 04:02:52 -04:00
trvon
66f9041b06
v0.7.1 staging before test improvement per issue tracking 2025-09-29 21:20:30 -04:00
trvon
e586892e06
checkpoint. Expanded tests and resolved minor issues with grep, ci/cd and daemon protocol add spec 2025-09-29 14:38:04 -04:00
Trevon
5fd0db37eb
test updates and prompt improvements for codex 2025-09-27 21:40:47 -04:00
Trevon
0537db6d81
Merge branch 'main' of git.sr.ht:~trvon/yams 2025-09-27 20:22:20 -04:00
Trevon
f806fc3d54
mobile compat 2025-09-27 20:22:15 -04:00
Trevon
d72994cdaf
merging sourcehut 2025-09-27 04:42:39 -04:00
Trevon
19fb4fee75
updating, stagging fixes, then will address ci 2025-09-27 04:39:58 -04:00
Trevon
0220830c3e
mobile binding and test fixes 2025-09-26 08:28:02 -04:00
Trevon
54f1364502
test flakiness improvements, ci improvements and fixes documented for v0.7.1 2025-09-26 06:40:48 -04:00
Trevon
f861fcd961
stagging v0.7.0 2025-09-25 16:40:56 -04:00