trvon
|
b06e9335b9
|
staging v0.7.8. running benchmarks on updated search engine and improving code for testing/benchmarking
|
2025-11-13 10:27:10 -05:00 |
|
trvon
|
352ee45a69
|
updating files with linter run
|
2025-11-11 10:11:27 -05:00 |
|
trvon
|
12fc1b8a50
|
resolved concurrency bugs in daemon. added fuzzing work in progress per issue #8
|
2025-11-11 10:10:07 -05:00 |
|
trvon
|
ebd0701054
|
search and retrieval optimizations leveraging parallel processing introduced with grep
|
2025-11-09 08:42:21 -05:00 |
|
trvon
|
c1d6a992fc
|
feat(search): implement parallel post-processing (PBI-001 Phase 3)
Parallel Post-Processor with Threshold-Based Activation
--------------------------------------------------------
- New ParallelPostProcessor class (120 lines header, 247 lines impl)
- Uses std::async for concurrent facet/highlight/snippet generation
- Threshold = 100 results (sequential below, parallel at/above)
- Facets now operate on filtered results (fixed data flow bug)
Performance Results (100 iterations)
------------------------------------
- 100 results: 0.06ms (~1.66M ops/sec) - sequential path
- 500 results: 0.23ms (~2.21M ops/sec) - parallel path
- 1000 results: 0.43ms (~2.32M ops/sec) - parallel path
- Speedup: ~3.4x faster at 1000 results
Test Coverage
-------------
- 5 unit tests (threshold behavior, facets, snippets, edge cases)
- All tests passing (5/5 ✅)
- 3 benchmarks added to search_benchmarks.cpp
Files Changed
-------------
- include/yams/search/parallel_post_processor.hpp (NEW)
- src/search/parallel_post_processor.cpp (NEW)
- src/search/search_executor.cpp (integrated)
- tests/unit/search/search_executor_test.cpp (+6 tests)
- tests/benchmarks/search_benchmarks.cpp (+3 benchmarks)
- CHANGELOG.md (documented with measured results)
- docs/delivery/001/prd.md (Phase 3 → ✅ COMPLETED)
Technical Details
-----------------
- Parallel path: filtering → parallel(facets + highlights) → wait
- Sequential path: identical logic, no std::async overhead
- Correctness preserved: identical output to previous sequential impl
- Build: 46/46 targets compiling successfully
|
2025-11-09 08:04:15 -05:00 |
|
trvon
|
52d27169c9
|
re-running lint
|
2025-11-09 02:24:39 -05:00 |
|
trvon
|
66825f8219
|
grep bug fixes and performance improvements
|
2025-11-09 02:24:07 -05:00 |
|
trvon
|
4702a345ad
|
ci fixes, test updates and documentation imrpovements
|
2025-11-07 13:20:58 -05:00 |
|
trvon
|
eba47216a3
|
search engine improvements
|
2025-11-07 11:08:32 -05:00 |
|
trvon
|
c0fde23eb5
|
small bug fixes for retrieval
|
2025-11-06 17:00:34 -05:00 |
|
trvon
|
d989da66dd
|
fixing prune command and tests fixes
|
2025-11-06 12:19:08 -05:00 |
|
trvon
|
0cd1bd0b4c
|
stabilizations. removing http as I am not using it. Focusing on streamlining build and system
|
2025-11-05 10:52:27 -05:00 |
|
trvon
|
97cfe741e5
|
clang tidy fixes and macos crash fix
|
2025-11-04 18:31:58 -05:00 |
|
trvon
|
b9d73ea60e
|
additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted
|
2025-11-04 14:43:42 -05:00 |
|
trvon
|
166d8c520d
|
staging v0.7.7
|
2025-11-01 16:02:12 -04:00 |
|
trvon
|
bbf23bb190
|
test migrations to catch2, service manager + socket server refactor for better startup performance. search bug fixes
|
2025-10-29 23:08:09 -04:00 |
|
trvon
|
61d5074c8b
|
import and linux fixes for linux builds
|
2025-10-24 15:03:12 -04:00 |
|
trvon
|
4135535c31
|
linux build fixes
|
2025-10-24 14:13:20 -04:00 |
|
trvon
|
d19a5d7b64
|
bug fixes and optimizations for v0.7.7. Finalizing tests, benchmarks and bug fixes prior to release
|
2025-10-24 12:49:00 -04:00 |
|
trvon
|
027a99ceaa
|
adding additional headers
|
2025-10-20 16:12:01 -04:00 |
|
trvon
|
b6ca31dfb0
|
adding symbol extraction work, simplying build with ./setup.sh, updated plugin tests with new meson shard and other goodies
|
2025-10-20 16:11:31 -04:00 |
|
trvon
|
8069318bf2
|
weekly update staged.
|
2025-10-18 00:39:19 -04:00 |
|
trvon
|
83fa1ad1ba
|
v0.7.5 staging and license updates
|
2025-10-13 17:07:31 -04:00 |
|
trvon
|
0aa529bd5e
|
improvements, benchmark updates and test improvements
|
2025-10-11 13:32:13 -04:00 |
|
trvon
|
b065e6a2c1
|
v0.7.5
|
2025-10-11 00:34:31 -04:00 |
|
trvon
|
ed676e5fe9
|
v0.7.4
|
2025-10-10 12:51:39 -04:00 |
|
trvon
|
5bb124a3c1
|
v0.7.3
|
2025-10-08 17:02:37 -04:00 |
|
trvon
|
b92603a4d3
|
linux compat fixes
|
2025-10-07 11:34:38 -04:00 |
|
trvon
|
7b9da100ff
|
v0.7.3 staging
|
2025-10-07 11:18:35 -04:00 |
|
trvon
|
ce3d9d526b
|
PBI-043: Integrate tree_diff benchmarks into nightly CI (Task 043-16)
- Add tree_diff benchmark run step to nightly workflow
- Add regression check against baseline thresholds
- Create baseline file with AC#7 metrics (tree_overhead ≤15%)
- Update artifact uploads to include tree_diff results
Validates:
- AC #2: Diff latency < 750ms p95 (10k entries)
- AC #7: Tree storage overhead ≤ 15%
- Task 043-07: Multi-snapshot dedup metrics
Progress: Task 043-16 in_progress
|
2025-10-07 10:52:11 -04:00 |
|
trvon
|
76be33677c
|
spec update for grep
|
2025-10-03 10:31:57 -04:00 |
|
trvon
|
72d04f66e0
|
v0.7.2 staging
|
2025-10-03 04:02:52 -04:00 |
|
trvon
|
66f9041b06
|
v0.7.1 staging before test improvement per issue tracking
|
2025-09-29 21:20:30 -04:00 |
|
trvon
|
e586892e06
|
checkpoint. Expanded tests and resolved minor issues with grep, ci/cd and daemon protocol add spec
|
2025-09-29 14:38:04 -04:00 |
|
Trevon
|
5fd0db37eb
|
test updates and prompt improvements for codex
|
2025-09-27 21:40:47 -04:00 |
|
Trevon
|
0537db6d81
|
Merge branch 'main' of git.sr.ht:~trvon/yams
|
2025-09-27 20:22:20 -04:00 |
|
Trevon
|
f806fc3d54
|
mobile compat
|
2025-09-27 20:22:15 -04:00 |
|
Trevon
|
d72994cdaf
|
merging sourcehut
|
2025-09-27 04:42:39 -04:00 |
|
Trevon
|
19fb4fee75
|
updating, stagging fixes, then will address ci
|
2025-09-27 04:39:58 -04:00 |
|
Trevon
|
0220830c3e
|
mobile binding and test fixes
|
2025-09-26 08:28:02 -04:00 |
|
Trevon
|
54f1364502
|
test flakiness improvements, ci improvements and fixes documented for v0.7.1
|
2025-09-26 06:40:48 -04:00 |
|
Trevon
|
f861fcd961
|
stagging v0.7.0
|
2025-09-25 16:40:56 -04:00 |
|
Trevon
|
3c310604f9
|
ci improvements for linux x86 build. mcp regression fixes
|
2025-09-25 15:16:38 -04:00 |
|
Trevon
|
a29ed05d80
|
adding missing header to github, updating github ci warm logic
|
2025-09-25 11:16:00 -04:00 |
|
Trevon
|
e39ccefae4
|
test expansion from meson migration and ci improvements
|
2025-09-24 18:42:35 -04:00 |
|
Trevon
|
463bd9c367
|
test improvements, search bug fixes, sourcehut build patches
|
2025-09-24 11:33:55 -04:00 |
|
Trevon
|
9f4c3b734c
|
test framework stabilizations and bug fixes
|
2025-09-23 22:07:22 -04:00 |
|
Trevon
|
d99ef81a16
|
additional merge resolutions and ci fixes
|
2025-09-23 14:25:16 -04:00 |
|
Trevon
|
0e1a665d6c
|
Merge branch 'main' of github.com:trvon/yams
|
2025-09-23 13:22:22 -04:00 |
|
Trevon
|
eec3397508
|
mobile compatability
|
2025-09-23 13:21:21 -04:00 |
|
