Commit graph

186 commits

Author SHA1 Message Date
trvon
0cdb3ab6c0
fix: testing improvements and bug fixes 2026-03-18 12:30:32 -04:00
trvon
82daf7dcf2
feat: additional cleanup from taskflow migration 2026-03-17 05:22:12 -04:00
trvon
f3399c001e
feat: adding perf optimizations for search and grep based on previous commit. Improving model logic for future embeddinggemma and improved colbert support. Re-ranking fixes for search to improve retrieval accuracy. 2026-03-11 14:15:33 -04:00
trvon
a3fd21766c
feat: reliability improvements for daemon lifecycle, submodule bumps, plugin improvements and search tuning optimizations based on benchmarks 2026-03-09 19:38:15 -04:00
trvon
d92f66d2f6
fix: fixing daemon regression for startup logic resulting in ipc eof, expanding release please to update conan file version, expanding benchmark docs 2026-03-07 21:38:35 -05:00
trvon
8f06bd615f
feat: security fixes for plugin install and adding additional UTF-8 string sanitization 2026-02-28 10:17:03 -05:00
trvon
4245090359
fix: test improvements and CI harning for slower tests 2026-02-27 20:54:34 -05:00
trvon
099bbef70d
feat: large update. Documentation update, config and plugin hardning and improvements related to loading trust. Exposed trust state in the doctor command with hints on improvements. Bug fixes and test improvements to reduce flakiness and TSAN issues 2026-02-26 11:21:29 -05:00
trvon
74e93468b9
fix: fixing daemon inflight request lock and pid regression 2026-02-25 16:24:11 -05:00
trvon
b72eb955be
feat: lint run and sandbox detection improvements for non sandbox envs 2026-02-25 13:41:09 -05:00
trvon
38629de1a1
fix: improvement of graph node source and retrieval logic and sandbox fixes in add command 2026-02-25 12:23:25 -05:00
trvon
3b1a3007ab
feat: sandbox testing expansion (sandbox relates to how the daemon communicates in sandbox). Graph optimizations for retrieval and UX improvements. Will continue improving graph system 2026-02-25 11:37:29 -05:00
trvon
c49f0ba759
feat: optimizations based on profile runs in hashing and work coordinator. test updates and correctness fixes 2026-02-24 21:06:43 -05:00
trvon
6df2332515
feat: beginning sandbox support work and retrieval optimizations 2026-02-24 17:11:19 -05:00
0xkite
56cb6a66c5
Recreate last 7 commits (signed) 2026-02-24 14:32:58 -05:00
trvon
d86ac665cd
fix: updating conanfile for onnxruntime to respect system version, updated tests for windows compat, update vectors to enforce wal check point so files does not explode in size 2026-02-21 12:20:50 -05:00
trvon
901337b135
fix: windows test fixes 2026-02-20 22:51:41 -05:00
trvon
fc284f3b37
fix: resolving TSAN issues and expanding graph building to use gliner data 2026-02-19 14:52:01 -05:00
trvon
55b2dc517f
fix: additional merge fixes and search improvements 2026-02-19 10:24:23 -05:00
trvon
207532f46a
merge: integrate main into experimental (preserve PBI-081 simplification)
Merge main's 93 commits into experimental, preserving architectural updates
decisions:

- Keep ResourceGovernor as centralized pool registry (experimental's PBI-081 Phase 2)
- Translate all PoolManager API calls to ResourceGovernor equivalents
- Remove PoolManager.{h,cpp} from build (absorbed into ResourceGovernor)
- Preserve main's enhancements: RepairService, IOCoordinator, GradientLimiter,
  embed_preparer, GPU info, plugin trust, 60+ new test files
- Take main's version for 28 of 31 conflicts (more comprehensive rewrites)
- Keep experimental's ResourceGovernor.h (expanded pool API)
- Manual merge for .vscode/settings.json (use workspace-relative paths)
2026-02-19 10:01:01 -05:00
trvon
dea5315ae3
feat: streamlining tuning and pool logic in daemon 2026-02-18 16:56:25 -05:00
trvon
a9bad18fa4
feat: adding additional tests, making the aggressive profile scaling better 2026-02-17 19:15:26 -05:00
trvon
014e12c975
fix: testing improvements and bug fixes in daemon logic for lifecycle management 2026-02-17 15:55:29 -05:00
trvon
be77f1f4d3
feat: additional test improvements, improved logic for ingestion queue to increase throughput and client stability 2026-02-16 18:13:54 -05:00
trvon
33821d93f1
feat: test hardening, added benchmark for multiclient and improve stability to support up to 16 clients before performance degrades, improved parallization and request handling in daemon ingestion pipeline 2026-02-16 15:46:16 -05:00
trvon
8516a1b779
feat: tuning improvements with expanded db metrics, package hardening and updated tests 2026-02-15 17:52:43 -05:00
trvon
c4ae922b7a
feat: mobile bindings expansion, update mcp for graph operations and download tool hardening 2026-02-15 17:50:14 -05:00
trvon
94a49472f1
feat: fixing bug with multiple processes access gpu, read/write pools now added in metadata repository, and updated plugins for opencode and vscode 2026-02-14 18:16:57 -05:00
trvon
8f38ee76be
feat: updating metrics for search and retrieval for future learning system. Additional tuning for search performance 2026-02-13 21:09:26 -05:00
trvon
a44c2fb4af
feat: implementing embedding chunking strategy and two staged ingestion that processes then distributes document data 2026-02-12 00:46:04 -05:00
trvon
4ecdbe7d73
fix: moved SocketServer read/write into dedicated IOCoordinator and fixed proxy socket paths resolution logic. Fixed TSAN race in SymSpell init 2026-02-11 14:40:23 -05:00
trvon
cc28b8a343
feat: instrumented embedding for deeper insight into hotspots. Fixed CoreML scaling that resulted in high ram usage due to VRAM calculation. Expanded testing for embedding and draining of work 2026-02-11 12:07:08 -05:00
trvon
ff77c6b304
fix: improving socket and chunking reliability and robustness. Added better regression tests and errror logging logic for state connections 2026-02-10 12:25:30 -05:00
trvon
00c3a76771
feat: recovery test improvements 2026-02-09 23:27:12 -05:00
trvon
7764a0c3c9
fix: ROCM/MIGraphX onnxruntime test validate improvements 2026-02-09 21:22:15 -05:00
trvon
288bb78c89
Merge branch 'main' of github.com:trvon/yams 2026-02-09 20:07:55 -05:00
trvon
fd32c519c5
fix: staging ROCM improvements 2026-02-09 20:07:52 -05:00
trvon
cd7c698e07
feat: stability improvements for document ingestion 2026-02-09 19:14:45 -05:00
trvon
1d255d59ce
feat: address bugs with scaling, batching in daemon processing 2026-02-09 17:07:00 -05:00
trvon
0c8ffea321
feat: improving ingestion speed with kg batch and updating metrics to use constexpr 2026-02-09 01:33:24 -05:00
trvon
3101780fe2
feat: adding additional benchmark and validating onnxruntime model usage for embedding generations. Should be much faster 2026-02-08 21:59:14 -05:00
trvon
f4f3c055fe
feat: benchmark expansion and normalization. Imrpoving metrics for repair and models 2026-02-08 20:35:39 -05:00
trvon
c83110319d
feat: benchmark, model testing / enhancements, insertion performance updates 2026-02-08 18:33:29 -05:00
trvon
ac843d1e93
Merge branch 'main' of github.com:trvon/yams 2026-02-08 14:06:09 -05:00
trvon
a3522b8b22
fix: expose gpu usage, add command imrpovments and other bug fixes 2026-02-08 14:04:57 -05:00
trvon
c4a7992122
fix: repairmanager, post ingest and pipeline fixes 2026-02-08 14:02:57 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
trvon
567ee32a99
fix: fixing macos coreml detection 2026-02-06 10:16:35 -05:00
trvon
df1348f3c7
fix: tuning improvements and better tests. Now working address memory issue of huge queue when ingesting allot of files 2026-02-06 04:31:09 -05:00
trvon
ab06614505
fix(repair): fix SIGSEGV crash, embedding failures, and runaway repair loops
- Fix writer_drain() SIGSEGV by setting connection_closing_ on write failure
- Add InternalError/ResourceExhausted to embedding retry list
- Fix document-level embedding chunk_id (0→999999) and level mismatch
- Add circuit breaker to bail out after consecutive/rate-threshold failures
- Add semaphore concurrency limiter (max 2) for repair embed requests
- Replace silent catch-all with error-logging catch blocks
2026-02-05 21:15:26 -05:00