Commit graph

87 commits

Author SHA1 Message Date
trvon
0261b90a7b
refactor(build): centralize dependency discovery and trim Meson duplication 2026-03-23 15:41:13 -04:00
trvon
9c496e674e
fix: correctness fixes for stale sqlite handles (apart of previous work), improvements in test suite and continue work for search optimizations 2026-03-22 20:06:29 -04:00
trvon
2e20416e96
feat: adding fuzz test for new download logic, removing r2 endpoint from tests, decoupling embedding / onnxruntime logic for work from previous commit 2026-03-21 18:08:23 -04:00
trvon
86ec015eea
feat: massive commit. Download logic updates with expanding controls (stop, start, resume etc.) from daemon control. This is used in my archive openclaw agent. This commit also includes work to harden onnxruntime abi access. this should allow loading newer abi's when builds are pinned to 1.23.0. 2026-03-21 17:12:47 -04:00
trvon
2a11749c57
fix: plugin bug fix for reranker 2026-03-19 16:16:41 -04:00
trvon
1c2bd4f058
feat: experimenting with parallelization of onnx reranker 2026-03-12 11:21:25 -04:00
trvon
513d43098c
feat: hardening client reponses and improving search engine precision through optimization loop 2026-03-12 11:07:18 -04:00
trvon
7a8c26110c
feat: early embeddinggemma support 2026-03-11 16:43:29 -04:00
trvon
f3399c001e
feat: adding perf optimizations for search and grep based on previous commit. Improving model logic for future embeddinggemma and improved colbert support. Re-ranking fixes for search to improve retrieval accuracy. 2026-03-11 14:15:33 -04:00
trvon
a3fd21766c
feat: reliability improvements for daemon lifecycle, submodule bumps, plugin improvements and search tuning optimizations based on benchmarks 2026-03-09 19:38:15 -04:00
trvon
31eb110391
fix: hardening release CI, addressing issues with onnxruntime linking on macos and linux and expanding benchmark 2026-03-06 08:30:14 -05:00
trvon
fdf2c323f7
fix: fixing onnxruntime linking isuses which result in degraded state on linux 2026-03-05 09:49:03 -05:00
trvon
8523b77169
feat: linking fix for onnx plugin for windows builds 2026-02-28 10:36:04 -05:00
0xkite
56cb6a66c5
Recreate last 7 commits (signed) 2026-02-24 14:32:58 -05:00
trvon
218499386b
fix: pipeline scaling fixes, post ingestion benchmark updates 2026-02-19 12:16:47 -05:00
trvon
a9bad18fa4
feat: adding additional tests, making the aggressive profile scaling better 2026-02-17 19:15:26 -05:00
trvon
6a90f8c934
feat: test improvements, ASAN fixes, and onnx model performance improvements 2026-02-17 08:59:53 -05:00
trvon
33821d93f1
feat: test hardening, added benchmark for multiclient and improve stability to support up to 16 clients before performance degrades, improved parallization and request handling in daemon ingestion pipeline 2026-02-16 15:46:16 -05:00
trvon
c4ae922b7a
feat: mobile bindings expansion, update mcp for graph operations and download tool hardening 2026-02-15 17:50:14 -05:00
trvon
94a49472f1
feat: fixing bug with multiple processes access gpu, read/write pools now added in metadata repository, and updated plugins for opencode and vscode 2026-02-14 18:16:57 -05:00
trvon
8f38ee76be
feat: updating metrics for search and retrieval for future learning system. Additional tuning for search performance 2026-02-13 21:09:26 -05:00
trvon
8256917e5e
feat: Hardening moodel logic for embedings. Adding trace-linked feedback event persistence checkpoint 2026-02-12 23:42:21 -05:00
trvon
b40b60f054
fix: bug fixes for resource limiting and onnxruntime model shapes for embeddings 2026-02-12 01:52:33 -05:00
trvon
44a94eabe1
feat: fuzzing and config expansion. Moving to optimizing ingestion. Adding tunable embedding (chunk size etc.) 2026-02-11 23:21:26 -05:00
trvon
cc28b8a343
feat: instrumented embedding for deeper insight into hotspots. Fixed CoreML scaling that resulted in high ram usage due to VRAM calculation. Expanded testing for embedding and draining of work 2026-02-11 12:07:08 -05:00
trvon
a0fd82e25c fix: Fixing issues that break windows release build. This should allow new msvc version Working on debug builds. 2026-02-10 15:03:39 -08:00
trvon
04b55be44e
fix: apply tuning logic for profiles to GPU 2026-02-10 15:49:26 -05:00
trvon
2e966c4f1b
fix: windows build fixes 2026-02-09 23:26:33 -05:00
trvon
7764a0c3c9
fix: ROCM/MIGraphX onnxruntime test validate improvements 2026-02-09 21:22:15 -05:00
trvon
288bb78c89
Merge branch 'main' of github.com:trvon/yams 2026-02-09 20:07:55 -05:00
trvon
fd32c519c5
fix: staging ROCM improvements 2026-02-09 20:07:52 -05:00
trvon
cd7c698e07
feat: stability improvements for document ingestion 2026-02-09 19:14:45 -05:00
trvon
1d255d59ce
feat: address bugs with scaling, batching in daemon processing 2026-02-09 17:07:00 -05:00
trvon
3101780fe2
feat: adding additional benchmark and validating onnxruntime model usage for embedding generations. Should be much faster 2026-02-08 21:59:14 -05:00
trvon
c83110319d
feat: benchmark, model testing / enhancements, insertion performance updates 2026-02-08 18:33:29 -05:00
trvon
a3522b8b22
fix: expose gpu usage, add command imrpovments and other bug fixes 2026-02-08 14:04:57 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
trvon
567ee32a99
fix: fixing macos coreml detection 2026-02-06 10:16:35 -05:00
trvon
df1348f3c7
fix: tuning improvements and better tests. Now working address memory issue of huge queue when ingesting allot of files 2026-02-06 04:31:09 -05:00
trvon
5b06ca7a2c
fix(onnx): ensure GPU provider defines are passed to plugin
The ONNX plugin was not receiving -DYAMS_ONNX_COREML_ENABLED=1 because
the CMake dependency method doesn't propagate COMPILE_DEFINITIONS from
Conan's pkg-config.

Changes:
- Try pkg-config first to get compile definitions with GPU flags
- Fall back to CMake method if pkg-config not available
- Add explicit platform detection fallback for macOS CoreML
- Support all GPU providers: CoreML, CUDA, DirectML, MIGraphX

Fixes GPU acceleration not being enabled despite setup.sh detecting it.
2026-02-05 12:48:07 -05:00
trvon
d0313bf303
windows onnx fixes 2026-01-24 15:50:52 -05:00
trvon
633c3ce1cc
gliner term expansion for better search and search model ranking update 2026-01-22 23:17:40 -05:00
trvon
6a714aab62
Dockerfile build fix and model improvements 2026-01-22 14:50:30 -05:00
trvon
c7fb151f3d
skipping v0.7.11 and going straight to v0.8.0. Staging pre-release 2026-01-22 14:21:32 -05:00
trvon
cb256f5066
fixing windows debug setup and adding rocm build support 2026-01-21 10:39:07 -05:00
trvon
b3fbff0457
fixing model logic to reduce pool size when using cpu 2026-01-20 13:05:42 -05:00
trvon
9267e406bc
adding tuning tests, daemon resource advisor respects profile (efficient, balanced, aggressive), retrieval benchmark fixes 2026-01-20 12:07:30 -05:00
trvon
63286ac450
evicting model when idle, post processing in search is parallelized and additional model management improvements 2026-01-20 11:27:29 -05:00
trvon
440e8f8df3
Merge remote-tracking branch 'origin' into experimental 2026-01-20 00:12:55 -05:00
trvon
783f713318
adding tune advisor guidance and cleaning up stats ui 2026-01-20 00:11:58 -05:00