Commit graph

73 commits

Author SHA1 Message Date
trvon
218499386b
fix: pipeline scaling fixes, post ingestion benchmark updates 2026-02-19 12:16:47 -05:00
trvon
a9bad18fa4
feat: adding additional tests, making the aggressive profile scaling better 2026-02-17 19:15:26 -05:00
trvon
6a90f8c934
feat: test improvements, ASAN fixes, and onnx model performance improvements 2026-02-17 08:59:53 -05:00
trvon
33821d93f1
feat: test hardening, added benchmark for multiclient and improve stability to support up to 16 clients before performance degrades, improved parallization and request handling in daemon ingestion pipeline 2026-02-16 15:46:16 -05:00
trvon
c4ae922b7a
feat: mobile bindings expansion, update mcp for graph operations and download tool hardening 2026-02-15 17:50:14 -05:00
trvon
94a49472f1
feat: fixing bug with multiple processes access gpu, read/write pools now added in metadata repository, and updated plugins for opencode and vscode 2026-02-14 18:16:57 -05:00
trvon
8f38ee76be
feat: updating metrics for search and retrieval for future learning system. Additional tuning for search performance 2026-02-13 21:09:26 -05:00
trvon
8256917e5e
feat: Hardening moodel logic for embedings. Adding trace-linked feedback event persistence checkpoint 2026-02-12 23:42:21 -05:00
trvon
b40b60f054
fix: bug fixes for resource limiting and onnxruntime model shapes for embeddings 2026-02-12 01:52:33 -05:00
trvon
44a94eabe1
feat: fuzzing and config expansion. Moving to optimizing ingestion. Adding tunable embedding (chunk size etc.) 2026-02-11 23:21:26 -05:00
trvon
cc28b8a343
feat: instrumented embedding for deeper insight into hotspots. Fixed CoreML scaling that resulted in high ram usage due to VRAM calculation. Expanded testing for embedding and draining of work 2026-02-11 12:07:08 -05:00
trvon
a0fd82e25c fix: Fixing issues that break windows release build. This should allow new msvc version Working on debug builds. 2026-02-10 15:03:39 -08:00
trvon
04b55be44e
fix: apply tuning logic for profiles to GPU 2026-02-10 15:49:26 -05:00
trvon
2e966c4f1b
fix: windows build fixes 2026-02-09 23:26:33 -05:00
trvon
7764a0c3c9
fix: ROCM/MIGraphX onnxruntime test validate improvements 2026-02-09 21:22:15 -05:00
trvon
288bb78c89
Merge branch 'main' of github.com:trvon/yams 2026-02-09 20:07:55 -05:00
trvon
fd32c519c5
fix: staging ROCM improvements 2026-02-09 20:07:52 -05:00
trvon
cd7c698e07
feat: stability improvements for document ingestion 2026-02-09 19:14:45 -05:00
trvon
1d255d59ce
feat: address bugs with scaling, batching in daemon processing 2026-02-09 17:07:00 -05:00
trvon
3101780fe2
feat: adding additional benchmark and validating onnxruntime model usage for embedding generations. Should be much faster 2026-02-08 21:59:14 -05:00
trvon
c83110319d
feat: benchmark, model testing / enhancements, insertion performance updates 2026-02-08 18:33:29 -05:00
trvon
a3522b8b22
fix: expose gpu usage, add command imrpovments and other bug fixes 2026-02-08 14:04:57 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
trvon
567ee32a99
fix: fixing macos coreml detection 2026-02-06 10:16:35 -05:00
trvon
df1348f3c7
fix: tuning improvements and better tests. Now working address memory issue of huge queue when ingesting allot of files 2026-02-06 04:31:09 -05:00
trvon
5b06ca7a2c
fix(onnx): ensure GPU provider defines are passed to plugin
The ONNX plugin was not receiving -DYAMS_ONNX_COREML_ENABLED=1 because
the CMake dependency method doesn't propagate COMPILE_DEFINITIONS from
Conan's pkg-config.

Changes:
- Try pkg-config first to get compile definitions with GPU flags
- Fall back to CMake method if pkg-config not available
- Add explicit platform detection fallback for macOS CoreML
- Support all GPU providers: CoreML, CUDA, DirectML, MIGraphX

Fixes GPU acceleration not being enabled despite setup.sh detecting it.
2026-02-05 12:48:07 -05:00
trvon
d0313bf303
windows onnx fixes 2026-01-24 15:50:52 -05:00
trvon
633c3ce1cc
gliner term expansion for better search and search model ranking update 2026-01-22 23:17:40 -05:00
trvon
6a714aab62
Dockerfile build fix and model improvements 2026-01-22 14:50:30 -05:00
trvon
c7fb151f3d
skipping v0.7.11 and going straight to v0.8.0. Staging pre-release 2026-01-22 14:21:32 -05:00
trvon
cb256f5066
fixing windows debug setup and adding rocm build support 2026-01-21 10:39:07 -05:00
trvon
b3fbff0457
fixing model logic to reduce pool size when using cpu 2026-01-20 13:05:42 -05:00
trvon
9267e406bc
adding tuning tests, daemon resource advisor respects profile (efficient, balanced, aggressive), retrieval benchmark fixes 2026-01-20 12:07:30 -05:00
trvon
63286ac450
evicting model when idle, post processing in search is parallelized and additional model management improvements 2026-01-20 11:27:29 -05:00
trvon
440e8f8df3
Merge remote-tracking branch 'origin' into experimental 2026-01-20 00:12:55 -05:00
trvon
783f713318
adding tune advisor guidance and cleaning up stats ui 2026-01-20 00:11:58 -05:00
trvon
a8a6559377
dockerfile and ci fixes with improvements for model loading logic 2026-01-19 22:28:30 -05:00
trvon
cc75a5504f
benchmark fixing and pool allocation improvements 2026-01-19 21:26:04 -05:00
trvon
df3997545b
search benchmarking fixes 2026-01-19 02:50:05 -05:00
trvon
b7aa881de2
test fixes, reranking model loading improvements 2026-01-18 22:27:30 -05:00
trvon
f624a23067
build fixes and benchmark improvements 2026-01-17 16:29:28 -05:00
trvon
0dd0a87132
adding compile support for onnxruntime 2026-01-17 16:05:20 -05:00
trvon
eb87c8ec40
reducing ingestion bottlenecks with better batch operations 2026-01-16 19:04:11 -05:00
trvon
80ea3ca869
testing improvements 2026-01-14 16:27:42 -05:00
trvon
d5ea3875f4
embedding generation improvements 2026-01-10 21:07:20 -05:00
trvon
d3b50e4dc4
bug fixes for onnx and improving support for larger models. tuning serach engine and expanding module communication via daemon 2026-01-10 01:32:48 -05:00
trvon
c7743269b4
bug fixes for model loading logic, dynamic vec table dimensions, cli refactor and search bug fixes 2026-01-08 23:10:58 -05:00
trvon
83bd1b7fc1
updating entity interface and adding new plugin for entity extraction 2026-01-08 15:06:58 -05:00
trvon
164c3e3c9d
test fixes and ci improvements 2025-12-29 03:13:55 -05:00
trvon
f2e864f051
test fixes and bug fixes 2025-12-26 16:57:13 -05:00