Commit graph

357 commits

Author SHA1 Message Date
trvon
161f3e30e4
cleaning up code 2026-01-21 16:54:16 -05:00
trvon
4738adba89
post ingestion pipeline governor improvements 2026-01-20 14:48:52 -05:00
trvon
ceadbd52e8
repair manager is now tuning aware with dedupe support with running jobs in post ingest 2026-01-20 14:24:51 -05:00
trvon
b3fbff0457
fixing model logic to reduce pool size when using cpu 2026-01-20 13:05:42 -05:00
trvon
9267e406bc
adding tuning tests, daemon resource advisor respects profile (efficient, balanced, aggressive), retrieval benchmark fixes 2026-01-20 12:07:30 -05:00
trvon
63286ac450
evicting model when idle, post processing in search is parallelized and additional model management improvements 2026-01-20 11:27:29 -05:00
trvon
440e8f8df3
Merge remote-tracking branch 'origin' into experimental 2026-01-20 00:12:55 -05:00
trvon
783f713318
adding tune advisor guidance and cleaning up stats ui 2026-01-20 00:11:58 -05:00
trvon
a8a6559377
dockerfile and ci fixes with improvements for model loading logic 2026-01-19 22:28:30 -05:00
trvon
cc75a5504f
benchmark fixing and pool allocation improvements 2026-01-19 21:26:04 -05:00
trvon
ad8b50ac25
cleaning up gliner pipeline and limit to a signal thread so onnx can consume the rest of the pool for embeddings 2026-01-19 19:35:34 -05:00
trvon
dabb828e7a
stagging changes for release of v0.7.11 . Working on improving retrieval 2026-01-19 18:59:06 -05:00
trvon
df3997545b
search benchmarking fixes 2026-01-19 02:50:05 -05:00
trvon
b7aa881de2
test fixes, reranking model loading improvements 2026-01-18 22:27:30 -05:00
trvon
67a3c521e0
search engine tests, hnsw bug fix and test fixes 2026-01-17 22:13:08 -05:00
trvon
f95dbae8d1
improving batch logic for inserts 2026-01-17 17:36:03 -05:00
trvon
1bf5f9a763
improving batching inserts and addressing ft5s return quality 2026-01-17 15:48:17 -05:00
trvon
f40e9cf1be
search bug fixes, and thread sanitization fixes 2026-01-16 23:06:49 -05:00
trvon
94e661ee1f
pre metadata repository refactor 2026-01-16 19:16:34 -05:00
trvon
eb87c8ec40
reducing ingestion bottlenecks with better batch operations 2026-01-16 19:04:11 -05:00
trvon
ae52598a58
batching improvements. using libsql experimental concurrency for insert. still testing search regressions. 2026-01-16 16:45:43 -05:00
trvon
a52627050c
logging improvements, test fixes and using old ranking from main 2026-01-15 11:21:51 -05:00
trvon
80ea3ca869
testing improvements 2026-01-14 16:27:42 -05:00
trvon
d5ea3875f4
embedding generation improvements 2026-01-10 21:07:20 -05:00
trvon
d3b50e4dc4
bug fixes for onnx and improving support for larger models. tuning serach engine and expanding module communication via daemon 2026-01-10 01:32:48 -05:00
trvon
d4df4efa32
Merge remote-tracking branch 'origin/main' into experimental 2026-01-09 11:52:18 -05:00
trvon
2aab228ca7
additional compat fixes for ci 2026-01-09 11:51:30 -05:00
trvon
c7743269b4
bug fixes for model loading logic, dynamic vec table dimensions, cli refactor and search bug fixes 2026-01-08 23:10:58 -05:00
trvon
83bd1b7fc1
updating entity interface and adding new plugin for entity extraction 2026-01-08 15:06:58 -05:00
trvon
bdb94e7035
removing tier search 2026-01-08 00:05:06 -05:00
trvon
b078329bc8
search regressions fixes. removed bktree for symspell 2026-01-07 23:43:12 -05:00
trvon
f32852f4b9
symspell fuzzy index optimization for search 2026-01-07 20:31:11 -05:00
trvon
f780513889
optimizations for data ingestion and search, updating documentation 2026-01-07 17:36:56 -05:00
trvon
027fdc001e
clangd fixes, moved symbol extractor to vectordb, investigating slow vector search performance 2026-01-07 10:38:05 -05:00
trvon
0bce48a899
bug fixes, extended tree dedup logic for ingestion, dynamic search engine returning with internal benchmark 2026-01-06 18:57:35 -05:00
trvon
4321f29679
profiling improvements, ft5s bug fixes for retrieval, and benchmark optimizations 2026-01-06 14:57:13 -05:00
trvon
523ab8d3b7
ingestion optimizations 2026-01-06 02:02:16 -05:00
trvon
c7c48e8934
removed hnsw vector manager. search optimizations 2026-01-05 23:39:18 -05:00
trvon
82eea28210
removing duplicate hnsw and leverage sqlite vec cpp library updates 2026-01-05 10:16:32 -05:00
trvon
b3d44b9e98
removing deprecated search executor. continuing work for rag benchmarking 2026-01-04 18:29:09 -05:00
trvon
61f06ab301
compression bug fix and adding optioanl disable for symbol re-ranking until perf issue is found 2026-01-04 08:38:19 -05:00
trvon
180db83a1b
search engine cleanup and test updates 2026-01-04 00:39:01 -05:00
trvon
b912ea0b83
compression bug fix 2026-01-03 22:38:28 -05:00
trvon
498668c2d8
ci improvements, compression stat fix, requires yams repair run without daemon running 2026-01-03 11:59:25 -05:00
trvon
485c413174
v0.7.11 staging 2026-01-03 00:17:21 -05:00
trvon
c73b899b8f
bug fixes and daemon communication improvements 2026-01-02 22:37:19 -05:00
trvon
49e3f638bc
improving daemon startup logic, improve repair and doctor cli UX 2026-01-02 13:57:37 -05:00
trvon
92ccd287b5
daemon communication imrpovements and bug fixes related to tests 2026-01-02 11:55:58 -05:00
trvon
2704a5ecf9
search performance fixes, linux build updates and test fixes 2026-01-01 15:38:46 -05:00
trvon
94d89fe0d5
bug fixes, test updates and ci improvements for TSAN test runs 2026-01-01 13:52:52 -05:00