Commit graph

49 commits

Author SHA1 Message Date
Trevon
0dd3985db4
refactor: simplify runtime paths and harden retrieval (#61)
* refactor(tuning): prune dormant runtime knobs

Remove unused tuning controls and adaptive search budget state. Extract testable ONNX slot reconciliation and search telemetry hydration seams, and correct the Apple Silicon sysctl value width.

* refactor(vector): retire dormant backends

Remove unused FAISS, model-infrastructure, VectorIndexManager, and TurboQuant paths while keeping Simeon PQ and float-vector storage.

Migrate unused V2.2 quantized schemas transactionally to V2.3. Databases containing non-default quantized formats or packed-code blobs fail closed with recovery guidance and no mutation.

* refactor(plugins): remove legacy SDK tooling

Remove the Ghidra and SDK submodules, their bespoke tests, and stale scan exclusions. Retain generic PluginProcess coverage against the repository mock fixture.

* build(vector): remove stale FAISS overrides

* refactor(ipc): remove dormant FSM snapshots

* refactor(ingest): unify bounded KG enqueue

* fix(plugins): harden allocation contracts

Keep ABI outputs null or fully initialized when allocations fail, and represent empty object payloads without relying on malloc(0).

* fix(storage): define empty object reads

Return a null buffer with zero length for successful empty-object reads instead of treating malloc(0) as an allocation contract.

* refactor(storage): trim through string views

* test: prune dormant harness helpers

Remove unused readiness and fixture helpers, and keep benchmark client-count doubling in a wide integer domain.

* chore(cpp): initialize analyzer-facing locals

* build(simeon): advance analyzer cleanup

* refactor(config): drop dead daemon client keys

* refactor(ipc): inject daemon client transport

Socket and in-process execution now share DaemonClient request dispatch, so CLI fallbacks do not need alternate service paths.

* refactor(retrieval): route CLI through daemon

Search and grep now use the same daemon handlers over socket or in-process transport. Live grep remains an explicit freshness inspection.

* refactor(graph): move CLI scope into daemon

Graph CLI requests now share daemon handlers across socket and in-process transports. CWD filtering occurs before pagination so scoped totals and pages stay correct.

* build: isolate test-only runtime controls

* refactor(metadata): decouple lock telemetry

* fix(services): return on request timeout

* fix(retrieval): enforce workspace scope

* fix(graph): scope nodes before pagination

* fix(grep): drop binary result lines

* fix(daemon): bound checkpoint wait

* fix(repair): use KG health checks

* fix(storage): always verify compressed CRC

* perf(vector): skip unchanged PQ snapshots

* build(zyp): exclude bench from default build

* build: protect Meson files from formatter

* refactor: remove unreachable production APIs

* refactor(daemon): remove dormant runtime state

* fix(vector): harden daemon provider calls

Timed-out coroutines must own their client and requests. Provider discovery must also fail instead of returning synthetic embeddings in production.

* refactor(storage): remove unusable adapters

* fix(cli): unify in-process add requests

* fix(tsan): preserve async worker progress

* test(cli): isolate daemon-dependent suites

* fix(repair): expose queue backoff progress
2026-07-31 14:16:45 -04:00
trvon
801980ce11
fix: fixing onnx model logic so that memory does not hold indefinitely. Removing re-ranker logic from plugin 2026-04-21 11:49:12 -04:00
trvon
2d0df863b7
fix: improved plugin locking around onnx session state and ownership improvements 2026-04-12 00:33:08 -04:00
trvon
fff1ca19ac
fix: address regressions in onnx runtime generation from previous commit. Addressing critical bugs 2026-04-07 21:24:59 -04:00
trvon
814672f4dd
feat: removing unnecessary abstraction and adding some optimizations for embeddings generation 2026-04-07 18:04:34 -04:00
trvon
e8a6296797
fix: re-ranker embedding generation fix, test failures drift fix, search improvements for graph query expansion and gliner improvements for building graph 2026-04-06 18:38:54 -04:00
trvon
3f3ba0582d
fix: release please fix, improvements for embedding generation (check if model is loading an query that). continue work on search retrieval improvement related to on going graph improvements 2026-04-06 07:07:36 -04:00
trvon
a0b4915bcd
fix: bypass broken Gemma CoreML path and restore ANN/TurboQuant search 2026-04-01 21:09:22 -04:00
trvon
9c496e674e
fix: correctness fixes for stale sqlite handles (apart of previous work), improvements in test suite and continue work for search optimizations 2026-03-22 20:06:29 -04:00
trvon
86ec015eea
feat: massive commit. Download logic updates with expanding controls (stop, start, resume etc.) from daemon control. This is used in my archive openclaw agent. This commit also includes work to harden onnxruntime abi access. this should allow loading newer abi's when builds are pinned to 1.23.0. 2026-03-21 17:12:47 -04:00
trvon
2a11749c57
fix: plugin bug fix for reranker 2026-03-19 16:16:41 -04:00
trvon
a3fd21766c
feat: reliability improvements for daemon lifecycle, submodule bumps, plugin improvements and search tuning optimizations based on benchmarks 2026-03-09 19:38:15 -04:00
trvon
6a90f8c934
feat: test improvements, ASAN fixes, and onnx model performance improvements 2026-02-17 08:59:53 -05:00
trvon
cc28b8a343
feat: instrumented embedding for deeper insight into hotspots. Fixed CoreML scaling that resulted in high ram usage due to VRAM calculation. Expanded testing for embedding and draining of work 2026-02-11 12:07:08 -05:00
trvon
cd7c698e07
feat: stability improvements for document ingestion 2026-02-09 19:14:45 -05:00
trvon
a3522b8b22
fix: expose gpu usage, add command imrpovments and other bug fixes 2026-02-08 14:04:57 -05:00
trvon
448f5e47b4
fix: fixing repairmanager logic, windows build issues, linting, resource scaling 2026-02-07 22:07:56 -05:00
trvon
df1348f3c7
fix: tuning improvements and better tests. Now working address memory issue of huge queue when ingesting allot of files 2026-02-06 04:31:09 -05:00
trvon
633c3ce1cc
gliner term expansion for better search and search model ranking update 2026-01-22 23:17:40 -05:00
trvon
6a714aab62
Dockerfile build fix and model improvements 2026-01-22 14:50:30 -05:00
trvon
c7fb151f3d
skipping v0.7.11 and going straight to v0.8.0. Staging pre-release 2026-01-22 14:21:32 -05:00
trvon
b3fbff0457
fixing model logic to reduce pool size when using cpu 2026-01-20 13:05:42 -05:00
trvon
9267e406bc
adding tuning tests, daemon resource advisor respects profile (efficient, balanced, aggressive), retrieval benchmark fixes 2026-01-20 12:07:30 -05:00
trvon
63286ac450
evicting model when idle, post processing in search is parallelized and additional model management improvements 2026-01-20 11:27:29 -05:00
trvon
440e8f8df3
Merge remote-tracking branch 'origin' into experimental 2026-01-20 00:12:55 -05:00
trvon
783f713318
adding tune advisor guidance and cleaning up stats ui 2026-01-20 00:11:58 -05:00
trvon
a8a6559377
dockerfile and ci fixes with improvements for model loading logic 2026-01-19 22:28:30 -05:00
trvon
cc75a5504f
benchmark fixing and pool allocation improvements 2026-01-19 21:26:04 -05:00
trvon
df3997545b
search benchmarking fixes 2026-01-19 02:50:05 -05:00
trvon
b7aa881de2
test fixes, reranking model loading improvements 2026-01-18 22:27:30 -05:00
trvon
d3b50e4dc4
bug fixes for onnx and improving support for larger models. tuning serach engine and expanding module communication via daemon 2026-01-10 01:32:48 -05:00
trvon
83bd1b7fc1
updating entity interface and adding new plugin for entity extraction 2026-01-08 15:06:58 -05:00
trvon
f2e864f051
test fixes and bug fixes 2025-12-26 16:57:13 -05:00
trevon
df75484d89
search bug fixes and ingestion optimizations 2025-12-22 13:16:16 -05:00
trevon
5656833b46
embeddings fix 2025-12-22 01:07:38 -05:00
trvon
e24a85651a
plugin install path update, daemon status fixes, lint run 2025-12-20 18:13:54 -05:00
trevon
492e7ed5dd
graph improvements and plugin fixes for windows 2025-12-20 16:46:46 -05:00
trevon
e72f97ad7e
fixing entity extracting plugin logic, treesitter plugin (expanding functions), and onnx plugin on windows 2025-12-20 01:04:33 -05:00
trvon
aacd7af41f
running linter 2025-12-13 16:27:07 -05:00
trevon
b82a3ccd36
grammar and symbol extractor bug fixes 2025-12-13 14:50:44 -05:00
trevon
86378b8cb6
testing improvements, bug fixes for plugin loading and logic. Search engine bug fix 2025-12-12 04:54:25 -05:00
trevon
e60e82c4f0
improvements for v0.7.10 2025-12-11 22:07:22 -05:00
trvon
b9d73ea60e
additional improvements (check the changelog), and clang tidy fixes. working to stabilize build before v0.7.7 so the tag is deleted 2025-11-04 14:43:42 -05:00
trvon
82f5748624
staging plugin updates 2025-10-23 23:47:28 -04:00
trvon
8069318bf2
weekly update staged. 2025-10-18 00:39:19 -04:00
trvon
ed676e5fe9
v0.7.4 2025-10-10 12:51:39 -04:00
Trevon
6d67ef0f89
v0.6.20 2025-09-13 22:01:36 -04:00
Trevon
df92bef1f0
v0.6.19 2025-09-13 16:24:08 -04:00
Trevon
956c43b80b
v0.6.12 experiemental 2025-09-11 11:28:42 -04:00