Commit graph

185 commits

Author SHA1 Message Date
Trevon
7df64b1161
perf(search): bound topology routing and harden runtime paths (#59)
* fix: address review build issues

* perf(search): bound topology routing

Cache route membership, shortlist centroids with static ANN, and route SPQ through explicit allowed-document budgets.

* test(xplan): measure routed vector work

Pin benchmark binary identity and export route, cache, and phase costs for repeated equal-budget comparisons.

* test(search): use portable jthread wrapper

* fix(daemon): serialize detached cancellation

* fix(cli): honor pinned daemon sockets

* fix(xplan): support Windows contract imports

* fix(list): apply metadata filters before paging

* docs(prompts): require memory hydration

Treat search results as candidates and hydrate selected artifacts before use. Quote argument hints for strict YAML loaders.

* test(cli): keep add on pinned daemon

* test(metadata): isolate performance timing

* fix(graph): tolerate stale snippet ranges

Source files may change before persisted symbol metadata is refreshed. Omit stale snippets instead of aborting graph exploration.

* test(daemon): await request readiness

Reuse the retrying list probe before asserting post-shutdown error quality under sanitizer load.

* ci(release): use hosted cmake

Resolve Conan CMake tool requirements from PATH so cold ARM64 caches do not depend on cmake.org. Default BUILD_DIR for failure cleanup.
2026-07-19 14:53:10 -04:00
trvon
80738eb3e8
fix(release): repair package repo publish
Arch repo metadata and R2 uploads need to be reproducible from CI, with retry hardening for transient Cloudflare failures.
2026-07-05 23:33:37 -04:00
trvon
9b7dbacdf6
fix(ci): stabilize Windows release builds 2026-07-05 15:56:52 -04:00
trvon
43ebe26d36
fix: ci stabilizations for release 2026-07-04 09:28:59 -04:00
trvon
b2ede10e54
fix: stabilize CI release gates
Fix DB vacuum, compression gates, fuzzy search, temp dirs.
   Repair release packaging: Bash 3.2, Arch containers,
   package validation defaults, artifact names, matrix metadata.

   Local tests + release act lane pass.
2026-07-03 22:40:05 -04:00
trvon
bed8578857
fix(ci): stablize ci 2026-07-02 21:34:18 -04:00
trvon
e58aef6cf5
fix(ci): isolate arch package builds
- stop arch lanes from reusing build/release
   - fix local arch lane quoting
   - align release arch lane with isolated build dirs
2026-07-01 10:02:54 -04:00
trvon
5ce5e6a774
feat: Arch Linux packaging + CI
Add arch:
   - PKGBUILD + yams.install in packaging/arch/
   - build-arch-pkg.sh (pacman deps, makepkg, repo-add)
   - arch-lane.Dockerfile systemd validation substrate
   - arch-package.Dockerfile pre-baked CI builder
   - package-lane.sh --only arch (build + validate local lane)
   - package-validate.sh Arch lane (pacman -U/-R smoke-test)
   - release.yml: 2 new matrix entries, arch-repo metadata, R2 upload
   - publish-repos.yml: arch-repo download + R2 upload
   - yams-repo worker: /archrepo route, .pkg.tar.zst + .db/.files types
2026-07-01 05:50:59 +00:00
Trevon
090a5ca69c
fix(testing): stabilize TSAN coverage, harden daemon shutdown, and speed up KG/storage paths (#53)
* perf(search, metadata): add KG write buffer, score cache, adaptive budgets

* perf(indexing): wire KGWriteBuffer into indexing service

   Converts per-document addEdgesUnique calls into batched flush via
   KGWriteBuffer.  500-doc ingest: 500 SQL round-trips → 1 batch.

   Verified: 14.2× edge insert gap (14.8K→195K edges/s) in kg_edge bench.
   Tests: 10/10 Catch2 pass (105 assertions).

* perf(storage): add fsync durability, parallel batch, read integrity

* test(storage): add stress, crash-sim, cold-cache, batch benchmarks

* fix: CI optimizations and work coordinator shutdown fix

* fix(testing): stabilize TSAN coverage gate

* fix: harden KG flush, score cache, and benches

   - keep KG buffers intact when batch commit fails
   - count flushed edges per batch instead of lifetime totals
   - guard the Simeon score cache and clear it on rebuild
   - fall back to fsync when F_FULLFSYNC fails on macOS
   - remove interactive sudo from cold-cache benchmarks
2026-06-26 17:57:02 -04:00
trvon
aea9b64404
feat(packaging): mature systemd service install + local validation 2026-06-24 12:57:16 -04:00
trvon
8b7bfe575d
feat: improved search fusion logic and tuning parameters. CI improvements, reverting to push with wrangler in CI. Experimenting with vector rebuild to address additional lost overhead in search 2026-05-05 08:58:20 -04:00
trvon
77dad749af
docs: revert CHANGELOG.md to condensed version, update release to fix overwrite attempt in release asset stage 2026-05-04 15:32:02 -04:00
trvon
e0b288f4e0
ci: improve release please configuration and CHANGELOG 2026-05-04 11:11:45 -04:00
trvon
75e7dcfa47
ci: windows ci improvements 2026-05-03 05:39:54 -04:00
trvon
e88578a9fc
feat: adding support for phss vector search, test fixes, daemon status regression fix, ci fixes for docker builds with new third-party library 2026-04-23 11:02:18 -04:00
trvon
127bc9e9e0
fix: fixing leakage of build artifacts in release, unifying repair path, adding cache to tuning path and bumping simeon version 2026-04-23 10:20:25 -04:00
trvon
76f917051f
fix: fixing apt update, re-rolling gpg public key 2026-04-18 21:08:25 -04:00
trvon
8b9a443280
fix: fixing ci push to repo 2026-04-18 18:39:40 -04:00
trvon
e8ddb31145
fix: address ci source venv and graph repair timeouts 2026-04-17 14:13:35 -04:00
trvon
a1253d1f69
feat: fixing brittleness in CI pip usage that breaks under package updates and system delayed updates. Improving graph repair process and reducing locks in ingestion pipeline 2026-04-17 12:32:00 -04:00
trvon
01c72ec828
fix: test and ci fixes and search improvements. Adding a router for tuning logic 2026-04-09 09:31:00 -04:00
trvon
13be8fdfa0
feat: checkpoint for updated unit test for daemon communication / protobuf errors. Expanding untested surface with optimizations for communication and ingestion. Additional work for ci apt / rpm install improvements, systemd configuration for installs and improved validation testing of packaging logic to reduce gpg errors. 2026-04-08 11:39:15 -04:00
trvon
3f3ba0582d
fix: release please fix, improvements for embedding generation (check if model is loading an query that). continue work on search retrieval improvement related to on going graph improvements 2026-04-06 07:07:36 -04:00
trvon
58a8cf8efe
feat: homebrew fixes for nightly formula install 2026-03-24 09:29:16 -04:00
trvon
9091a9fa5d
fix: ci fixes, coverage improvements and test improvements and bugs fixes 2026-03-22 17:27:34 -04:00
trvon
451b44147b
fix: fixing ci upload and release trigging logic 2026-03-15 03:11:25 -04:00
trvon
8af4d3524e
feat: starting remote storage work, config v3, and config migration 2026-03-07 10:34:48 -05:00
trvon
31eb110391
fix: hardening release CI, addressing issues with onnxruntime linking on macos and linux and expanding benchmark 2026-03-06 08:30:14 -05:00
trvon
fdf2c323f7
fix: fixing onnxruntime linking isuses which result in degraded state on linux 2026-03-05 09:49:03 -05:00
trvon
ca7a491493
fix: updating gpg signing and homebrew logic for releases 2026-03-05 07:51:11 -05:00
trvon
a2ec698b9e
feat: fixing ci for windows packaging 2026-03-05 00:34:46 -05:00
trvon
3e7624ce7f
fix(ci): recover release-please to release handoff 2026-02-28 16:09:49 -05:00
trvon
8e6c52c663
feat: post installation fix for homebrew to enable packaged plugins 2026-02-27 22:34:24 -05:00
trvon
5a764ac2cc
feat: updating brew install guide 2026-02-27 22:02:35 -05:00
trvon
4edc40a561
feat: updating homebrew formulas to correctly link nightly builds 2026-02-27 21:46:56 -05:00
trvon
8174f2afd5
feat: updating release to properly sign packages 2026-02-26 10:47:40 -05:00
trvon
3b1a3007ab
feat: sandbox testing expansion (sandbox relates to how the daemon communicates in sandbox). Graph optimizations for retrieval and UX improvements. Will continue improving graph system 2026-02-25 11:37:29 -05:00
trvon
dd8b7a4d90
feat: release please update 2026-02-24 21:07:27 -05:00
trvon
f7819d08d4
fix: ci and repo updates 2026-02-20 22:31:17 -05:00
trvon
014e12c975
fix: testing improvements and bug fixes in daemon logic for lifecycle management 2026-02-17 15:55:29 -05:00
trvon
f6251f6982
fix: performance updates, v0.8.2 pre-staging 2026-02-01 17:48:19 -05:00
trvon
8835d6704e
fix: removing mobile bindings from builds 2026-01-31 17:15:25 -05:00
trvon
d6d926801b
fix: nightly fixes for homebrew, daemon fixes and install logic improvements 2026-01-31 13:46:37 -05:00
trvon
bb23aff879
homebrew formula logic fix 2026-01-24 16:57:03 -05:00
trvon
8a3b4f90a2
ci improvements and windows compat fixes 2026-01-21 09:51:31 -05:00
trvon
f624a23067
build fixes and benchmark improvements 2026-01-17 16:29:28 -05:00
trvon
9844b82d6b
ci and tests improvements 2026-01-08 14:16:38 -05:00
trvon
866ee12efc
zig versioning fix 2025-12-31 15:18:17 -05:00
trvon
9246ab5813
ci fixes 2025-12-31 15:04:51 -05:00
trvon
bc71d36534
migrated pdf plugin, daemon shutdown logic fix 2025-12-31 14:46:07 -05:00