Commit graph

88 commits

Author SHA1 Message Date
github-actions[bot]
791095a70d
chore(main): release 0.20.5 2026-10-03 02:11:51 +00:00
github-actions[bot]
db46d22e78
chore(main): release 0.20.4 2026-10-02 18:34:29 +00:00
trvon
ca944de51b
build: trim Meson options and build only the Boost libraries YAMS links
meson_options.txt had 47 options. Several were read but never set by
any workflow, script or doc, several only fed test-lane timeouts, and
enable-{tsan,asan,ubsan} duplicated b_sanitize. 47 -> 33.

Removed (behavior kept at the previous default everywhere):
- require-fts5 (configure now always errors on a SQLite without FTS5,
  the old default), conan-generators-dir, cli11-cmake-path,
  onnxruntime-cmake-path (Conan/CMake discovery under the build dir is
  unchanged), split-debug.
- unit-timeout, integration-timeout, integration-ui-timeout,
  integration-smoke-timeout, integration-daemon-timeout and stress-iters:
  replaced by the same constants at their call sites (smoke keeps its
  test-timeout-scale multiplier). Only meson/profiles/ci-fast.ini and
  nightly-soak.ini set them, and nothing used those profiles; both go.
- enable-integration-services/-smoke and enable-daemon-integration:
  folded into enable-integration-tests. Debug builds still register every
  integration suite; nothing set the sub-toggles.

Kept, because third_party/symspell's meson.build reads them:
bench-timeout, enable-tsan and enable-asan. YAMS itself now derives all
sanitizer handling (extra flags, TSan runtime links, test timeouts) from
b_sanitize; setup.sh still mirrors its choice into enable-tsan/asan for
the submodule, and the CI ASan lane keeps -Denable-asan=true for the
same reason. enable-ubsan is a deprecated no-op (a warning if it
disagrees with b_sanitize) so build dirs configured with it still
regenerate; the UBSan lane passes only -Db_sanitize=undefined and still
gets -fno-sanitize-recover=all (standalone UBSan aborts; ASan+UBSan stays
recoverable, as before).

Conan: the without_* Boost list was applied only to iOS/Android. YAMS
uses Boost.Asio (header-only) and links only boost_system/boost_thread
on every platform (asio/ssl uses OpenSSL directly; no spawn/context), so
the list now applies everywhere. Debug Boost package on grim: 45 static
libraries / 229 MiB -> 10 / 6.8 MiB (Release: 45 / 30 MiB before).

Verified on grim: ./setup.sh Debug --no-tsan --with-tests reconfigures
an existing build/debug and builds; an existing build/release (configured
with -Denable-tsan/-Denable-asan) regenerates.

Signed-off-by: trvon <me@trevon.dev>
2026-10-01 18:52:34 -06:00
github-actions[bot]
75cc85fd0e
chore(main): release 0.20.3 2026-09-30 11:51:52 +00:00
github-actions[bot]
787684c730
chore(main): release 0.20.2 (#204)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-09-24 19:59:51 -06:00
github-actions[bot]
6119532928
chore(main): release 0.20.1 2026-09-25 00:05:39 +00:00
github-actions[bot]
c937648f4d
chore(main): release 0.20.0 2026-09-24 16:21:34 +00:00
trvon
66e59d305f
build: make the deprecated ONNX Runtime integration opt-in
Default builds no longer pull onnxruntime: conan enable_onnx and the conan
profiles default to False, meson enable-onnx defaults to disabled and skips
onnxruntime discovery entirely, and setup.sh/setup.ps1 only enable ONNX
(and the ONNX-backed Glint plugin) with --with-onnx / -WithOnnx.
YAMS_DISABLE_ONNX=true still forces it off.

This removes a build blocker on hosts where conan tries to build
onnxruntime from source (e.g. ROCm/MIGraphX on Linux). Release, Docker, and
Arch packaging pass the flag explicitly, so shipped artifacts are unchanged
until ONNX is dropped.
2026-09-22 18:56:22 -06:00
trvon
32e57d758d
refactor(symbols): remove tree-sitter from conan and fix legacy symbol tests
- Remove enable_symbol_extraction option and tree-sitter requirement from conanfile.py.
- Remove YAMS_DISABLE_SYMBOL_EXTRACTION toggles from setup.ps1, setup.sh, and ubuntu.Dockerfile.
- Add v39_metadata_db_template helper to MetadataDbTemplate for legacy symbol tests.
- Update GraphComponent, DeleteCascade, GraphContextService, and KGStore test
  fixtures to run symbol-specific test cases against schema v39.

Signed-off-by: trvon <me@trevon.dev>
2026-09-22 07:37:30 -06:00
github-actions[bot]
8ab82c1ccf
chore(main): release 0.19.0 (#55)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-07-31 21:21:44 -04:00
Trevon
0dd3985db4
refactor: simplify runtime paths and harden retrieval (#61)
* refactor(tuning): prune dormant runtime knobs

Remove unused tuning controls and adaptive search budget state. Extract testable ONNX slot reconciliation and search telemetry hydration seams, and correct the Apple Silicon sysctl value width.

* refactor(vector): retire dormant backends

Remove unused FAISS, model-infrastructure, VectorIndexManager, and TurboQuant paths while keeping Simeon PQ and float-vector storage.

Migrate unused V2.2 quantized schemas transactionally to V2.3. Databases containing non-default quantized formats or packed-code blobs fail closed with recovery guidance and no mutation.

* refactor(plugins): remove legacy SDK tooling

Remove the Ghidra and SDK submodules, their bespoke tests, and stale scan exclusions. Retain generic PluginProcess coverage against the repository mock fixture.

* build(vector): remove stale FAISS overrides

* refactor(ipc): remove dormant FSM snapshots

* refactor(ingest): unify bounded KG enqueue

* fix(plugins): harden allocation contracts

Keep ABI outputs null or fully initialized when allocations fail, and represent empty object payloads without relying on malloc(0).

* fix(storage): define empty object reads

Return a null buffer with zero length for successful empty-object reads instead of treating malloc(0) as an allocation contract.

* refactor(storage): trim through string views

* test: prune dormant harness helpers

Remove unused readiness and fixture helpers, and keep benchmark client-count doubling in a wide integer domain.

* chore(cpp): initialize analyzer-facing locals

* build(simeon): advance analyzer cleanup

* refactor(config): drop dead daemon client keys

* refactor(ipc): inject daemon client transport

Socket and in-process execution now share DaemonClient request dispatch, so CLI fallbacks do not need alternate service paths.

* refactor(retrieval): route CLI through daemon

Search and grep now use the same daemon handlers over socket or in-process transport. Live grep remains an explicit freshness inspection.

* refactor(graph): move CLI scope into daemon

Graph CLI requests now share daemon handlers across socket and in-process transports. CWD filtering occurs before pagination so scoped totals and pages stay correct.

* build: isolate test-only runtime controls

* refactor(metadata): decouple lock telemetry

* fix(services): return on request timeout

* fix(retrieval): enforce workspace scope

* fix(graph): scope nodes before pagination

* fix(grep): drop binary result lines

* fix(daemon): bound checkpoint wait

* fix(repair): use KG health checks

* fix(storage): always verify compressed CRC

* perf(vector): skip unchanged PQ snapshots

* build(zyp): exclude bench from default build

* build: protect Meson files from formatter

* refactor: remove unreachable production APIs

* refactor(daemon): remove dormant runtime state

* fix(vector): harden daemon provider calls

Timed-out coroutines must own their client and requests. Provider discovery must also fail instead of returning synthetic embeddings in production.

* refactor(storage): remove unusable adapters

* fix(cli): unify in-process add requests

* fix(tsan): preserve async worker progress

* test(cli): isolate daemon-dependent suites

* fix(repair): expose queue backoff progress
2026-07-31 14:16:45 -04:00
github-actions[bot]
ddd139b482
chore(main): release 0.18.1 (#54)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-07-05 20:58:23 -04:00
github-actions[bot]
501cc0aeda
chore(main): release 0.18.0 (#51)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-07-03 11:25:34 -04:00
github-actions[bot]
05fb02f64e
chore(main): release 0.17.0 (#43)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-06-12 23:04:29 -04:00
github-actions[bot]
fc6858ffb9
chore(main): release 0.16.2 (#37)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-06-01 12:17:17 -04:00
github-actions[bot]
c87a9f15cb
chore(main): release 0.16.1 (#35)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-05-23 21:23:06 -04:00
github-actions[bot]
0a8d4c4205
chore(main): release 0.16.0 (#32)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-05-18 01:18:51 -04:00
github-actions[bot]
753d89a7d6
chore(main): release 0.15.0 (#29)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-05-15 15:20:52 -04:00
trvon
597aed4fc9
fix(docker): add wget for Zig, disable faiss
openblas arm64 build fails in Docker containers. YAMS_DISABLE_FAISS=1
env var skips faiss (and its openblas transitive dep). Zig download
now uses wget -c for resume on flaky ziglang.org connections.
2026-05-06 15:10:03 -04:00
trvon
18b10dc444
fix: addressing build regressions where fiass needed openmp installed 2026-05-05 19:50:16 -04:00
trvon
8433d4f6fc
fix: disable faiss on Apple Clang macOS, remove hardcoded /opt/homebrew paths
faiss recipe validate() rejects apple-clang (no OpenMP). Disable faiss
in configure() when compiler=apple-clang on macOS. The list order is
swapped to [False,True] so False is the default; configure() enables
faiss on all non-apple-clang platforms.

Also removes hardcoded /opt/homebrew/{include,opt/libomp/include} paths
from src/vector/meson.build that broke Linux ARM / Docker builds when
the cmake faiss dep fallback was reached.
2026-05-05 19:11:47 -04:00
trvon
f14c7d64ab
fix: disable faiss on Apple Clang macOS, restore profile cache keys
faiss requires OpenMP which Apple Clang does not ship. Skip faiss
on macOS/apple-clang to prevent conan install failures during warm.

Also restore trailing whitespace in Linux gcc profiles to match
original cache key hash (hashFiles change invalidated all platform
caches, exposing the macOS issue).
2026-05-05 18:50:56 -04:00
trvon
dc6aaa13ce
feat: add FAISS HNSW vector backend with ConfigResolver policy 2026-05-05 15:38:22 -04:00
github-actions[bot]
591f664b82
chore(main): release 0.14.1 (#21)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-05-04 14:04:13 -04:00
github-actions[bot]
ef6c8ade12
chore(main): release 0.14.0 (#19)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-05-04 12:29:28 -04:00
Trevon
3486a71689
ci: windows build improvements based on ci changes and pinned versions. 2026-05-02 21:34:04 -04:00
trvon
c3d3ca4c70
fix: fix bad version update 2026-04-28 23:11:26 -04:00
trvon
86025d5e89
ci: ci cache improvements and version bump for msvc compat 2026-04-28 23:04:48 -04:00
trvon
84015b39b7
build(ci,tests): cleaning build system and updates related to ci test failures and compat 2026-04-25 14:48:44 -04:00
github-actions[bot]
c7d6349d42
chore(main): release 0.13.1 (#18)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-04-18 18:48:11 -04:00
trvon
c4089815c3
Merge branch 'main' of github.com:trvon/yams 2026-04-18 10:04:35 -04:00
trvon
d7ab4844a1
fix: small fixes for benchmarks and documentation update 2026-04-17 22:32:04 -04:00
github-actions[bot]
e68c4b2f14
chore(main): release 0.13.0 (#17)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-04-17 18:59:46 -04:00
trvon
09c8e0f959
feat: profile for building mobile bindings 2026-04-06 13:28:34 -04:00
github-actions[bot]
37a98d64d8
chore(main): release 0.12.0 (#16)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-04-02 22:23:18 -04:00
trvon
0261b90a7b
refactor(build): centralize dependency discovery and trim Meson duplication 2026-03-23 15:41:13 -04:00
trvon
081fb740b4
fix: improving test coverage and addressign ASAN issues 2026-03-19 06:32:13 -04:00
trvon
a449afce0f
feat: reverted taskflow experiment 2026-03-17 20:23:32 -04:00
trvon
325ab784d8
feat: leveraging taskflow for ingestion pipeline. search engine optimizations 2026-03-16 17:35:31 -04:00
github-actions[bot]
e7228572c5
chore(main): release 0.11.0 (#15)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-03-14 21:04:29 -04:00
trvon
9bdef80860
perf: accelerate grep and search with RE2 regex and SIMD memmem 2026-03-11 09:39:09 -04:00
trvon
d92f66d2f6
fix: fixing daemon regression for startup logic resulting in ipc eof, expanding release please to update conan file version, expanding benchmark docs 2026-03-07 21:38:35 -05:00
trvon
a0fd82e25c fix: Fixing issues that break windows release build. This should allow new msvc version Working on debug builds. 2026-02-10 15:03:39 -08:00
trvon
69e9f6e9e2
removing client only embedding path 2026-01-23 15:05:30 -05:00
trvon
4321f29679
profiling improvements, ft5s bug fixes for retrieval, and benchmark optimizations 2026-01-06 14:57:13 -05:00
trevon
8048a191a8
fixing conanfile for ci and request dispatcher ordering for windows 2025-12-20 18:55:37 -05:00
trevon
48dc0dfa89
removing gtest migrated tests and continuing with test migration 2025-12-16 10:50:18 -05:00
trevon
537d4594f4
docs update and ci improvements for qpdf 2025-11-27 14:25:29 -05:00
trevon
3b58ac1743
test stabilizations for windows. search metadata/tags improvements 2025-11-26 21:45:50 -05:00
trevon
ebe81823db
improvements for daemon lifecycle, tree repair, and mcp regression 2025-11-26 14:22:35 -05:00