 ent
|
efd80e8fe7
|
docs: dense profile downloads the prebuilt hybrid (no build step)
|
2026-06-24 15:08:13 +10:00 |
|
|
ent
|
314ae39000
|
docs: refactor README to a consistent neutral technical-documentation voice (drop second-person/session-narrative); add conc_workloads.py
|
2026-06-24 14:54:40 +10:00 |
|
|
ent
|
df8981d54c
|
VALIDATED defaults: gpu-mem 0.82 + seqs 3 (0.88+ over-subscribes/swaps); README corrected with measured KV pool (457k tok, 1.74x) + concurrency curve
|
2026-06-24 14:30:56 +10:00 |
|
|
ent
|
dabc866507
|
tune for 1 orchestrator + up to 3 subagents: gpu-mem 0.88 (~15GB reserve), seqs=4, ctx 262144; document use case + tradeoffs
|
2026-06-24 13:31:36 +10:00 |
|
|
ent
|
6797a9f6dd
|
default max-num-seqs=4 (>=2 with headroom; ~5 fit full native ctx each)
|
2026-06-24 13:21:52 +10:00 |
|
|
ent
|
7dd6a74d38
|
tune defaults for max context + KV depth: gpu-mem 0.89 (reserve ~14GB), ctx 262144, max-num-seqs 1, decouple max-batched-tokens (8192)
|
2026-06-24 13:18:32 +10:00 |
|
|
ent
|
70c91f94a7
|
docs: GB10 memory is 128 GB (119 GiB), not 128 GiB
|
2026-06-24 13:10:36 +10:00 |
|
|
ent
|
dc9d40a1c4
|
docs: credit albond's recipe as the foundation + head-to-head comparison (59.0 vs 51.58 e2e, same method)
|
2026-06-24 13:08:52 +10:00 |
|
|
ent
|
60bf1b7b02
|
qwen3.5-122B-A10B on DGX Spark: vLLM + DFlash + dense-bandwidth stack, one-shot installer
|
2026-06-24 13:02:35 +10:00 |
|