 ent
|
dabc866507
|
tune for 1 orchestrator + up to 3 subagents: gpu-mem 0.88 (~15GB reserve), seqs=4, ctx 262144; document use case + tradeoffs
|
2026-06-24 13:31:36 +10:00 |
|
|
ent
|
6797a9f6dd
|
default max-num-seqs=4 (>=2 with headroom; ~5 fit full native ctx each)
|
2026-06-24 13:21:52 +10:00 |
|
|
ent
|
7dd6a74d38
|
tune defaults for max context + KV depth: gpu-mem 0.89 (reserve ~14GB), ctx 262144, max-num-seqs 1, decouple max-batched-tokens (8192)
|
2026-06-24 13:18:32 +10:00 |
|
|
ent
|
70c91f94a7
|
docs: GB10 memory is 128 GB (119 GiB), not 128 GiB
|
2026-06-24 13:10:36 +10:00 |
|
|
ent
|
dc9d40a1c4
|
docs: credit albond's recipe as the foundation + head-to-head comparison (59.0 vs 51.58 e2e, same method)
|
2026-06-24 13:08:52 +10:00 |
|
|
ent
|
60bf1b7b02
|
qwen3.5-122B-A10B on DGX Spark: vLLM + DFlash + dense-bandwidth stack, one-shot installer
|
2026-06-24 13:02:35 +10:00 |
|