docs: fix Reproducing — --start defaults to dense now; dflash is the explicit opt-in
This commit is contained in:
@@ -317,13 +317,13 @@ docs/
|
|||||||
## Reproducing
|
## Reproducing
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
# default agent path (DFlash) + smoke test:
|
# default: the dense profile (downloads the prebuilt hybrid) + smoke test:
|
||||||
./install.sh --start
|
./install.sh --start
|
||||||
|
|
||||||
# the dense stack (downloads the prebuilt hybrid checkpoint):
|
|
||||||
./install.sh --start --profile dense
|
|
||||||
# (to build the hybrid checkpoint locally instead of downloading it:)
|
# (to build the hybrid checkpoint locally instead of downloading it:)
|
||||||
# ./install.sh --build-hybrid && ./install.sh --start --profile dense
|
# ./install.sh --build-hybrid && ./install.sh --start
|
||||||
|
|
||||||
|
# plain-DFlash agent path (serves the Intel INT4 checkpoint, largest KV pool):
|
||||||
|
./install.sh --start --profile dflash
|
||||||
|
|
||||||
# benchmarks (run on the host against the server; requires: pip install requests):
|
# benchmarks (run on the host against the server; requires: pip install requests):
|
||||||
python3 scripts/bench_decode.py --base-url http://127.0.0.1:8000 --model qwen \
|
python3 scripts/bench_decode.py --base-url http://127.0.0.1:8000 --model qwen \
|
||||||
|
|||||||
Reference in New Issue
Block a user