Run Evaluation RPJ Wiki on Arch Linux (#74)

* chore: ignore benchmark data

* perf: avoid merging offset dicts for lower mem usage

* style: format

* docs: rpj_wiki
This commit is contained in:
Andy Lee
2025-08-20 12:25:54 -07:00
committed by GitHub
parent 13bb561aad
commit 6d11e86e71
7 changed files with 46 additions and 110 deletions

View File

@@ -657,6 +657,7 @@ Options:
```bash
uv pip install -e ".[dev]" # Install dev dependencies
python benchmarks/run_evaluation.py # Will auto-download evaluation data and run benchmarks
python benchmarks/run_evaluation.py benchmarks/data/indices/rpj_wiki/rpj_wiki --num-queries 2000 # After downloading data, you can run the benchmark with our biggest index
```
The evaluation script downloads data automatically on first run. The last three results were tested with partial personal data, and you can reproduce them with your own data!