1.3 KiB
1.3 KiB
| 1 | Dataset | Hardware | Recall_target | HNSW | IVF | DiskANN | IVF-Disk | IVF-Recompute | Our | |
|---|---|---|---|---|---|---|---|---|---|---|
| 2 | NQ | A10 | 85% | 0.046 | 1.656 | 0.017 | 2.996 | 482.53 | 4.243 | |
| 3 | NQ | A10 | 90% | 0.051 | 2.552 | 0.028 | 3.437 | 769.04 | 8.136 | |
| 4 | NQ | A10 | 95% | 0.055 | 5.163 | 0.070 | 5.602 | 1436.26 | 27.275 | |
| 5 | NQ | MAC | 85% | 0 | 0 | 0.152 | 2.199 | 1535.10 | 10.672 | |
| 6 | NQ | MAC | 90% | 0 | 0 | 0.37 | 2.936 | 2446.60 | 19.941 | |
| 7 | NQ | MAC | 95% | 0 | 0 | 1.207 | 4.191 | 4569.29 | 61.383 | |
| 8 | TriviaQA | A10 | 85% | 0.042 | 1.772 | 0.032 | 2.464 | 560.5 | 5.612 | |
| 9 | TriviaQA | A10 | 90% | 0.043 | 3.541 | 0.057 | 3.651 | 997.81 | 10.737 | |
| 10 | TriviaQA | A10 | 95% | 0.053 | 7.168 | 0.090 | 5.458 | 2005.33 | 36.387 | |
| 11 | TriviaQA | MAC | 85% | 0 | 0 | 0.481 | 1.875 | 1783.14787 | 12.825 | |
| 12 | TriviaQA | MAC | 90% | 0 | 0 | 0.984 | 2.639 | 3174.410301 | 24.977 | |
| 13 | TriviaQA | MAC | 95% | 0 | 0 | 1.578 | 3.884 | 6379.712245 | 85.734 | |
| 14 | GPQA | A10 | 85% | 0.041 | 0.134 | 0.024 | 0.048 | 40.16 | 2.269 | |
| 15 | GPQA | A10 | 90% | 0.042 | 0.174 | 0.034 | 0.06 | 54.71 | 3.200 | |
| 16 | GPQA | A10 | 95% | 0.045 | 0.292 | 0.051 | 0.11 | 97.67 | 7.445 | |
| 17 | GPQA | MAC | 85% | 0 | 0 | 0.144 | 0.087 | 127.7707505 | 6.123 | |
| 18 | GPQA | MAC | 90% | 0 | 0 | 0.288 | 0.108 | 174.0647409 | 8.507 | |
| 19 | GPQA | MAC | 95% | 0 | 0 | 0.497 | 0.132 | 310.7380142 | 19.577 | |
| 20 | HotpotQA | A10 | 85% | 0.044 | 2.519 | 0.054 | 4.048 | 724.26 | 14.713 | |
| 21 | HotpotQA | A10 | 90% | 0.049 | 3.867 | 0.109 | 5.045 | 1173.67 | 33.561 | |
| 22 | HotpotQA | A10 | 95% | 0.07 | 10.928 | 0.412 | 8.659 | 3079.57 | 68.626 | |
| 23 | HotpotQA | MAC | 85% | 0 | 0 | 0.974 | 2.844 | 2304.125187 | 34.783 | |
| 24 | HotpotQA | MAC | 90% | 0 | 0 | 1.913 | 3.542 | 3415.736201 | 53.004 | |
| 25 | HotpotQA | MAC | 95% | 0 | 0 | 5.783 | 6.764 | 9797.244043 | 95.413 |