441 B
441 B
| 1 | Dataset | Metric | Original | original + batch | original + two_level | original + two_level + batch |
|---|---|---|---|---|---|---|
| 2 | NQ | Latency | 6.9 | 5.8 | 4.2 | 3.7 |
| 3 | NQ | SpeedUp | 1 | 1.18965517 | 1.64285714 | 1.86486486 |
| 4 | TriviaQA | Latency | 17.054 | 14.542 | 12.046 | 10.83 |
| 5 | TriviaQA | SpeedUp | 1 | 1.17274103 | 1.41573967 | 1.57469990 |
| 6 | GPQA | Latency | 9.164 | 7.639 | 6.798 | 5.77 |
| 7 | GPQA | SpeedUp | 1 | 1.19963346 | 1.34804354 | 1.58821490 |
| 8 | HotpotQA | Latency | 60.279 | 39.827 | 50.664 | 29.868 |
| 9 | HotpotQA | SpeedUp | 1 | 1.51352098 | 1.18977972 | 2.01817999 |