| Model Name | GPU Metrics | # Characters in Summary | ||
|---|---|---|---|---|
| Characters/s | Memory | Low | High | |
| InternVL2.5 - 1b | 291.18 | 2.4 GB | TBD | TBD |
| Florence2-Base - 223m | 766.49 | 2.6 GB | 350 | 660 |
| InternVL2.5 - 4b | 173.57 | 3.1 GB | TBD | TBD |
| Moondream2 - 2b | 344.97 | 4.5 GB | 299 | 644 |
| Florence2-Large - 772m | 564.86 | 5.3 GB | 450 | 650 |
| Mississippi - 2b | 320.00 | 5.3 GB | TBD | TBD |
| Ovis1.6-Llama3.2 - 3b | 321.79 | 9.6 GB | TBD | TBD |
| GLM-4v - 9b | 140.65 | 10.4 GB | TBD | TBD |
| llava 1.6 vicuna - 13b | 120.98 | 11.2 GB | 501 | 1045 |
| Molmo-D-0924 - 8b | 146.60 | 12.4 GB | TBD | TBD |