Skip to content

Commit ad8c944

Browse files
authored
Merge pull request google-deepmind#23 from zhuangshaobin/Video-GPT
add Video-GPT to benchmark
2 parents 6b697d7 + de4429d commit ad8c944

1 file changed

Lines changed: 10 additions & 9 deletions

File tree

‎README.md‎

Lines changed: 10 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -38,15 +38,16 @@ If you test your model on Physics-IQ and would like your score/paper/model to be
3838
| **#** | **Model** | **input type** | **Physics-IQ score** | **date added (YYYY-MM-DD)** |
3939
| -- | --- | --- | --- | --- |
4040
| 1 | [Magi-1](https://arxiv.org/abs/2505.13211) | multiframe (v2v) | **56.0 %** :1st_place_medal: | 2025-04-21 |
41-
| 2 | [Magi-1](https://arxiv.org/abs/2505.13211) | i2v | 30.2 % :2nd_place_medal: | 2025-04-21 |
42-
| 3 | [VideoPoet](https://arxiv.org/abs/2312.14125) | multiframe (v2v) | 29.5 % :3rd_place_medal: | 2025-02-19 |
43-
| 4 | [Lumiere](https://arxiv.org/abs/2401.12945) | multiframe (v2v) | 23.0 % | 2025-02-19 |
44-
| 5 | [Runway Gen 3](https://runwayml.com/research/introducing-gen-3-alpha) | i2v | 22.8 % | 2025-02-19 |
45-
| 6 | [VideoPoet](https://arxiv.org/abs/2312.14125) | i2v | 20.3 % | 2025-02-19 |
46-
| 7 | [Lumiere](https://arxiv.org/abs/2401.12945) | i2v | 19.0 % | 2025-02-19 |
47-
| 8 | [Stable Video Diffusion](https://arxiv.org/abs/2311.15127) | i2v | 14.8 % | 2025-02-19 |
48-
| 9 | [Pika](https://pika.art/) | i2v | 13.0 % | 2025-02-19 |
49-
|10 | [Sora](https://openai.com/sora/) | i2v | 10.0 % | 2025-02-19 |
41+
| 2 | [Video-GPT](https://arxiv.org/abs/2505.12489) | multiframe (v2v) | 35.0 % :2nd_place_medal: | 2025-05-22 |
42+
| 3 | [Magi-1](https://arxiv.org/abs/2505.13211) | i2v | 30.2 % :3rd_place_medal: | 2025-04-21 |
43+
| 4 | [VideoPoet](https://arxiv.org/abs/2312.14125) | multiframe (v2v) | 29.5 % | 2025-02-19 |
44+
| 5 | [Lumiere](https://arxiv.org/abs/2401.12945) | multiframe (v2v) | 23.0 % | 2025-02-19 |
45+
| 6 | [Runway Gen 3](https://runwayml.com/research/introducing-gen-3-alpha) | i2v | 22.8 % | 2025-02-19 |
46+
| 7 | [VideoPoet](https://arxiv.org/abs/2312.14125) | i2v | 20.3 % | 2025-02-19 |
47+
| 8 | [Lumiere](https://arxiv.org/abs/2401.12945) | i2v | 19.0 % | 2025-02-19 |
48+
| 9 | [Stable Video Diffusion](https://arxiv.org/abs/2311.15127) | i2v | 14.8 % | 2025-02-19 |
49+
| 10 | [Pika](https://pika.art/) | i2v | 13.0 % | 2025-02-19 |
50+
| 11 | [Sora](https://openai.com/sora/) | i2v | 10.0 % | 2025-02-19 |
5051

5152
*Note to early adopters of the benchmark: results from the paper were finalized on February 19, 2025; if you used the toolbox before please re-run since we changed and improved a few aspects. Likewise, if you downloaded the dataset before that date, it is recommended to re-download it, ensuring the ground truth video masks have a duration of five seconds.*
5253

0 commit comments

Comments
 (0)