Repository navigation
Add Physis-Lang (Cosmos3 Nano) and Physis-Lang (Cosmos3 Super) to Physics-IQ Verified - #83
Conversation
|
Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA). View this failed invocation of the CLA check for more information. For the most up to date status, view the checks section at the bottom of the pull request. |
|
Thanks for the PR! Happy to merge; if you don't mind could you do the following changes:
Thank you! |
534e0ae to
4cd4eca
Compare
|
Thanks for the guidance. I’ve synced the README with the latest version and updated the leaderboard positions and dates to match the live leaderboard. The model names link directly to the paper PDF, and each “reported here” link points to this PR, following the existing README format. Please let me know if any further changes are needed. |
|
Thanks @xianzhengma, much appreciated. The PR is now merged. |
Summary
We propose two entries for the Physics-IQ Verified I2V leaderboard:
These are fine-tuned Cosmos-based models, not the unmodified Cosmos baselines. Results are self-reported and submitted for verification. Values are percentages, reported as mean +/- sample standard deviation across four independent generation runs.
Evaluation protocol
final_score_view, converted to a percentage. Aggregation uses unrounded per-run results.Method documentation
Paper PDF: https://github.com/Physis-Intelligence/Physis-Lang/blob/main/assets/Physis-Lang_arxiv.pdf
Our manuscript also includes evaluations on PhyGenBench, VideoPhy2 and PhyGround. We will update this PR with the arXiv link when available.
Inference hardware and timing
Hardware models are confirmed by the submitter. Timings were recovered from all 792 accepted samples per model, using the interval from saved sample arguments to saved sample outputs. They include output work, exclude process/model startup, and are not CUDA-kernel profiling measurements. GPU-seconds equal the unrounded mean logged interval multiplied by four; the cards explicitly document this unit.
Prompt upsampling used GPT-5.5 through an API, not local upsampling GPUs. Measured monetary costs are unavailable; unknown costs are not reported as zero.
Review materials and submission status
We request the private upload route described in README section H for the actual prompt CSVs, generated videos, evaluation outputs, submission cards and current manuscript. Please provide a run ID and scoped upload credentials for each model. We will upload the materials to the destination you provide; they have not yet been uploaded.
Both models have passed the official CSV/video component checks for all four runs (792 videos each). Runtime prompt consistency and archive read-back hash checks have also passed. The Google CLA check has passed.
The submitter has confirmed acceptance of submission terms version 1.0 and all five card warranties on behalf of NVIDIA; both cards record that confirmation at 2026-09-26T02:00:33Z. The complete official
--validate-onlycheck has not yet passed because the current validator rejects the three null GPU/count/time fields for API-based prompt upsampling. Media validation is not a claim of final submission acceptance. Private artifacts have not been uploaded, and we will update delivery and full-validation status before requesting final acceptance.Two points we would appreciate guidance on:
bpp, with the actual CSV provided privately.Proposed repository change
Add two rows to the Physics-IQ Verified table in README.md. The Original leaderboard and existing model scores are unchanged. The proposed rows are marked pending review; final numbering, dates and ranking annotations will be reconciled with the live table before merge.
Please also advise on the corresponding website update after acceptance.