§vendors

For Physics-ML Vendors

Third-party benchmark evidence for surrogate model sales and procurement.

The procurement problem

Procurement teams at A&D OEMs, energy companies, and Tier-1 suppliers need independent evidence of surrogate model accuracy. “We benchmarked internally” is not sufficient. Comparotor provides sealed, replayable benchmark reports that serve as neutral third-party validation.

What you get

Signed PDF report

A procurement-grade benchmark report: dataset version, Cl/Cd/Cm error breakdown, OOD generalisation score, latency distribution, artefact checksum. Signed and shareable.

Persistent report URL

Every evaluation gets a permanent URL. Link it in RFP responses, proposals, and marketing without re-running each time.

Benchmark badge

Display your leaderboard position. Use the benchmark badge in product pages and sales decks. Citable format for technical proposals.

Private evaluation

Your model weights are never published. Only scores appear on the leaderboard (if you choose public). Private submissions stay private.

How it works

01Submit your model as ONNX or Docker via the API or web dashboard

02Evaluation runs against sealed RotorBench-Aero v0.1 test set

03Receive signed PDF report via webhook within minutes

04Share the persistent report URL in your sales materials

05Optionally publish to the public leaderboard for marketing visibility

Frequently asked questions

Can we keep our model private?Yes. Private submissions are only visible to your team. Only scores appear publicly if you choose to publish.

Can we run multiple evaluations?Vendor Proof plan: 50 runs/month. Contact sales for higher limits.

Can we use the report in RFP responses?Yes. The report is designed to be shareable as procurement evidence.

What if our model improves?Run a new evaluation. Each run gets its own report and persistent URL.

Is the test set the same across vendors?Yes. All evaluations use the same sealed test set and SU2 reference. This guarantees comparability.

Ready to get started?

Run your first evaluation and receive a procurement-grade report within minutes.

Start your first evaluation View pricing Contact sales