CognomineBeta
Benchmarks

Three benchmarks, two questions

We publish three benchmarks. The first asks how fast we produce a plan and how good it is. The other two ask a harder question: whether a plan that scores well is also a practical plan, one that can be executed as scheduled.

More constraints for a practical plan.

We have run the executability test on two deposits with an identical method. On McLaughlin the published solution lost 58.4% of its stated value. On zuck_large, 29.5%. That spread is the finding: a plan built without physical constraints was not designed to survive them or to fail them, so how it fares once they are applied is essentially random, and nothing in the reported NPV tells a planner which case they are looking at.

All three benchmarks are our own results. Each page sets out its method, what it does not show, and where the underlying data comes from.

Run it on your own numbers