Pt heptamer island

SystemMorse Pt
Atoms343
Runs59
Cap3000 force calls

The main metric is Force calls. Scoring rules.

Charts

Success rate on Pt heptamer island, in rank order. The rate is the share of runs that finished. 10 ranked rows did not record a success rate and are not drawn.
Success rate on Pt heptamer island, in rank order. The rate is the share of runs that finished. 10 ranked rows did not record a success rate and are not drawn. PDF.
Dolan-Moré profile for Band / NEB on Pt heptamer island. The curve is the fraction of starts whose cost is at most tau times the best finite cost in this family. Tau is 1, 2, 4, 8, and 16. An unsolved start stays in the denominator and does not cross a finite tau. Dolan, E. D. and Moré, J. J., Math. Program. 91:201-213, 2002. Colored lines are the six largest areas. The other curves are gray.
Dolan-Moré profile for Band / NEB on Pt heptamer island. The curve is the fraction of starts whose cost is at most tau times the best finite cost in this family. Tau is 1, 2, 4, 8, and 16. An unsolved start stays in the denominator and does not cross a finite tau. Dolan, E. D. and Moré, J. J., Math. Program. 91:201-213, 2002. Colored lines are the six largest areas. The other curves are gray. PDF.
Dolan-Moré profile for Minimum mode on Pt heptamer island. The curve is the fraction of starts whose cost is at most tau times the best finite cost in this family. Tau is 1, 2, 4, 8, and 16. An unsolved start stays in the denominator and does not cross a finite tau. Dolan, E. D. and Moré, J. J., Math. Program. 91:201-213, 2002.
Dolan-Moré profile for Minimum mode on Pt heptamer island. The curve is the fraction of starts whose cost is at most tau times the best finite cost in this family. Tau is 1, 2, 4, 8, and 16. An unsolved start stays in the denominator and does not cross a finite tau. Dolan, E. D. and Moré, J. J., Math. Program. 91:201-213, 2002. PDF.
Dolan-Moré profile for Connect / double-ended on Pt heptamer island. The curve is the fraction of starts whose cost is at most tau times the best finite cost in this family. Tau is 1, 2, 4, 8, and 16. An unsolved start stays in the denominator and does not cross a finite tau. Dolan, E. D. and Moré, J. J., Math. Program. 91:201-213, 2002.
Dolan-Moré profile for Connect / double-ended on Pt heptamer island. The curve is the fraction of starts whose cost is at most tau times the best finite cost in this family. Tau is 1, 2, 4, 8, and 16. An unsolved start stays in the denominator and does not cross a finite tau. Dolan, E. D. and Moré, J. J., Math. Program. 91:201-213, 2002. PDF.
Force calls on each recorded start for Pt heptamer island. The box is the quartiles of those counts. A blue point is a success and a vermillion cross is a recorded failure (233). The horizontal position is the recorded count. The vertical offset only keeps marks from covering one another.
Force calls on each recorded start for Pt heptamer island. The box is the quartiles of those counts. A blue point is a success and a vermillion cross is a recorded failure (233). The horizontal position is the recorded count. The vertical offset only keeps marks from covering one another. PDF.
Performance profile for Pt heptamer island00.51124816Cost ratioFraction of startsgeodesic (1.0.0) · CI-NEB-LBFGS geodesicrgsaddle (0.2.2) · CI-NEB energy-weightedrgsaddle (0.2.2) · S-IDPP CI-NEBrgsaddle (0.2.2) · IDPP CI-NEBrgsaddle (0.2.2) · CI-NEBrgsaddle (0.2.2) · OCI-NEBgeodesic (1.0.0) · NEB-FIRE geodesicgeodesic (1.0.0) · CI-NEB geodesicASE (3.29.0) · NEB-FIRESella (2.6.0) · Sella+NEBCOMPASS (1.0.0) · COMPASSTSASE (1.0) · CI-NEBeOn (3.6.0) · LBFGSLAMMPS (30 Sep 2026) · CI-NEB-fireLAMMPS (30 Sep 2026) · CI-NEB-quickminrgsaddle (0.2.2) · NEBTSASE (1.0) · NEBEon svn (r2549) · Lanczos improved L-BFGSEon svn (r2549) · CI-NEBEon svn (r2549) · LBFGSEon svn (r2549) · Dimer L-BFGSEon svn (r2549) · Lanczos L-BFGSEon svn (r2549) · Doubly nudged CI-NEB
Performance profile. Higher means more starts solved within that cost ratio. Colored lines are the six largest areas. Thin lines are the other 17.
  • Eon svn (r2549) · Lanczos improved L-BFGS
  • Eon svn (r2549) · CI-NEB
  • Eon svn (r2549) · LBFGS
  • Eon svn (r2549) · Dimer L-BFGS
  • Eon svn (r2549) · Lanczos L-BFGS
  • Eon svn (r2549) · Doubly nudged CI-NEB
Cost distribution for Pt heptamer island02468103 to 184.088: 4184.088 to 329.013: 8329.013 to 588.031: 2588.031 to 1050.96: 71050.96 to 1878.35: 61878.35 to 3357.09: 33357.09 to 6000: 31036000
Cost distribution of 33 ranked rows. Logarithmic bins, from 103 to 6000.

Performance profile SVG Cost and success SVG

Performance profile for Pt heptamer island
Performance profile. Select the plot for the full SVG.
Cost and success for Pt heptamer island
Cost and success. Select the plot for the full SVG.
Best cost for pt-islandpt-island10²10³10⁴cost (force calls, log scale)OPTIM: 103OPTIM103Eon svn: 110Eon svn110pele: 449.746pele449.746geodesic: 824.119geodesic824.119ASE: 926.475ASE926.475rgsaddle: 938.102rgsaddle938.102Sella: 968.525Sella968.525COMPASS: 1078.12COMPASS1078.12TSASE: 2524.53TSASE2524.53LAMMPS: 2668.64LAMMPS2668.64eOn: 3080.19eOn3080.19
A shorter bar is a lower cost on a log scale shared by the codes of this problem.

Leaderboard

A shorter bar is a lower cost on the log scale for that problem. Select a column heading to sort.
RankCodeBestMedianSuccessPAR-2
1 OPTIM 103 211 100.0% 103
2 Eon svn 110 225.881 100.0% 110
3 pele 449.746 449.746 96.6% 449.746
4 geodesic 824.119 1115.25 98.3% 824.119
5 ASE 926.475 926.475 98.3% 926.475
6 rgsaddle 938.102 1070.44 93.2% 938.102
7 Sella 968.525 968.525 98.3% 968.525
8 COMPASS 1078.12 1078.12 98.3% 1078.12
9 TSASE 2524.53 4262.26 64.4% 2524.53
10 LAMMPS 2668.64 3617.71 74.6% 2668.64
11 eOn 3080.19 3080.19 64.4% 3080.19

The tables below list every ranked row, by method family and overall.

eOn band rows are not yet on the harness counter.

A run short of the full set, or a run that is not the stock method, stays off the ranked table.

These archived rows differ from the table of J. Chem. Theory Comput. 10, 5476 (2014) that prints them, and each ranks on its archived values: eOn (r2156) · eon-lanczos (Table 10 prints 165, 72 and 308 calls with 0 failed, this file has 325, 95 and 2660 with 5 failed, and no archived file has the printed values. It was written on 29 Aug 2013, six days after the files that match the other eOn rows of Table 10).

A failure class marked inferred comes from a start file that records no class. A start with an error is crash, a start at or above the cap is cap, and any other failure is divergence unless its force norm is at or below the stop, which makes it wrong_stationary. Rows with an inferred class: Sella (2.6.0) · Sella+NEB.

Band / NEB

Band / NEB. One row is one code, one version, and one method. A lower cost is better. PAR-2 counts a finished run as the calls it used and a failed run as twice the cap. An archived row shows the average it published, and its PAR-2 applies that rule to the failures the entry records. Hessians is the mean analytic Hessian count. FD calls is that count times one force call per coordinate.
RankRowCostUnitHessiansFD callsRuns
1eOn (r2156) · eon-ci-neb-single110force calls0059
2Eon svn (r2549) · CI-NEB225.881force calls0059
3Eon svn (r2549) · Doubly nudged CI-NEB246.271force calls0059
4eOn (r2156) · eon-ci-neb248force calls0059
5eOn (r2156) · eon-ci-swdneb256force calls0059
6eOn (r2156) · eon-ci-neb-5391force calls0059
7geodesic (1.0.0) · NEB-FIRE geodesic824.119force calls0059
8ASE (3.29.0) · NEB-FIRE926.475force calls0059
9rgsaddle (0.2.2) · CI-NEB energy-weighted938.102force calls0059
10Sella (2.6.0) · Sella+NEB968.525force calls0059
11rgsaddle (0.2.2) · OCI-NEB975.983force calls0059
12rgsaddle (0.2.2) · IDPP CI-NEB1062.46force calls0059
13rgsaddle (0.2.2) · CI-NEB1078.42force calls0059
14geodesic (1.0.0) · CI-NEB-LBFGS geodesic1115.25force calls0059
15rgsaddle (0.2.2) · S-IDPP CI-NEB1134.93force calls0059
16geodesic (1.0.0) · CI-NEB geodesic1462.14force calls0059
17TSASE (1.0) · CI-NEB2524.53force calls0059
18LAMMPS (30 Sep 2026) · CI-NEB-fire2668.64force calls0059
19LAMMPS (30 Sep 2026) · CI-NEB-quickmin4566.78force calls0059
20TSASE (1.0) · NEB6000force calls0059
21rgsaddle (0.2.2) · NEB6000force calls0059

Minimum mode

Minimum mode. One row is one code, one version, and one method. A lower cost is better. PAR-2 counts a finished run as the calls it used and a failed run as twice the cap. An archived row shows the average it published, and its PAR-2 applies that rule to the failures the entry records. Hessians is the mean analytic Hessian count. FD calls is that count times one force call per coordinate.
RankRowCostUnitHessiansFD callsRuns
1Eon svn (r2549) · Lanczos improved L-BFGS180.644force calls0059
2eOn (r2156) · eon-dimer182force calls0059
3Eon svn (r2549) · Dimer L-BFGS192.051force calls0059
4Eon svn (r2549) · Lanczos L-BFGS221.525force calls0059
5eOn (r2156) · eon-lanczos805.932force calls0059
6eOn (r2156) · eon-lanczos-improved1005.46force calls0059

Connect / double-ended

Connect / double-ended. One row is one code, one version, and one method. A lower cost is better. PAR-2 counts a finished run as the calls it used and a failed run as twice the cap. An archived row shows the average it published, and its PAR-2 applies that rule to the failures the entry records. Hessians is the mean analytic Hessian count. FD calls is that count times one force call per coordinate.
RankRowCostUnitHessiansFD callsRuns
1OPTIM · DNEB + hybrid eigenvector following103force calls0059
2Eon svn (r2549) · LBFGS225.881force calls0059
3OPTIM · climbing string319force calls0059
4pele · hybrid eigenvector following449.746force calls0059
5COMPASS (1.0.0) · COMPASS1078.12force calls0059
6eOn (3.6.0) · LBFGS3080.19force calls0059

Overall

One row is one code, one version, and one method. A lower cost is better. PAR-2 counts a finished run as the calls it used and a failed run as twice the cap. An archived row shows the average it published, and its PAR-2 applies that rule to the failures the entry records. Hessians is the mean analytic Hessian count. FD calls is that count times one force call per coordinate. The per-image mean divides the total by the number of moving images.
RowFamilyFamily rankUnitPAR-2PublishedMedian callsMean callsPer-image meanHessiansFD callsFailuresRuns
OPTIM · DNEB + hybrid eigenvector followingConnect / double-ended1force calls10310398103000 failed59
eOn (r2156) · eon-ci-neb-singleBand / NEB1force calls11011062110000 failed59
Eon svn (r2549) · Lanczos improved L-BFGSMinimum mode1force calls180.644161180.64460.214700crash 0, divergence 0, cap 0, wrong_stationary 059
eOn (r2156) · eon-dimerMinimum mode2force calls182182182182000 failed59
Eon svn (r2549) · Dimer L-BFGSMinimum mode3force calls192.051188192.05164.016900crash 0, divergence 0, cap 0, wrong_stationary 059
Eon svn (r2549) · Lanczos L-BFGSMinimum mode4force calls221.525208221.52573.841800crash 0, divergence 0, cap 0, wrong_stationary 059
Eon svn (r2549) · CI-NEBBand / NEB2force calls225.881188225.88175.293800crash 0, divergence 0, cap 0, wrong_stationary 059
Eon svn (r2549) · LBFGSConnect / double-ended2force calls225.881188225.88175.293800crash 0, divergence 0, cap 0, wrong_stationary 059
Eon svn (r2549) · Doubly nudged CI-NEBBand / NEB3force calls246.271218246.27182.090400crash 0, divergence 0, cap 0, wrong_stationary 059
eOn (r2156) · eon-ci-nebBand / NEB4force calls248248211248000 failed59
eOn (r2156) · eon-ci-swdnebBand / NEB5force calls256256219256000 failed59
OPTIM · climbing stringConnect / double-ended3force calls319319286319000 failed59
eOn (r2156) · eon-ci-neb-5Band / NEB6force calls391391395391000 failed59
pele · hybrid eigenvector followingConnect / double-ended4force calls449.746255244255002 failed, class not recorded59
eOn (r2156) · eon-lanczosMinimum mode5force calls805.932325207.5325005 failed, class not recorded59
geodesic (1.0.0) · NEB-FIRE geodesicBand / NEB7force calls824.119716773.271257.75700crash 0, divergence 0, cap 1, wrong_stationary 059
ASE (3.29.0) · NEB-FIREBand / NEB8force calls926.475707875.712291.90400crash 0, divergence 1, cap 0, wrong_stationary 059
rgsaddle (0.2.2) · CI-NEB energy-weightedBand / NEB9force calls938.102478561.644187.21500crash 0, divergence 2, cap 0, wrong_stationary 259
Sella (2.6.0) · Sella+NEBBand / NEB10force calls968.525756921.847307.28200crash 0, divergence 0, cap 1 (1 inferred), wrong_stationary 059
rgsaddle (0.2.2) · OCI-NEBBand / NEB11force calls975.983602823.441274.4800crash 0, divergence 0, cap 3, wrong_stationary 059
eOn (r2156) · eon-lanczos-improvedMinimum mode6force calls1005.46222157222008 failed, class not recorded59
rgsaddle (0.2.2) · IDPP CI-NEBBand / NEB12force calls1062.46491585.729195.24300crash 0, divergence 5, cap 0, wrong_stationary 059
COMPASS (1.0.0) · COMPASSConnect / double-ended5force calls1078.1210021027.27342.42400crash 0, divergence 0, cap 1, wrong_stationary 059
rgsaddle (0.2.2) · CI-NEBBand / NEB13force calls1078.42479601.542200.51400crash 0, divergence 5, cap 0, wrong_stationary 059
geodesic (1.0.0) · CI-NEB-LBFGS geodesicBand / NEB14force calls1115.25209223.84774.615800crash 0, divergence 9, cap 0, wrong_stationary 059
rgsaddle (0.2.2) · S-IDPP CI-NEBBand / NEB15force calls1134.93461607.153202.38400crash 0, divergence 5, cap 1, wrong_stationary 059
geodesic (1.0.0) · CI-NEB geodesicBand / NEB16force calls1462.14491604.746201.58200crash 0, divergence 9, cap 0, wrong_stationary 059
TSASE (1.0) · CI-NEBBand / NEB17force calls2524.53564639.61213.20300crash 0, divergence 20, cap 1, wrong_stationary 059
LAMMPS (30 Sep 2026) · CI-NEB-fireBand / NEB18force calls2668.6414051471.69490.56500crash 0, divergence 6, cap 0, wrong_stationary 959
eOn (3.6.0) · LBFGSConnect / double-ended6force calls3080.1922603220.91073.6300crash 0, divergence 0, cap 21, wrong_stationary 059
LAMMPS (30 Sep 2026) · CI-NEB-quickminBand / NEB19force calls4566.7827602508.98836.32800crash 0, divergence 26, cap 0, wrong_stationary 959
TSASE (1.0) · NEBBand / NEB20force calls6000543788.746262.91500crash 0, divergence 56, cap 3, wrong_stationary 059
rgsaddle (0.2.2) · NEBBand / NEB21force calls6000533744.475248.15800crash 0, divergence 56, cap 3, wrong_stationary 059

Off the ranked table

  • eOn (3.6.0) · LBFGS n=59, not yet on the harness counter.
  • eOn (3.6.0) · LBFGS n=59, not yet on the harness counter.