LCzero testing

BETA

With this tool you perhaps with reasonable certainty quickly can decide if a new LC-zero network weight file performs better or not. Currently version 323 has a CCRL rating of 2495 and version 390 (click on the ranking button in the upper right corner) clearly shows an improvement.

 

Operation

• Download LC-ZERO CPU version.

• Unzip anywhere.

• Open the folder and double-click run_mea-1s

MEA will run the STS 1500 positions testsuite at 1 second with version 323 currently rated 2495 ELO in the

CCRL 40/4 rating list and thereafter version 390. Run time ± 20-25 minutes per tested version.

• Double-click run-mrt-1s, it will open your browser and show you the results.

• That's it!

 

For 5 seconds testing double-click run_mea-5s and when finished double-click run_mrt-5s

For 10 seconds testing double-click run_mea-10s and when finished double-click run_mrt-10s

____________________________________________________________________________________

 

Testing new weight releases

• Download a new LC-zero network weight file [say 411]

• Unzip and rename the file as weights-411.txt

• Open run_mea-1s.bat with a text-editor

• Change "weights-323.txt" into "weights-411.txt"

• Change "lczero w323" into "lczero w411"

• Remove the other (second) MEA run.

• Save the file.

• And a double-click on the new run_mea-1s.bat will start the 411 version.

 

Other options

• Open run_mea-1s.bat with a text-editor

• To change the time control change --movetime 1000 [is 1 sec] to --movetime 200 [is 0.2 sec]

• To set the number of threads change --threads 1

• To set the hash table size change set HASH=128

• Save the file.

_______________________________________________________________________________________________

 

Sharing

Benchmarks

Mail me your benchmarks in the below form. Items without a * are optional

 
 
 
 
 

Name

NPS

ELO [1s]

ELO [ 5s ]

ELO [10s ]

Ed

33

1272

1617

1800

cf

153

1572

 

 

KS

71

1392

1817

1993

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

To calculate the LC-ZERO NPS of your CPU start LC-ZERO from the command line, type go infinite, let it run for 30-40 seconds and then type stop. Contribute that NPS number.