TCEC

TCEC (Top Chess Engine Championship) is a computer chess tournament organized and maintained by Chessdom at https://tcec-chess.com/. This page documents Leela configuration in each of the "seasons" of this tournament.

Season 20

Division	Executable	Network	Placement	Result
SuFi	v0.27.0-dev PR1483	J94-100	2/2	47/100
DivP	v0.26.3	66740	1/8	38/56

SuFi Ordo evaluation:

   # ENGINE                                      :  RATING  ERROR  CFS(%)    W    D    L   GAMES
   1 Stockfish 20210113                          :      21     49    79.8   14   78    8     100
   2 LCZero 0.27.0d-Tilps-dje-magic_JH.94-100    :       0   ----     ---    8   78   14     100

DivP Ordo evaluation:

   # ENGINE                              :  RATING  ERROR  CFS(%)    W    D    L   GAMES
   1 Stockfish 20201225                  :       0     93    50.0   24   28    4      56
   2 LCZero v0.26.3_T60.66740            :       0   ----    91.8   24   28    4      56
   3 KomodoDragon 2647.00                :     -68     95    65.0   20   25   11      56
   4 AllieStein v0.8-120f959_net-15.0    :     -86     94    84.5   15   32    9      56
   5 Stoofvlees II a16                   :    -133     96    93.9   15   24   17      56
   6 ScorpioNN 3.0.11                    :    -204     93    64.9    4   34   18      56
   7 Ethereal TCEC S20 DivP              :    -223    101    73.7    6   27   23      56
   8 rofChade 2.309                      :    -255    101     ---    4   26   26      56

Individual statistics:
2) LCZero v0.26.3_T60.66740            0 :     56 (+24,=28,-4),  67.9 %
   vs.                                    :  games (  +,  =, -),   (%) :   Diff,   SD, CFS (%)
   Stockfish 20201225                     :      8 (  2,  4, 2),  50.0 :     -0,   47,   50.0
   KomodoDragon 2647.00                   :      8 (  4,  3, 1),  68.8 :    +68,   49,   91.8
   AllieStein v0.8-120f959_net-15.0       :      8 (  3,  5, 0),  68.8 :    +86,   48,   96.3
   Stoofvlees II a16                      :      8 (  4,  4, 0),  75.0 :   +133,   49,   99.7
   ScorpioNN 3.0.11                       :      8 (  4,  4, 0),  75.0 :   +204,   48,  100.0
   Ethereal TCEC S20 DivP                 :      8 (  3,  5, 0),  68.8 :   +223,   51,  100.0
   rofChade 2.309                         :      8 (  4,  3, 1),  68.8 :   +255,   52,  100.0

LC0 hardware and settings:

Hardware: 4x V100 + Xeon 8163 CPU @ 2.50GHz, 32 vcores
Non-default parameters:
- MoveOverheadMs=1000
- Backend=demux
- BackendOptions=backend=cuda-fp16,res_block_fusing=true,(gpu=0),(gpu=1),(gpu=2),(gpu=3)
- NNCacheSize=20000000
- MinibatchSize=320
- MaxPrefetch=160
- MaxCollisionEvents=917
- MaxOutOfOrderEvalsFactor=2.4
- SmartPruningMinimumBatches=300
- RootHasOwnCpuctParams=false
- CPuct=1.745
- CPuctBase=38739
- FpuValue=0.330
- CPuctFactor=3.894
- PolicyTemperature=1.359
- MovesLeftMaxEffect=0.2
- MovesLeftThreshold=0.0
- MovesLeftSlope=0.004
- MovesLeftQuadraticFactor=0.0
- MovesLeftScaledFactor=1.0
- TimeManager=legacy(steepness=4.0)
Added/Changed for SuFi:
- NNCacheSize=50000000
- RamLimitMb=96000

Season 19

Division	Executable	Network	Placement	Result
SuFi	v0.26.3-rc1	J92-190	2/2	45.5/100
DivP	v0.26.2-rc1	J92-100	2/8	32.5/56

SuFi Ordo evaluation:

   # ENGINE                                    :  RATING  ERROR  CFS(%)    W    D    L   GAMES
   1 Stockfish 202009282242_nn-baeb9ef2d183    :      32     49    89.7   18   73    9     100
   2 LCZero v0.26.3-rc1_T60.SV.JH.92-190       :       0   ----     ---    9   73   18     100

DivP Ordo evaluation:

   # ENGINE                                    :  RATING  ERROR  CFS(%)    W    D    L   GAMES
   1 Stockfish 202008260719_nn-82215d0fd0df    :      23     89    69.2   14   41    1      56
   2 LCZero v0.26.2-rc1_J92-100                :       0   ----    80.2   10   45    1      56
   3 AllieStein v0.8-120f959_net-15.0          :     -39     90    68.4    3   52    1      56
   4 Stoofvlees II a14                         :     -61     92    54.8    4   46    6      56
   5 Komodo 2576.00                            :     -67     92    59.5    4   45    7      56
   6 ScorpioNN 3.0.8.3                         :     -78     90    54.9    2   47    7      56
   7 Fire 8_beta                               :     -84     89    60.3    2   46    8      56
   8 Ethereal 12.43                            :     -95     86     ---    2   44   10      56

Individual statistics:
2) LCZero v0.26.2-rc1_J92-100               0 :     56 (+10,=45,-1),  58.0 %
   vs.                                          :  games (  +,  =, -),   (%) :   Diff,   SD, CFS (%)
   Stockfish 202008260719_nn-82215d0fd0df       :      8 (  0,  7, 1),  43.8 :    -23,   46,   30.8
   AllieStein v0.8-120f959_net-15.0             :      8 (  0,  8, 0),  50.0 :    +39,   46,   80.2
   Stoofvlees II a14                            :      8 (  1,  7, 0),  56.2 :    +61,   47,   90.4
   Komodo 2576.00                               :      8 (  1,  7, 0),  56.2 :    +67,   47,   92.3
   ScorpioNN 3.0.8.3                            :      8 (  3,  5, 0),  68.8 :    +78,   46,   95.6
   Fire 8_beta                                  :      8 (  1,  7, 0),  56.2 :    +84,   45,   96.7
   Ethereal 12.43                               :      8 (  4,  4, 0),  75.0 :    +95,   44,   98.5

LC0 hardware and settings:

Hardware: 4x V100 + Xeon 8163 CPU @ 2.50GHz, 32 vcores
Non-default parameters:
- MoveOverheadMs=1000
- Backend=demux
- BackendOptions=backend=cudnn-fp16,custom_winograd=true,(gpu=0),(gpu=1),(gpu=2),(gpu=3)
- NNCacheSize=20000000
- MinibatchSize=320
- MaxPrefetch=160
- MaxCollisionEvents=917
- MaxOutOfOrderEvalsFactor=2.4
- SmartPruningMinimumBatches=600
- MovesLeftMaxEffect=0.2
- MovesLeftThreshold=0.862976
- MovesLeftSlope=0.0004
Added/Changed for SuFi:
- BackendOptions=backend=cudnn-fp16,custom_winograd=true,res_block_fusing=true,(gpu=0),(gpu=1),(gpu=2),(gpu=3)
- MovesLeftThreshold=0.0
- MovesLeftSlope=0.004
- MovesLeftQuadraticFactor=0.0
- MovesLeftScaledFactor=1.0

Season 18

Division	Executable	Network	Placement	Result
SuFi	v0.25.1	svjio-t60-3972-mlh	2/2	46.5/100
DivP	v0.25.1	sv-t60-3010	2/8	24.5/42

SuFi Ordo evaluation:

   # ENGINE                               :  RATING  ERROR  CFS(%)    W    D    L   GAMES
   1 Stockfish 202006170741               :      25     49    83.6   23   61   16     100
   2 LCZero v0.25.1-svjio-t60-3972-mlh    :       0   ----     ---   16   61   23     100

DivP Ordo evaluation:

   # ENGINE                          :  RATING  ERROR  CFS(%)    W    D    L   GAMES
   1 Stockfish 202005232210          :      15    106    61.1    9   33    0      42
   2 LCZero v0.25.1-sv-t60-3010      :       0   ----    61.2    7   35    0      42
   3 AllieStein v0.7_dev-net_14.3    :     -15    105    55.8    7   33    2      42
   4 Stoofvlees II a14               :     -23    107    71.9    7   32    3      42
   5 Komodo 2551.00                  :     -53    105    71.5    4   34    4      42
   6 Ethereal 12.19                  :     -83    104    80.3    0   38    4      42
   7 rofChade 2.303                  :    -129    107    56.0    1   30   11      42
   8 Fire 8_beta                     :    -136    103     ---    0   31   11      42

Individual statistics:
2) LCZero v0.25.1-sv-t60-3010      0 :     42 (+7,=35,-0),  58.3 %
   vs.                                :  games ( +,  =, -),   (%) :   Diff,   SD, CFS (%)
   Stockfish 202005232210             :      6 ( 0,  6, 0),  50.0 :    -15,   54,   38.9
   AllieStein v0.7_dev-net_14.3       :      6 ( 0,  6, 0),  50.0 :    +15,   53,   61.2
   Stoofvlees II a14                  :      6 ( 1,  5, 0),  58.3 :    +23,   55,   66.1
   Komodo 2551.00                     :      6 ( 1,  5, 0),  58.3 :    +53,   54,   83.7
   Ethereal 12.19                     :      6 ( 2,  4, 0),  66.7 :    +83,   53,   94.0
   rofChade 2.303                     :      6 ( 2,  4, 0),  66.7 :   +129,   54,   99.1
   Fire 8_beta                        :      6 ( 1,  5, 0),  58.3 :   +136,   53,   99.5

LC0 hardware and settings:

Hardware: 4x V100 + Xeon 8163 CPU @ 2.50GHz, 32 vcores
Non-default parameters:
- MoveOverheadMs=1000
- Backend=demux
- BackendOptions=backend=cudnn-fp16,custom_winograd=true,(gpu=0),(gpu=1),(gpu=2),(gpu=3)
- NNCacheSize=20000000
- MinibatchSize=320
- MaxPrefetch=160
- MaxCollisionEvents=917
- MaxOutOfOrderEvalsFactor=2.4
- SmartPruningMinimumBatches=600
Added for SuFi:
- MovesLeftMaxEffect=0.2
- MovesLeftThreshold=0.0
- MovesLeftSlope=0.007
- MovesLeftQuadraticFactor=0.0
- MovesLeftScaledFactor=1.0
- MovesLeftConstantFactor=0.0

Season 13

Division	Executable	Network	Placement	Result
Div4	lc0 "v0.16.1" (b1301aa9)	10161	1st place	22.0/28
Div3	lc0 "v0.16.1" (b1301aa9)	10520	3rd place	16.0/28

Hardware: TCEC GPU server has 2x GTX 1080 ti. Full specs here
Command line: lc0 -w 10161 -t 4 --minibatch-size=512 --backend=multiplexing "--backend-opts=(backend=cudnn,gpu=0),(backend=cudnn,gpu=1)" --nncache=2000000 -l lc0debug.txt
UCI: Move time overhead in milliseconds=2000
- Div3 added: Time weight curve peak ply=37; Aggressive smart pruning threshold=0.604; Scale thinking time=3.05;

TCEC "v0.16.1" binary from appveyor

TCEC S13 issues

Bonus games 7-10-2018

Net IDs: kb3 and id481
Hardware: TheAnswer volunteered 2x1080 ti via ssh access.
Command line: ./lc0 -w [kb3|id481] --backend=multiplexing '--backend-opts=a(backend=cudnn,threads=2,gpu=0),b(backend=cudnn,threads=2,gpu=1)' -t 4 (kb1 and default respectively with increased move overhead to help with latency).

Season 12

Versions
- Div4: lczero v0.10, ID125 - +0 -25 =2 (and 1 win by forfeit)
Hardware: TCEC CPU server 2 x 8 core Intel Xeon E5-2689 @ 3300 MHz
Command line: lczero -w id125 ....?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

TCEC

Season 20

SuFi Ordo evaluation:

DivP Ordo evaluation:

LC0 hardware and settings:

Season 19

SuFi Ordo evaluation:

DivP Ordo evaluation:

LC0 hardware and settings:

Season 18

SuFi Ordo evaluation:

DivP Ordo evaluation:

LC0 hardware and settings:

Season 13

Bonus games 7-10-2018

Season 12

Clone this wiki locally