Stockfish Handicap Matches

Really ?

How strong is Stockfish 11 ?

Stockfish version 11 is elo rated 3534 on the CCRL 40/2 rating list. We play time handicap matches as long as it takes that opponents can beat it. The first match is played at equal time control (40/10) and 1000 games. Thereafter we increase the time control of the opponent with a factor two (40/20) and 800 games. We repeat this process till the opponent finally is able to win or till the maximum of a factor 10 is reached.

SF11 versus

CCRL elo

Equal

Factor 2

Factor 2.5

Factor 3

Factor 3.5

Factor 4

Komodo 14

3446

29.9%

45.5%

51.6%

Houdini 6.03

3445

26.4%

40.4%

44.3%

47.9%

51.8%

SF11 versus

CCRL elo

Equal

Factor 2

Factor 3

Factor 4

F5

F6

F7

F8

Ethereal 12

3373

14.6%

29.7%

38.2%

43.4%

46.4%

50.5%

Xiphos 0.6

3336

16.1%

25.2%

34.1%

38.6%

42.6%

47.7%

49.1%

51.5%

Fire 7.1

3336

16.4%

31.9%

37.5%

44.3%

46.5%

50.6%

Rofchade 2.3

3306

16.6%

26.0%

34.0%

38.8%

39.0%

44.6%

45.0%

51.4%

SF11 versus

CCRL elo

Equal

Factor 2

Factor 4

Factor 6

Factor 8

Factor 10

Booot 6.4

3295

6.0%

15.6%

29.5%

36.0%

43.2%

48.0%

Schooner 2.2

3277

15.4%

19.7%

33.8%

34.7%

41.4%

44.6%

Laser 1.7

3274

7.4%

19.3%

27.7%

28.0%

42.1%

42.1%

100 games only

SF11 versus

CCRL elo

Equal

Factor 10

Shredder 13

3271

5.4%

34.7%

Defenchess 2.2

3269

12.4%

43.0%

RubiChess 1.7.2

3243

5.0%

47.0%

Andscacs 0.95

3229

9.5%

28.0%

Arasan 22

3181

3.5%

33.0%

---------------------

---------------------

----------------

-------------------

Fruit 2.1

2685

1.0%

4.5%

Factor 100

Fun with the known names of the past

and/or former rating list leaders

and world champions.

Shredder

Multiple World Champion titles and dominating the rating lists from 1999-2004

Crafty

World Champion 1983 and 1986

Rybka

4 times World Champion [*] and dominating the rating lists from 2005-2011

Benjamin

aka Rebel. 3 times rating list leader, MM4 Turbo, ChessMachine, Rebel 8 & 9

* Rybka was disqualified in 2011

SF11 versus

CCRL elo

Equal

Factor 10

Factor 100

WLD *

Shredder 12

2955

1.5%

4.5%

18%

6  70 | 24

Crafty 25.6

2951

3%

6.5%

25%

12 | 62 | 26

Rybka 1.0

2852

crashed

6.0%

32.5%

15 | 50 | 35

Fruit 2.1

2685

1%

4.5%

9%

1 | 83 | 16

Benjamin

2646

0%

6.5%

11.5%

5 | 82 | 13

ProDeo 2.2

2771

0.5%

2.5%

9.0%

3 | 85 | 12

*   Win | Loss | Draw ratio, factor 100 only.


Progress has been incredible.

___________________________________________________________________________________


What about Lc0 ?

On CCRL 40/2 Lc0 is rated 3641 running on a RTX 2080, our test is done on a RTX 1060 6Gb.

Performance

Price

RTX 1060 6Gb

56.5

€217

RTX 2080

120

€680

Price

Intel I7 860

€68

Lc0 25.1 versus

CCRL elo

Threads

500 games

WDL

PGN

Stockfish 11

3534

1

53.9%

166 | 207 | 127

Stockfish 11

3596

4

67.9%

241 | 197 |  62

Last update June 21, 2020