The Empirical Rabbit is one year old this month! It is time to summarise the highlights of the year, and indicate any changes to my perspective.

2011 Chinese
Year of the Rabbit
Lessons from Cognitive Psychology Nov 2010
This article summarises findings of cognitive psychology that are relevant to repeatedly solving chess problems. When the repetitions are closely spaced, performance increases rapidly, but long term memory retention is poor. When the repetitions are widely spaced, performance increases slowly, but long term memory retention is much better. Practical learning systems (e.g. those for learning foreign languages) space the initial repetitions closely, and gradually increase the intervals between successive repetitions.
Once Through vs. Repetition Nov 2010
This article remains a fair summary of the relative merits of solving an infinite stream of new problems, versus solving a smaller set of problems repeatedly. In practice, a compromise has to be made between practicing on as many problems as possible; and learning (and retaining) all the lessons that these problems have to teach. Another practical consideration is the limited supply of good problem sets - an infinite stream of problems is not available in the real world - so the real question is when to repeat!
7 Circles Dec 2010
This article remains a good summary of the limitations of Michael de la Maza’s 7 Circles method. MDLM solved 1,000 tactical chess problems seven times using the CT-ART 3.0 tactical trainer, halving the time interval between each repetition: 64 days, 32 days, 16 days, 8 days, 4 days, and 2 days. My experience was that by that by the time I had worked my way through Fred Reinfeld’s 1,001 Winning Chess Sacrifices and Combinations, and returned back to the beginning, I did not remember much. My accuracy had improved a little, but I was not obviously faster.
The Reinfeld Experiment Jan 2011
I decided to use Reinfeld’s 1,001 to experiment with expanding repetition intervals. After much experimentation, I decided to solve each batch of problems repeatedly at intervals of 1 day, 2 days, 4 days, 8 days, 16 days... My progress is summarised by the table:
Repetition: 1 2 3 4 5 6 7 8 9
Percent Score: 85% 93% 95% 95% 97% 97% 95% 92% 90%
Minutes/Problem: 3.5 2.7 2.0 1.5 1.3 1.3 1.2 1.0 1.2
Day Number: 1 2 4 8 16 32 64 128 256
This method was clearly highly effective at improving my performance at solving the problems that I was practicing, and helped me to refine my training methods.
The Bain Experiment Mar 2011
Inspired by Dan Heisman’s Novice Nook articles, I decided to apply my method to timed tests of the 388 simple tactics problems from John Bain’s Chess Tactics for Students. Again, I improved at the problems that I was practising - but what about problems that I had never seen before? Here is a histogram of the solution times for my first passes through three equally difficult problem sets:

I was astonished! The time limit method (see my October article Rating Points Revisited) estimates my improvement as 346 Elo points with a standard deviation of 134 Elo points, for a time limit of 5 seconds. Unfortunately, this very large apparent improvement appears to have been partly due to a high proportion of problems that were near duplicates.
Tactics Performance Measurement Apr 2011
This article discusses some important issues concerning tactics performance measurement. It has become clear that only reliable method of measuring tactics performance is to compile statistics for a large number of reliably rated players. The methods based on giving problems ratings and treating them as opponents (e.g. those used by the online tactics servers and my time limit method) can give only a rough indication.
The Woolum Experiment May 2011
For my next experiment, I used 792 problems from the next book on Dan Heisman’s list, which was Al Woolum’s Chess Tactics Workbook, repeating the problems on days 1, 3, 5, 7, 14, 26, 50 and 96. Here are the results for my first passes through six equally difficult problem batches:

The time limit method estimates my improvement as 136 Elo points with a standard deviation of 39 Elo points, for a time limit of 5 seconds. The proportion of near duplicates in Woolum is much more realistic than for Bain, so this result is more convincing.
The CHP Experiment Jul 2011
My next experiment used the next three books on Dan Heisman’s list: Jeff Coakley’s Winning Chess Strategy for Kids, Dan Heisman’s Back to Basics Tactics, and Bruce Pandolfini’s The Winning Way. I used the same repetition schedule as for the Woolum Experiment. Here are the results for my first passes through six equally difficult problem batches:

The time limit method estimates my improvement at the 583 problems in Heisman + Pandolfini as 71 Elo points with a standard deviation of 44 Elo points, for a time limit of 5 seconds. This result was not as convincing as for Woolum, but it was still encouraging.
Time to Move Up a Gear Sep 2011
This article discusses the adjustments that I made to speed up my tactics training. Most importantly, I decided to finish Woolum at Pass 8, and omit Pass 3 from my schedule for my next two experiments. (I later decided to end CHP at Pass 8, and to end the next two experiments at what was now Pass 7.)
The Susan Polgar Experiment Sep 2011
My next experiment was based on Susan Polgar’s Chess Tactics for Champions. I divided the 570 problems into just four problem batches to save time, but at the cost of limiting my chances of accurately measuring my progress. Nonetheless, the time limit method estimates my improvement as 64 Elo points with a standard deviation of 33 Elo points, for a time limit of 5 seconds. To avoid schedule overload, I had to extend the interval between Pass 6 and Pass 7 from six weeks to eight weeks. Nonetheless, here are my results for Passes 2 to 7 of the first batch of problems:

There is some evidence of a drop off in the number of these problems that I was able solve in under 5 seconds, but the number that I failed to solve within 40 seconds reduced steadily. (It may be significant that I was tackling harder problem sets in later experiments between Passes 6 and 7 of this experiment.)
The Ivashchenko 1b Experiment Oct 2011
This experiment was based 539 problems from Sergey Ivashchenko‘s Chess School 1b. I divided the problems into just four problem batches, which again limited my chances of obtaining a clear result. The time limit method estimates my improvement as about 70 Elo points at the longer time limits, but the standard deviation is at least as large - so we cannot draw any firm conclusions here.
The blog that seeks out hard evidence concerning chess training methods for the average player - particularly the not so young average player.
Tuesday, 1 November 2011
Beyond the Blue Coakley
I have already said that Jeff Coakley’s Winning Chess Exercises for Kids (the hardest Coakley) is the subject of my next tactics training experiment, but what is there for me to consider after that?
Richard Palliser’s Complete Chess Workout - 1,200 problems:
http://www.chesscafe.com/text/review621.pdf
http://www.chessville.com/reviews/TheCompleteChessWorkoutVsChessGems.htm
This book gets good reviews on Amazon and elsewhere, and is reasonably priced with a good cost per problem. The introduction to the book says that it was written for club players. I have bought a copy, and it looks very good. I was put off buying this book for a long time by the publishers statement that it is suitable for all levels of player. Fortunately, that is not true.
Ray Cheng’s Practical Chess Exercises - 600 problems:
http://www.chesscafe.com/text/review595.pdf
http://www.chessville.com/reviews/PracticalChessExercises.htm
I have had a copy of this book for some time. I will have to get round to using it! The book gets good reviews on Amazon and elsewhere. 600 problems is not a lot, but the book is cheap and the price per problem is good.
Maxim Blokh’s Combinative Motifs - “Many more than” 1,205 problems:
http://www.chesscafe.com/text/review535.pdf
I had a chance to look at a copy of this book at a local tournament. It is sorted by motif, with numbers in circles indicating the difficulty of the problems. I would have expected more than a small paper back for the money, but the diagrams are not too bad, and the price per problem is reasonable. This book is the paper version of the computer based trainer CT-ART 3.0, which has a good reputation. The latest version of this trainer, CT-ART 4.0 has 2,200 basic exercises and 1,800 auxiliary exercises:
http://www.chesscafe.com/text/review730.pdf
I have not seen any praise of the new problems added in CT-ART 4.0, and the paper version is more convenient.
Sergey Ivashchenko’s Chess School 2 - 1,188 problems:
http://www.chesscafe.com/text/review546.pdf
I expect that the format of this book is the same as for Chess School 1b, which I found to be excellent. The book is expensive, but the price per problem is reasonable. The computer version of this book is Chess Tactics for Intermediate Players:
http://www.chesscafe.com/text/review453.pdf
I found a web post saying this program is harder than CT-ART. Again, the paper version is preferable.
Chessimo - More than 6,000 problems:
http://www.chessimo.com/trainer/chessimo-en-1
It has tactics, strategy and endgame modules, with built in repetition. The endgame modules have a particularly good reputation, and the strategy modules look good too. Chessimo is not cheap, but it does appear to offer a lot for the money.
Yakov Neishtadt's Improve Your Chess Tactics - 700 problems:
http://lousyatchess.blogspot.com/2011/05/review-improve-your-chess-tactics.html
I have a copy of the forerunner of this book, Neishtadt’s Test Your Tactical Ability, which is very good. The new book contains more problems, and omits the very hard “Do You Know the Classics?” chapter. Kasparov’s coach has been quoted as saying that it is the best tactics book ever. I also had chance to look at this book at the tournament. The diagrams are tiny! My optician says that I have excellent corrected vision, but I do not believe that I could cope with this book. I will stick to the old book!
Other Possibilities
Unfortunately, most tactics books are claimed to be suitable for beginners to super GMs, which is not what I want at all! The Ultimate Chess Puzzle Book, Giant Chess Puzzle Book and Quality Chess Puzzle Book all appear to fall into this “something for everyone, but not much for anyone” category. However, as with the Palliser book, this may just be misguided marketing. None of these books are cheap, but the price per problem is reasonable. Sharpen Your Tactics (Lein) is widely recommended, but is out of print. Second hand copies are usually very expensive after shipping from the US. One review on Amazon said that the problems were 75% checkmates, which is not ideal.
Richard Palliser’s Complete Chess Workout - 1,200 problems:
http://www.chesscafe.com/text/review621.pdf
http://www.chessville.com/reviews/TheCompleteChessWorkoutVsChessGems.htm
This book gets good reviews on Amazon and elsewhere, and is reasonably priced with a good cost per problem. The introduction to the book says that it was written for club players. I have bought a copy, and it looks very good. I was put off buying this book for a long time by the publishers statement that it is suitable for all levels of player. Fortunately, that is not true.
Ray Cheng’s Practical Chess Exercises - 600 problems:
http://www.chesscafe.com/text/review595.pdf
http://www.chessville.com/reviews/PracticalChessExercises.htm
I have had a copy of this book for some time. I will have to get round to using it! The book gets good reviews on Amazon and elsewhere. 600 problems is not a lot, but the book is cheap and the price per problem is good.
Maxim Blokh’s Combinative Motifs - “Many more than” 1,205 problems:
http://www.chesscafe.com/text/review535.pdf
I had a chance to look at a copy of this book at a local tournament. It is sorted by motif, with numbers in circles indicating the difficulty of the problems. I would have expected more than a small paper back for the money, but the diagrams are not too bad, and the price per problem is reasonable. This book is the paper version of the computer based trainer CT-ART 3.0, which has a good reputation. The latest version of this trainer, CT-ART 4.0 has 2,200 basic exercises and 1,800 auxiliary exercises:
http://www.chesscafe.com/text/review730.pdf
I have not seen any praise of the new problems added in CT-ART 4.0, and the paper version is more convenient.
Sergey Ivashchenko’s Chess School 2 - 1,188 problems:
http://www.chesscafe.com/text/review546.pdf
I expect that the format of this book is the same as for Chess School 1b, which I found to be excellent. The book is expensive, but the price per problem is reasonable. The computer version of this book is Chess Tactics for Intermediate Players:
http://www.chesscafe.com/text/review453.pdf
I found a web post saying this program is harder than CT-ART. Again, the paper version is preferable.
Chessimo - More than 6,000 problems:
http://www.chessimo.com/trainer/chessimo-en-1
It has tactics, strategy and endgame modules, with built in repetition. The endgame modules have a particularly good reputation, and the strategy modules look good too. Chessimo is not cheap, but it does appear to offer a lot for the money.
Yakov Neishtadt's Improve Your Chess Tactics - 700 problems:
http://lousyatchess.blogspot.com/2011/05/review-improve-your-chess-tactics.html
I have a copy of the forerunner of this book, Neishtadt’s Test Your Tactical Ability, which is very good. The new book contains more problems, and omits the very hard “Do You Know the Classics?” chapter. Kasparov’s coach has been quoted as saying that it is the best tactics book ever. I also had chance to look at this book at the tournament. The diagrams are tiny! My optician says that I have excellent corrected vision, but I do not believe that I could cope with this book. I will stick to the old book!
Other Possibilities
Unfortunately, most tactics books are claimed to be suitable for beginners to super GMs, which is not what I want at all! The Ultimate Chess Puzzle Book, Giant Chess Puzzle Book and Quality Chess Puzzle Book all appear to fall into this “something for everyone, but not much for anyone” category. However, as with the Palliser book, this may just be misguided marketing. None of these books are cheap, but the price per problem is reasonable. Sharpen Your Tactics (Lein) is widely recommended, but is out of print. Second hand copies are usually very expensive after shipping from the US. One review on Amazon said that the problems were 75% checkmates, which is not ideal.
Chess Combinations for Club Players
I downloaded a copy of Chess Combinations for Club Players (CCFCP), when it was being offered at a discount and the price per problem looked good. CCFP does indeed have 2,056 problems, but they are very repetitive. I counted what appeared to be three exact duplicates in six problems on one occasion! Even when the problems were not exact duplicates, they were usually very similar to others in the set.
Convekta, the publisher the CCFCP software, says that it is suitable for club players and intermediate players, 1400–1800 Elo. By comparison, Convekta says Chess School 1b is suitable for Elo 1200-1500. This suggests that CCFCP should about 300 points harder than Chess School 1b - but most of the problems are about 300 points easier! The problems in CCFCP are grouped into folders labelled Level 3 to 17, with the problems at the higher Levels given higher ratings. Nonetheless, I found that I scored 98%, irrespective of the Level, which suggests that there is no significant difference in difficulty between the Levels. Here is an example of a problem rated 2800:

(N.B. You can enlarge the diagrams by clicking on them.) The solution to this problem is obvious, given the hint “annihilation of an important square defence”. Black plays 1...Bxa3 and meets 2.ba with 2...Nxc2+ forking the king and rook. There are problems harder than that in Bain! If that is a 2800 problem, I am Magnus Carlsen! Does that mean that all the problems in CCFCP are trivial? Not entirely. The only continuation on which you are tested is the game continuation, and with very few exceptions, that is trivial. However, for about 10% of the problems, there is a defence that is more problematic. Here is an example:

The only continuation on which you are tested here is 1...Qc6 Qxc6 2.Nxe7+ Kh8 3.Nxc6, but what about the other defences? 1...Qa7 is trickier, but defeated by 2.Qe6+ (if 2...Rf7 3.Nh6+). 1...Qd7 is also trickier, but is defeated by 2.Ne5. Nonetheless, given the hint “decoy to a knight fork,” what else could the solution be? This problem is at Level 10, but there are problems that are at least as tricky at the easiest Levels. Nonetheless, these problems do not have higher ratings than completely trivial problems in the same folder!
The program’s scoring was rather generous, giving me credit for finding the remaining moves when I failed to find the first move. Nonetheless, I found it hard to score more than 98%, partly because of the occasional tricky problem; and partly because only the game continuation is counted as correct, and there is often more than one way of capturing a piece, for example. The games from which the problems are are sometimes between lowly rated or unrated players, so the game continuation is not always the best. Nonetheless, in Learn mode (an untimed test), I was awarded a totally meaningless rating of 2290.
A minor gripe is that when the problem has Black to move, Peshka (the interface used by CCFCP) displays Black at the bottom of the board and White at the top. There is an icon on the lower left hand side of the board to flip the board round; but there is no box that I can check to say that I always want standard diagrams with White at the bottom. Another minor gripe is that there is no easy way of selecting a particular problem by number. It is possible to select a particular problem using the row of buttons just above the board. (In the diagram above, these buttons are green for the problems that I have completed, and grey for the others.) However, there is no space to number the buttons, and you have to click on the button to see the problem (AKA Task) number. It would be a big improvement if hovering the mouse over a button brought up a bubble showing the problem number.
By clicking the Play icon, it is possible to enter moves that are not part of the solution and receive replies from Crafty, the onboard computer engine. However, there is no way of entering alternative defences, and getting Crafty to show you how to defeat them. However, even if there was a way of making Crafty switch sides, that would still be more time consuming than simply being given the complete solution as in a problem book. Having to type in the solution makes sense if you are tested on all the reasonable defences, but not if you are only tested on the least challenging one.
The problems in CCFCP are sorted by:
* Annihilation of defence of a piece.
* Annihilation of an important square defence.
* Decoy of a king into a mating net.
* Decoy to a knight fork.
* Intercepting a piece defending another piece.
* Distraction of a piece defending another piece.
The “decoy of a king into a mating net” problems are all trivial mates in 2, in which the king is decoyed to a square on which it can be mated. The “intercepting a piece defending another piece” problems are mostly trivial removal of the guard problems. The “distraction of a piece defending another piece” problems are mostly trivial problems in which the line of defence of a piece is intercepted. Clearly, this list is only a subset of the tactical motifs that are included in most elementary tactics books. Given that most of the problems are so trivial, it would be better if they were in random order of motif.
The CCFCP software labels the problem folders as “Ctart for beginners2,” but beginners need proper solutions, so I do not believe that this product is suitable for beginners. (Indeed, the absence of proper solutions is likely to cause some difficulty even for strong club players.) Beginners would also need the problems to be reliably sorted into order of difficulty. They also need to become accustomed to standard chess diagrams (with White at the bottom), and used to spotting simple tactics from both sides of the board. Strong club players are not likely to want a set of highly repetitious problems that are mostly at Bain level, with hints, and without proper solutions for the few tricky ones. I cannot recommend this product to anyone!
More positively, having bought CCFCP, I did work my way through all the problems, and I believe there was some value in that. I also got plenty of practice at solving problems with the diagram “the wrong way round,” which seems to be a necessary survival skill for the online servers. I was also able try out the Peshka interface.
I am sorry to have had to give my first negative review, but the tactics books that I have recommended are all very much better than this product.
Convekta, the publisher the CCFCP software, says that it is suitable for club players and intermediate players, 1400–1800 Elo. By comparison, Convekta says Chess School 1b is suitable for Elo 1200-1500. This suggests that CCFCP should about 300 points harder than Chess School 1b - but most of the problems are about 300 points easier! The problems in CCFCP are grouped into folders labelled Level 3 to 17, with the problems at the higher Levels given higher ratings. Nonetheless, I found that I scored 98%, irrespective of the Level, which suggests that there is no significant difference in difficulty between the Levels. Here is an example of a problem rated 2800:

(N.B. You can enlarge the diagrams by clicking on them.) The solution to this problem is obvious, given the hint “annihilation of an important square defence”. Black plays 1...Bxa3 and meets 2.ba with 2...Nxc2+ forking the king and rook. There are problems harder than that in Bain! If that is a 2800 problem, I am Magnus Carlsen! Does that mean that all the problems in CCFCP are trivial? Not entirely. The only continuation on which you are tested is the game continuation, and with very few exceptions, that is trivial. However, for about 10% of the problems, there is a defence that is more problematic. Here is an example:
The only continuation on which you are tested here is 1...Qc6 Qxc6 2.Nxe7+ Kh8 3.Nxc6, but what about the other defences? 1...Qa7 is trickier, but defeated by 2.Qe6+ (if 2...Rf7 3.Nh6+). 1...Qd7 is also trickier, but is defeated by 2.Ne5. Nonetheless, given the hint “decoy to a knight fork,” what else could the solution be? This problem is at Level 10, but there are problems that are at least as tricky at the easiest Levels. Nonetheless, these problems do not have higher ratings than completely trivial problems in the same folder!
The program’s scoring was rather generous, giving me credit for finding the remaining moves when I failed to find the first move. Nonetheless, I found it hard to score more than 98%, partly because of the occasional tricky problem; and partly because only the game continuation is counted as correct, and there is often more than one way of capturing a piece, for example. The games from which the problems are are sometimes between lowly rated or unrated players, so the game continuation is not always the best. Nonetheless, in Learn mode (an untimed test), I was awarded a totally meaningless rating of 2290.
A minor gripe is that when the problem has Black to move, Peshka (the interface used by CCFCP) displays Black at the bottom of the board and White at the top. There is an icon on the lower left hand side of the board to flip the board round; but there is no box that I can check to say that I always want standard diagrams with White at the bottom. Another minor gripe is that there is no easy way of selecting a particular problem by number. It is possible to select a particular problem using the row of buttons just above the board. (In the diagram above, these buttons are green for the problems that I have completed, and grey for the others.) However, there is no space to number the buttons, and you have to click on the button to see the problem (AKA Task) number. It would be a big improvement if hovering the mouse over a button brought up a bubble showing the problem number.
By clicking the Play icon, it is possible to enter moves that are not part of the solution and receive replies from Crafty, the onboard computer engine. However, there is no way of entering alternative defences, and getting Crafty to show you how to defeat them. However, even if there was a way of making Crafty switch sides, that would still be more time consuming than simply being given the complete solution as in a problem book. Having to type in the solution makes sense if you are tested on all the reasonable defences, but not if you are only tested on the least challenging one.
The problems in CCFCP are sorted by:
* Annihilation of defence of a piece.
* Annihilation of an important square defence.
* Decoy of a king into a mating net.
* Decoy to a knight fork.
* Intercepting a piece defending another piece.
* Distraction of a piece defending another piece.
The “decoy of a king into a mating net” problems are all trivial mates in 2, in which the king is decoyed to a square on which it can be mated. The “intercepting a piece defending another piece” problems are mostly trivial removal of the guard problems. The “distraction of a piece defending another piece” problems are mostly trivial problems in which the line of defence of a piece is intercepted. Clearly, this list is only a subset of the tactical motifs that are included in most elementary tactics books. Given that most of the problems are so trivial, it would be better if they were in random order of motif.
The CCFCP software labels the problem folders as “Ctart for beginners2,” but beginners need proper solutions, so I do not believe that this product is suitable for beginners. (Indeed, the absence of proper solutions is likely to cause some difficulty even for strong club players.) Beginners would also need the problems to be reliably sorted into order of difficulty. They also need to become accustomed to standard chess diagrams (with White at the bottom), and used to spotting simple tactics from both sides of the board. Strong club players are not likely to want a set of highly repetitious problems that are mostly at Bain level, with hints, and without proper solutions for the few tricky ones. I cannot recommend this product to anyone!
More positively, having bought CCFCP, I did work my way through all the problems, and I believe there was some value in that. I also got plenty of practice at solving problems with the diagram “the wrong way round,” which seems to be a necessary survival skill for the online servers. I was also able try out the Peshka interface.
I am sorry to have had to give my first negative review, but the tactics books that I have recommended are all very much better than this product.
Subscribe to:
Posts (Atom)