
## Highlights
- I find Anki a great help when reading research papers,
particularly in fields outside my expertise.
- I began with the
AlphaGo paper itself. I
began reading it quickly, almost skimming. I wasn't looking for
a comprehensive understanding. Rather, I was doing two
things. One, I was trying to simply identify the most important
ideas in the paper. What were the names of the key techniques
I'd need to learn about? Second, there was a kind of hoovering
process, looking for basic facts that I could understand easily,
and that would obviously benefit me. Things like basic
terminology, the rules of Go, and so on.
Here's a few examples of the kind of question I entered into
Anki at this stage: “What's the size of a Go
board?”; “Who plays first in Go?”; “How
many human game positions did AlphaGo learn from?”;
“Where did AlphaGo get its training data?”;
“What were the names of the two main types of neural
network AlphaGo used?”
As you can see, these are all elementary questions. They're the
kind of thing that are very easily picked up during an initial
pass over the paper, with occasional digressions to search
Google and Wikipedia, and so on. Furthermore, while these facts
were easy to pick up in isolation, they also seemed likely to be
useful in building a deeper understanding of other material in
the paper.
I made several rapid passes over the paper in this way, each
time getting deeper and deeper. At this stage I wasn't trying to
obtain anything like a complete understanding of
AlphaGo. Rather, I was trying to build up my background
understanding. At all times, if something wasn't easy to
understand, I didn't worry about it, I just keep going. But as I
made repeat passes, the range of things that were easy to
understand grew and grew. I found myself adding questions about
the types of features used as inputs to AlphaGo's neural
networks, basic facts about the structure of the networks, and
so on.
After five or six such passes over the paper, I went back and
attempted a thorough read. This time the purpose was to
understand AlphaGo in detail. By now I understood much of the
background context, and it was relatively easy to do a thorough
read, certainly far easier than coming into the paper
cold. Don't get me wrong: it was still challenging. But it was
far easier than it would have been otherwise.
- notes:: again the notion of multiple reading passes on a piece of content with varying depths of analysis to build a more holisitc understanding
- Most of my Anki-based reading is much shallower than my read of
the AlphaGo paper. Rather than spending days on a paper, I'll
typically spend 10 to 60 minutes, sometimes longer for very good
papers. Here's a few notes on some patterns I've found useful in
shallow reading.
As mentioned above, I'm usually doing such reading as part of
the background research for some project. I will find a new
article (or set of articles), and typically spend a few minutes
assessing it. Does the article seem likely to contain
substantial insight or provocation relevant to my project
– new questions, new ideas, new methods, new results? If
so, I'll have a read.
This doesn't mean reading every word in the paper. Rather, I'll
add to Anki questions about the core claims, core questions, and
core ideas of the paper. It's particularly helpful to extract
Anki questions from the abstract, introduction, conclusion,
figures, and figure captions. Typically I will extract anywhere
from 5 to 20 Anki questions from the paper. It's usually a bad
idea to extract fewer than 5 questions – doing so tends to
leave the paper as a kind of isolated orphan in my memory.
Later I find it difficult to feel much connection to those
questions. Put another way: if a paper is so uninteresting that
it's not possible to add 5 good questions about it, it's usually
better to add no questions at all.