Small Simplicity

Understanding Intelligence from Computational Perspective

Jan 16, 2020

How to read a paper

Before you start

Q: "why are you reading this?"

  • Write it down where you can see it while reading the paper
    • Your purpose/goal of reading may change later. You will have a different experience then.
  • Is there a clear answer for this question? If not, you probably should not go on reading the paper

Warm-up (1 hr)

Think of it like going on a date with a new person. It's a new relationship, so don't try/expect to understand it in one go -- this is rude:)

  • Go to a quiet place for a few hours. Take your coffee with you

  • Start by reading the title and abstract

    • Goal: gain a high level overview of the paper
    • What are the main goals of the authors?
    • What are the high level results?
    • What is the problem the paper is solving?
  • Skim the paper (~15min)

    • Look at the figures
    • Jot down any keywords to look out for when reading
    • Goal: get a sense for the layout of the paper; get keywords to look out for
  • Go to introduction, especially if you feel unfamiliar with the field/paper. Okay to do it often.

    • Goal: get other references to fill in the gap in your understanding
  • Carefully step through each figure

    • why?: each figure contain key points of the paper. Authors spend a lot of time creating them and try to condense important information that supports their experiments/hypothesis. Pay particular attention to them.
    • Goal: Gain feel for what the authors think is most important; Write down what to look out for when reading the paper in detail (which will follow soon)
  • Take a break. Walk a bit.

First ~pass~ date (1.5hr)

Start taking high level notes. Expect new words, unfamiliar ideas. Mark those (you don't yet need to understand every single word), move on.

This is your first date with the paper. You are not going to learn all gory details about it, but you will ask good questions, understand what motivated the paper, and what it's going to be about.

  • Begin again with the abstract, skim through the introduction*

  • Diligent pass through the methods section

    • Goal: Draw down the overall setup
  • Read the results and discussion

    • Goal: write down the key findings and how they were determined
  • Take a break. Do jumping jacks. Sing a song.

Let's continue.

  • Revisit the figures: by now, you should be able to get into nitty gritties of the figures (having read the methods, results, and discussion section)
    • Goal: find more gems from the figures.
    • Spend about 30min ~ 1hr

Second full pass (1-2hrs)

Goal:

  • Focus on shoring up what you didn't understand previously,
  • Gain a command of the methods section
    • Test if you can write a pseudocode
  • Being a critical reader of the discussion section

Details:

  • Pay particular attention to the areas you marked as being difficult to understand. This is why you read a new paper. Don't play safe. Okay to feel uncomfortable. Okay to do it the following day (but don't push it back too much).

  • Leave no word undefined, unclear. Make sure you understand every sentence.

  • Skim through areas you feel confident in (eg. abstract, intro, results)

Guiding Questions

  • from Quora

  • What previous research and ideas were cited that this paper is building off of? (usually introduction)

  • Was there reasoning for performing this research, if so what was it? (introduction)
  • Clearly list out the objectives of the study
  • Did you write down 3 on your note?
  • Was any equipment/software used? (methods)
  • What variables were measured during experimentation? (methods)
  • Were any statistical tests used? What were their results? (methods/results)
  • What are the main findings? (results)
  • How do these results fit into the context of other research and their 'field'? (discussion)
  • Explain each figure and discuss their significance.
  • Did you write down 9 on your note?
  • Can the results be reproduced and is there any code available?
  • Name the authors, year, and title of the paper!
  • Are any of the authors familiar, do you know their previous work?
  • What key terms and concepts do I not know and need to look up in a dictionary, textbook, or ask someone?
  • What are your thoughts on the results? Do they seem valid?

Apply the technique

Most importantly, apply this guideline to your reading. Modify it to suit your personality.


Write a reading report

This is the end product of your reading. Without it, you didn't do your job.
^Really.

To check out ## check out: - Jason Eisner (JHU): [how to read a paper](https://www.cs.jhu.edu/~jason/advice/how-to-read-a-paper.html) - Prof.Murat at Buffalo: - [how to lead a reading group](https://tinyurl.com/rbree4d) - [how he reads a paper](http://muratbuffalo.blogspot.com/2013/07/how-i-read-research-paper.html) - how Prof. Nancy Lynch works: cool! - Cathy Wu, MIT: [how to lead a reading group](https://tinyurl.com/rbree4d)