Deep Learning From Basics to Practice

Version history

Cover-Volume1-Final
Cover-Volume2-Final

Big thanks to everyone who spotted and reported an error! In the list below, I've listed the name of the first sharp-eyed reader to spot each problem.

The online files will always contain the most recent version. If you've downloaded the book already, visit your Kindle library page to see if there's a new version available. If so, there will be a button to let you replace your current version with the new one, for free. If you're curious about which version you have, it's on the copyright page for each volume. I can only update the published files infrequently, so mostly I'll let them accumulate here until the number is overwhelming, or there's a really big error needing correcting.

Throughout the book I capitalize "Figure" and "Listing" when referring to a specific object, because in that context it's a name and thus a proper noun. So we'd see, "There is a figure below," and "The idea is shown in Figure 5-3." Style guidelines vary; this is the approach that makes sense to me.

Version 1.1

Page x, multiple references(Jim Blinn)
Some hyperlinks in the reference section contain an extra space at the end of the link. Others contain a space at the line break if the link is longer than one line. These appear to be artifacts of how hyperlinks are handled by the layout software. If a link fails for you, look for these extra internal or trailing spaces, and delete them after pasting the link into your browser's address bar.
Page 113, pph 2 (Christian Laforte)
"and and P(C|V) tell us how" >> "and P(C|V) tells us how"
Page 123, pph 2 (David Wiser)
"blook" >> "blood"
Page 137, Figure 3.31 (Dave Rahardja)
"False Negatives" label >> "Relevant Pages"
Page 150, pph 2 (Eric Haines)
"Man had a similar problem" >> "Men had a similar problem"
Page 168, caption Figure 4.9 (Arto Bendiken)
"and P(H,F) follows the same pattern" >> "and P(H,R) follows the same pattern"
Page 245 (David Wiser)
Moved Figure 6.6 down to its caption.
Page 273, pph 1 (Eric Haines)
"spearates" >> "separates"
Page 287, pph 4 (Eric Haines)
Removed space before comma in "means ,"
Page 303, pph 2 (David Wiser)
"wierdnesses" >> "weirdnesses"
Page 313, pph 1 (David Wiser)
"then after" >> "than after"
Page 339, pph 4 (Aaryaman Vasishta)
Added period between "overfitting" and "The more common"
Page 379, pph 1 (David Wiser)
"that or a stick figure" >> "that a stick figure"
Page 436, pph 1 (David Wiser)
"system the performs" >> "system that performs"
Page 447, pph 3 (David Wiser)
"Figure 12.12 shows" >> "Figure 12.8 shows"
Page 447, pph 3 (David Wiser)
"data in Figure 12.11" >> "data in Figure 12.6"
Page 463, pph 3 (Stefan Zellmann)
"the German eigen meaning "same," >> "the German eigen meaning “own” (or roughly “self”),"
Page 464, line 4 (Andrew)
"eigenndog" >> "eigendog"
Page 473, pph 3 (David Wiser)
"determines an output of out" >> "produces"
Page 482, line 2 (Andrew)
"we include the data" >> "we included the data"
Page 492, pph 2 (David Wiser)
"depdn" >> "depends"
Page 518, pph 1 (David Wiser)
"create at two children" >> "create at least two children"
Page 527, last pph (Richard Purcell)
"and we reported A" >> "and we reported B"
Page 539, pph 1 (David Wiser)
"usualy" >> "usually"
Page 550, pph 3 (David Wiser)
"by workassign" >> "assign"
Page 602, pph 2 (Richard Purcell)
"group of classifiers form" >> "group of classifiers from"
Page 621, last pph (David Wiser)
"wait for hours or even weeks fit()" >> "wait hours or even weeks for fit()"
Page 622, pph 3 (David Wiser)
"no straight line is doing" >> "no straight line is going"
Page 630, pph 1 (Richard Purcell)
"polynomials in bvoth" >> "polynomials in both"
Page 663, pph 4 (Richard Purcell)
"adds up the inputs and then" >> "adds up the inputs to"
Page 699, pph 2 (Richard Purcell)
"use to as a final step" >> "use it as a final step"
Page 699, pphs 3 and 4 (Ramon Montoya Vozmediano)
"The name is the same as the softmax activation function we saw above, because they’re based on similar mathematics. But this technique is not an activation function. This version of softmax turns the raw numbers that come out of the network into class probabilities" >> "The purpose of softmax is to turn the raw numbers that come out of the network into class probabilities. The mechanics of this process are intimately involved with the mathematics of how the network computes its predictions, so we won’t go into those details here. Figure 17.23 shows the idea: scores come in, and probabilities come out."
Page 710, pph 4 (Richard Purcell)
"may help to think to think" >> "may help to think"
Page 745, pph 2 (Andrew)
Deleted "value of V is (AC+ACm). Then the"
Page 747, pph 2 (Jaewon Jung)
Replaced each instance of Ao x Cd with 1/(Ao x Cd)
Page 747, pph3 (Jaewon Jung)
"Ao x Cd" >> 1
Page 747, pph3 (Jaewon Jung)
"change of 1" >> "change of 1/(Ao x Cd)"
Page 747, pph3 (Jaewon Jung)
"change of -1" >> "change of -1/(Ao x Cd)"
Page 747, Figure 18.23 (Jaewon Jung)
Replaced each "1" with "Ao x Cd", and vice-versa
Page 747, Figure 18.23 caption (Jaewon Jung)
Switched "1" and "Ao x Cd".
Page 747, pph3 (Andrew)
Deleted "by -1"
Page 768, pph 3 (Richard Purcell)
"move our stating point" >> "move our starting point"
Page 977, (David Wiser)
Chapter heading 24.4.2 >> 21.4.2
Page 979, (David Wiser)
Chapter heading 24.5 >> 21.5
Page 980, (David Wiser)
Chapter heading 24.6 >> 21.6
Page 983, (David Wiser)
Chapter heading 24.7 >> 21.7
Page 984, (David Wiser)
Chapter heading 24.7.1 >> 21.7.1
Page 985, (David Wiser)
Chapter heading 24.8 >> 21.8
Page 991, (David Wiser)
Chapter heading 24.9 >> 21.9
Page 996, (David Wiser)
Chapter heading 24.9.1 >> 21.9.1
Page 876, paragraph 2 (David Wiser)
"this layer this the end of" >> "this layer to be the end of"
Page 877, paragraph 4 (David Wiser)
"keep thing straight" >> "keep things straight"
Page 886, Figure 20.8 caption (David Wiser)
"We're set the dropout" >> "We've set the dropout"
Page 898, Caption Figure 20.13 (Ramon Montoya Vozmediano)
"Upper left" and "Bottom right" should be switched.
Page 916, paragraph 2 (David Wiser)
"the load was rejected" >> "the loan was rejected"
Page 916, paragraph 3 (David Wiser)
"all 5 officers to evaluate" >> "all 5 officers evaluate"
Page 934, paragraph 3 (David Wiser)
Removed 's from "We’d like to 's make a single number"
Page 970, caption Figure 21.31 (David Wiser)
"stride of in both directions 3" >> "stride of 3 in both directions"
Page 979, Figure 21.39 (David Wiser)
label '(v)' >> '(b)'
Page 979, Figure 21.39 (David Wiser)
Moved orange box in part (b) one step up
Page 980, last paragraph (David Wiser)
"It's normal convolution" >> "It's a normal convolution"
Page 988, paragraph 2 (David Wiser)
"each input of or starting" >> "each input of our starting"
Page 988, paragraph 2 (David Wiser)
"as shown Figure" >> "as shown in Figure"
Page 998, last paragraph (Ramon Montoya Vozmediano)
"chunks of a pooling step" >> "chunks of a padding step"
Page 1042, paragraph 1 (David Wiser)
"Figure 16" >> "Figure 22.16"
Page 1059, Figure 22.27 (David Wiser)
Corrected numbers in third column from the left.
Page 1059, Figure 22.28 (Andrew)
Moved arrows and labels to match new Figure 22.27.
Page 1068, paragraph 4 (David Wiser)
"counterclockwise circle" >> "clockwise circle"
Page 1096, paragraph 3 (David Wiser)
"For same reason" >> "For the same reason"
Page 1103, paragraph 2 (David Wiser)
"seen as a just a much" >> "seen as just a much"
Page 1193, last paragraph (David Wiser)
"of or own" >> "of our own"
Page 1198, paragraph 3 (David Wiser)
"so every files" >> "so every file"
Page 1213, paragraph 1 (David Wiser)
"Note that we've" >> "Note that we're"
Page 1217, Figure 24.5 caption (David Wiser)
added ", and batch values decrease to the right."
Page 1249, listing 24.17 (David Wiser)
Each instance of "model__" changed to "model_step__" (GitHub notebook was correct)
Page 1250, listing 24.19 (David Wiser)
Each instance of "model__" changed to "model_step__" (GitHub notebook was correct)
Page 1270, Figure 24.24 (David Wiser)
Grid changed to 5x5x3 to match text.
Page 1279, paragraph 2 (David Wiser)
"border_mode='same'" >> "padding='same'"
Page 1311, listing 24.55 (David Wiser)
Un-indented last two lines (GitHub notebook was correct)
Page 1315, Figure 24.55 (Andrew)
Adjusted figure so bottom isn't clipped.
Page 1320, listing 24.65 (David Wiser)
"inverse_trainY" >> "inverse_y_train"
Page 1320, listing 24.65 (David Wiser)
"inverse_testY" >> "inverse_y_test"
Page 1332, listing 24.66 (David Wiser)
missing last 4 lines of listing restored (GitHub notebook was correct)
Page 1333, paragraph 1 (Andrew)
"to either have settled down" >> "to have settled down"

Version 1.0.2

Both volumes
About a million changes!

Version 1.0.1

Copyright page (Mike Wong)
Fixed typo in "Institute"
Copyright page (Mike Wong)
Fixed typo in "Institute"
Copyright page (Andrew)
Added links and contact information
Title pages, both volumes (Andrew)
Added download page
Preface, Page iii, 3rd paragraph (David Pol)
Replaced "they are still require" with "they still require"
Preface, Page iii, 4rd paragraph (David Pol)
Replaced "applying them them" with "applying them"
Preface, Page iii, 6th paragraph (David Pol)
Replaced "presenation" with "presentation"
Page 8, paragraph 3 (Mauricio Vives)
Replaced "do that will" with "do that well"
Page 10, first line (Mauricio Vives)
Replaced "that the one" with "than the one"
Page 10, first paragraph (Mauricio Vives)
Replaced "Figure 1.out" with "figure out
Page 13, Figure 1.7 (Mauricio Vives)
Moved "Samples" label to y-axis
Page 13 (Mauricio Vives)
Inserted apostrophe in "it's using"
Page 13, Figure 1.9 (Mauricio Vives)
Moved "Samples" label to y-axis
Page 12, final paragraph (Andrew)
Replaced "so the label tells us the expert’s opinion gives us a score from 0 to 100, telling us whether that day’s weather does or does not make it a good day for hiking on that mountain." with: "The expert’s opinion, using a score from 0 to 100, tells how confident the expert is that the day’s weather would make for good hiking."
Page 15, final line (Mauricio Vives)
Inserted missing "h" in "no idea how"
Page 16, first full paragraph (Andrew)
Inserted "to" to read, "encourage the computer [to] generalize"
Page 22, first paragraph (Mauricio Vives)
Replaced "utensils" with "objects"
Page 25, second paragraph (Mauricio Vives)
Replaced "Figure 1." with "figure"
Page 35, last paragraph (Andrew)
Replaced "But in supervised" with "By contrast, in supervised"
Page 38, first paragraph (Andrew)
Replaced "dozens" with "dozens or more"
Page 38, second paragraph (Andrew)
Replaced "our deep" with "a deep"
Page 42, last paragraph (Eric Haines)
Replaced "to Figure 1.out" with "to figure out"
Page 49, second paragraph (Andrew)
Replaced "care about it" with "care about them"
Page 49, 5th paragraph (Kostya Smolenskiy)
Replaced "endup" with "end up"
Page 52, first paragraph (Andrew)
Replaced "that go" with "that we go"
Page 53, second paragraph (Andrew)
Replaced "chance of getting" with "expectation of getting"
Page 56, second paragraph (Andrew)
Replaced "0 to 1" with "0 to about 0.02"
Page 57, last paragraph (Andrew)
Replaced "just a programs" with "just programs"
Page 60, caption Figure 2.6 (Kostya Smolenskiy)
Replaced "all inputs" with "all other inputs"
Page 60, second paragraph (Christian Forfang)
Replaced "either of both" with "either or both"
Page 65, caption Figure 2.10 (Kostya Smolenskiy)
Replaced "cente r" with "center"
Page 66, first paragraph (Kostya Smolenskiy)
Removed line break after first sigma
Page 67, first paragraph (Christian Forfang)
Replaced "shape or a normal" with "shape of a normal"
Page 69, (Christian Forfang)
Replaced "return a 4" with "return a 3"
Page 107, first paragraph (Kostya Smolenskiy)
Replaced "Since in these pictures...landed in A" with "Given the sizes of A, B, and their overlap, the chance of landing in A given that we landed in B is greater than the chance of landing in B given that we landed in A."
Page 109, second paragraph (Andrew)
Reset third sentence to keep P(A,B)=P(A|B)*P(B) together
Page 109, final paragraph (Kostya Smolenskiy)
Replaced "right hand size" with "right hand side"
Page 116, final paragraph (Kostya Smolenskiy)
Replaced "light green for negative" with "light red for negative"
Page 126, first paragraph (Kostya Smolenskiy)
Replaced "line and pace" with "line and place"
Page 127, final parargraph (Kostya Smolenskiy)
Replaced "0 and 1" with "0 to 1"
Page 135, Figure 3.31 (Kostya Smolenskiy)
Corrected figure.
Page 138, Figure 3.34 (Mrinal Mohit)
Corrected the formula and picture for accuracy on next-to-last row
Page 148, final paragraph (Mrinal Mohit)
Replaced last sentence to describe new Figure 3.45
Page 149, Figure 3.45 (Mrinal Mohit)
Replaced figure and caption to illustrate an unintuitive example of perfect precision.
Page 238, third paragraph (Andrew)
Placed "tuba", "violin", "starfish", and "octopus" in quotes and removed italics
Page 241, third paragraph (Andrew)
Reset quote as block quote, and removed trailing comma
Page 241, fifth paragraph (Andrew)
Replaced "up a page by hand, one" with "up a page one"
Page 244, last paragraph (Andrew)
Replaced asterisk in 5*15 with multiplication symbol
Page 249, last paragraph (Andrew)
Replaced "melody" with "a melody"
Page 250, third paragraph (Andrew)
Replaced "dis-organization" with "disorganization"

Version 1.0.0

February 21, 2018

Initial Publication