GradIEEEnt half decent: The hidden power of imprecise lines
In brief
Tom 7 (suckerpinch) delivers a long, comedic digression on gradient descent and floating-point imprecision. He shows how rounding behavior can supply the nonlinearity needed to build a neural network.