The spelled-out intro to language modeling: building makemore

Andrej KarpathyLength: 1 hour 57 minutesMachine learning & deep learning

In brief

Andrej Karpathy builds a bigram character-level language model from scratch, introducing torch.Tensor and the framework of training, sampling and loss evaluation. It is the first step toward a GPT-style Transformer in his makemore series.