AI can't cross this line and we don't know why.

Welch LabsLength: 24 minutesMachine learning & deep learning

In brief

A Welch Labs explainer on neural scaling laws and the compute-efficient frontier, asking why model loss seems to hit a line it cannot cross. It draws an analogy to an ideal gas law for AI.