LLMs Have High Crystallized And Low Fluid Intelligence
Shear's technical read on why current models feel brilliant and stupid in turns. He argues the transformer's real innovation is not that it outperforms traditional prediction algorithms on normal amounts of data, but that it keeps improving as you dump in more data and more compute, where other machine learning approaches hit diminishing returns fast. That lets you run it on every domain at once - effectively overfitting a statistical prediction algorithm on all explicit human knowledge. The consequence is that it is excellent at anything inside its training set or at a linear interpolation between several things in it, and poor at genuinely novel reasoning. His test case is a gears puzzle: seven alternating gears on a wall with a flag on the seventh, turn the first gear right and predict the flag. The model knows the general principle that gears alternate but struggles to reason it through, because nobody has written that particular question down. He frames it in psychometric terms as very high crystallized intelligence and pretty low fluid intelligence - and adds that the crystallized capability alone is immensely useful, while the day fluid intelligence arrives too is the scary one.
- Transformers' edge is continued benefit from more data and compute, not raw accuracy
- That allows training across every domain at once - all explicit human knowledge
- Strong on training-set content and interpolations; weak on novel problems
- The seven-gears-and-a-flag puzzle exposes the gap
- High crystallized intelligence, low fluid intelligence - and fluid arriving is the scary case
“There are seven gears on a wall each alternating.”
“it has a very high crystallized intelligence, but a pretty low fluid intelligence right now.”