#scaling-laws

#scaling-laws

A phrase I've often clung to regarding artificial intelligence is one that is also cloaked in a bit of techno-mystery. And I bet you've heard it as part of the lexicon of technology and imagination: "emergent abilities." It's common to hear that large language models (LLMs) have these curious "emergent" behaviors that are often coupled with linguistic partners like scaling and complexity. And yes, I'm guilty too.