Why Language Models Are So Hard To Understand

AI researchers are using techniques inspired by neuroscience to study how language models work — and to reveal how perplexing they can be. The post Why Language Models Are So Hard To Understand first appeared on Quanta Magazine

Apr 30, 2025 - 15:57
 0
Why Language Models Are So Hard To Understand

You don’t typically build a machine without understanding how it works. But for artificial intelligence researchers building large language models, understanding is about the one thing they haven’t achieved. In fact, sometimes their work feels more like gardening than engineering. “Put a tomato seed into the ground and you get a tomato plant,” said Martin Wattenberg, a language model researcher…

Source