In machine learning, a stochastic [stuh-kas-tik] parrot is a large language model (LLM) that is good at generating convincing language, but does not actually understand the meaning of the language it is processing. The term was coined by computational linguistics professor Emily M. Bender in the 2021 artificial intelligence research paper ‘On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?’
Stochastic means ‘random and involving chance or probability.’ A stochastic parrot,’ according to Bender, is an entity ‘for haphazardly stitching together sequences of linguistic forms … according to probabilistic information about how they combine, but without any reference to meaning.’ Less formally, the term refers to ‘large language models that are impressive in their ability to generate realistic-sounding language but ultimately do not truly understand the meaning of the language they are processing.’
read more »
The Daily Omnivore 