Archive for July 31st, 2021

July 31, 2021

GPT-3

OpenAI

Generative Pre-trained Transformer 3 (GPT-3) is an autoregressive language model that uses deep learning to produce human-like text. It is the third-generation language prediction model in the GPT-n series (and the successor to GPT-2) created by OpenAI, a San Francisco-based artificial intelligence research laboratory.

Before the release of GPT-3, the largest language model was Microsoft’s Turing NLG, introduced several months earlier with a capacity of 17 billion parameters—less than a tenth of GPT-3’s.

read more »