A recent paper published by Google researchers entitled “Emergent Abilities of Large Language Models” examines language models represented by GPT-3 and finds that the performance of language models does not increase with the size of the model. It increases linearly, but there is a critical point. Only when the model is too large to exceed a certain critical value, capabilities that smaller models do not have will emerge. This emergent capability of language models may further extend the capabilities of language models.
