Deep learning models have disrupted the field of artificial intelligence (AI) since the early 2010s, with algorithms inspired by the structure and function of the brain. Transformer architecture and Generative Pre-trained Transformer (GPT) have further advanced the capabilities of AI models. DeepMind co-founder and Inflection CEO Mustafa Suleyman predicts that AI will continue its exponential progress, with orders-of-magnitude growth in model training sizes over the next few years. This could mean, for example, that an entire bookshelf of text could be entered as a prompt.
