OpenAI researchers have used sparse autoencoders to identify 16 million features in GPT-4, providing insight into what the model is ‘thinking’ about. This is a step towards understanding how AI models use information, as often developers are surprised by their creations’ abilities. However, more work is needed to fully interpret and understand these features.