Deepmind Open-sources Ai Interpretability Research Tool Tracr

DeepMind has open-sourced TRAnsformer Compiler for RASP (Tracr), a compiler designed to translate programs into neural network models. The compiler is intended to help researchers understand the inner workings of Transformer AI models such as GPT-3, and provides a ‘ground truth’ model for evaluating AI interpretability tools.