PaLM-E is a new generalist robot model that enables the transfer of knowledge from various visual and linguistic domains to the robotic system. It is based on a powerful large-scale language model, PaLM, and is supplemented with sensor data from robotic systems. PaLM-E has been tested on a variety of robotic tasks, such as object manipulation, navigation, and language understanding, and has shown promising results.
