Google I/O 2023 saw the unveiling of PaLM 2, the latest general-purpose large language model from Google. PaLM 2 is the backbone of multiple Google products, such as Google Generative AI Search, Duet AI, Google Bard, and more. PaLM 2 is a successor to the earlier Pathways Language Model (PaLM) and is multilingual, supporting more than 100 languages. PaLM 2 is smaller in size than its predecessor, but is faster and more efficient. It is trained on 14.7 billion parameters, which is far less than PaLM 1 and other competitive models. Google is likely employing Reinforcement Learning from Human Feedback (RLHF), compute-optimal scaling, and other novel techniques in PaLM 2.
