Baidu, a Chinese tech giant, has released its answer to OpenAI’s ChatGPT: ERNIE Bot. ERNIE Bot is based on Baidu’s large-language model, ERNIE, which was introduced in 2019. ERNIE and BERT (Bidirectional Encoder Representations from Transformers) are unsupervised pre-trained language models based on the transformer algorithm. OpenAI took LLMs further by pouring money into pre-training and then releasing a public chatbot based on the model, ChatGPT. Reviews of ERNIE Bot have been mixed, but the gap between the various models is likely to narrow.
