Yandex N : Open-sources An Llm Training Tool That Saves Up To 20% Of Gpu Resources

Yandex has introduced YaFSDP, an open-source method for training large language models (LLMs) that offers a speedup of up to 26% compared to previous methods. This optimization can result in significant cost savings for developers and companies. The tool is available for free on Github and can improve LLM training efficiency for AI engineers and companies worldwide.