memory usage - Artificial Intelligence News Briefing

Yandex N : Open-sources An Llm Training Tool That Saves Up To 20% Of Gpu Resources

Deep Learning Machine Learning June 11, 2024

Yandex has introduced YaFSDP, an open-source method for training large language models (LLMs) that offers a speedup of up to 26% compared to previous…

Collage: A New Machine Learning Approach To Deal With Floating-point Errors In Low-precision To Make Llm Training Accurate And Efficient

Deep Learning Natural Language Processing May 10, 2024

COLLAGE is a novel approach that uses a Multi-Component Float (MCF) representation to optimize efficiency and memory usage during training of large language models.…

Subscribe to Updates

Browsing: memory usage

Yandex N : Open-sources An Llm Training Tool That Saves Up To 20% Of Gpu Resources

Collage: A New Machine Learning Approach To Deal With Floating-point Errors In Low-precision To Make Llm Training Accurate And Efficient