Is Deep Learning Hitting A Local Minimum ?

The study of Artificial Neural Networks (ANNs) has seen a phenomenal amount of research in recent years, with nearly 16,000 articles published in 2022 on arXiv.org. This has been justified by impressive results in various applications such as computer vision, natural language processing, and speech recognition. However, the problem of generalization remains significant and Deep Learning may be converging towards a local minimum, far from an optimal solution embodied by biological neural networks.